GUI-Aided NIR and Color Image Blending

Radhakrishna Achanta, Andrea Guidi, Sabine Süsstrunk
Ieee Service Center, 445 Hoes Lane, Po Box 1331, Piscataway, Nj 08855-1331 Usa, 2010
Article de conférence

Résumé

A near-infrared (NIR) image of a scene contains different information than the corresponding visible spectrum (RGB) image, due to physical phenomena related to scattering, absorption, and reflectance of the different radiation bands. It can be desirable to combine the most relevant image content from both NIR and RGB to improve image quality. In this paper, we present two schemes of combining NIR and RGB information to obtain visually better quality images. The first is an automatic approach that performs segment-based NIR-blending by local and global entropy maximization. The second uses a GUI-aided approach where the user chooses the segments and manually con- trols blending. To minimize artifacts at the segment boundaries, three different boundary smoothing methods are introduced and compared in terms of speed and quality of output.

Official source

https://infoscience.epfl.ch/record/150131?ln=fr

À propos de ce résultat

Cette page est générée automatiquement et peut contenir des informations qui ne sont pas correctes, complètes, à jour ou pertinentes par rapport à votre recherche. Il en va de même pour toutes les autres pages de ce site. Veillez à vérifier les informations auprès des sources officielles de l'EPFL.

Concepts associés

Chargement

Publications associées

Chargement

Material Classification Using Color and NIR Images

Neda Salamati, Sabine Süsstrunk

Material classification is becoming more important in computer vision and digital photography applications, which require accurate classification of objects present in the imaged scene. This is a very challenging task because the sheer diversity of scene content and lighting conditions decreases the usefulness of many color- and texture-based features used in image classification. In this work, we investigate the potential offered by using information outside of the visible spectrum, specifically the near-infrared (NIR). The difference in the NIR images’ intensities is not just due to the particular color of the material, but also absorption and reflectance characteristics of the colorant. This relative independency of NIR and color information makes NIR images a prime candidate for classification. The database, on which the training and testing were conducted, consists of textile, tile, linoleum and wood samples. To classify the materials, visible and NIR images were analyzed according to their lightness, texture, and color. The analysis results were the input to a classifier in form of feature vectors. The results show that our database is classified almost exactly. Comparing with visible-only features, wood and textile samples were better classified due to the additional information the NIR images provide.

2009

Chargement

The colors in a digital image do not only depend on the scene's reflectances, but also on the lighting conditions and on the characteristics of the imaging device. It is often necessary to separate the influence of these three elements, in particular to separate the contribution of the object's reflection properties from the one of the incident light. Both are usually represented by spectral quantities, i.e., defined over the visible spectrum. The retrieval of illuminant and reflectances from an RGB image, which provides three values per pixel, is an under-determined problem and requires additional information or assumption on the scene's content in order to be solved. In this thesis, we study how redundant information across a set of images can be exploited to recover either illuminant or reflectance knowledge. We demonstrate that accurate object color can be retrieved as tristimulus values from standard RGB images captured with an unknown camera under uncontrolled lighting conditions and no access to raw data, but containing a limited number of reference colors in the form of a specific calibration target. The correction must be constrained to a limited range of colors similar to the one of the object of interest, which are compared to pre-computed references for the derivation of a linear transform. We implement this method for two consumer oriented applications in Makeup and Home Décor, respectively, which provide users with color advice. The correction accuracy is of ΔE*ab ≃ 1 to 2 depending on the design of the target. We show that this accuracy is sufficient for the applications at hand. We also developed a method to retrieve illuminant spectra from a set of images taken with fixed location cameras, such as panoramic or surveillance ones. In pictures captured with such devices, there will be changes in lighting and dynamic content, but there will also be constant objects. We propose to use these elements as reference colors to solve for color constancy. More precisely, we exploit that their reflectances, while unknown, remain constant across images. We invert a series of image formation models in parallel for a set of test illuminants and, by forcing the output reflectances to match, deduce the illuminant under which each image was captured. Simulations on synthetic RGB patches demonstrate that real daylight illuminants can be retrieved with a median angular under 3° from sets containing as little as four images using a limited number of reference surfaces.

EPFL2010

Chargement

Method to produce a full-color smoothed image

Sabine Süsstrunk

The present invention aims at providing a method to produce modified images of a human face while removing all defects, such as such as pigmentation irregularities (e.g., moles, freckles), irritation, roughness, or wrinkles This is achieved thanks to a method to produce a full-color smoothed image comprising the steps of : - acquiring a first image in the visible spectrum of a scene, - acquiring a second image in the near infra-red spectrum of the same or similar scene, - extracting the intensity information from the first image, - decomposing the intensity information from the first image into a first detail layer and a first base layer, - decomposing the second image into a second detail layer and a second base layer, - combining at least all or part of the second detail layer with at least all or part of the first base layer to produce a combined intensity information, - combining the color information of the first image with the combined intensity information to produce the full-color smoothed image

2016

Chargement

EPFL2010