The Reproduction of Specular Highlights on High Dynamic Range Displays

Laurence Meylan, Sabine Süsstrunk
2006
Conference paper

Abstract

Recent advances in the design of high dynamic range (HDR) monitors enable the display of images having a large dynamic range, close to that encountered in the real world. As their usage will increase, we will be confronted with the problem of rerendering images that have been mapped to standard dynamic range (SDR) displays so that they look natural on HDR monitors. We address this issue for SDR images representing original HDR scenes. We propose a tone scale function that takes advantage of the increase in dynamic range of HDR monitors to recreate the brightness of specular highlights, which were clipped or compressed by the capturing and rendering process to SDR. We validate the use of such functions with a psychovisual experiment conducted on an HDR display, where the observers’ task was to judge pairs of tone-scaled images. The result of the experiment shows that using part of the extension of dynamic range provided by HDR displays to enhance the brightness of specular highlights leads to more natural looking images.

Official source

https://infoscience.epfl.ch/record/85838?ln=en

About this result

This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Related concepts

Related publications

Tone mapping for high dynamic range images

Laurence Meylan

Tone mapping is an essential step for the reproduction of "nice looking" images. It provides the mapping between the luminances of the original scene to the output device's display values. When the dynamic range of the captured scene is smaller or larger than that of the display device, tone mapping expands or compresses the luminance ratios. We address the problem of tone mapping high dynamic range (HDR) images to standard displays (CRT, LCD) and to HDR displays. With standard displays, the dynamic range of the captured HDR scene must be compressed significantly, which can induce a loss of contrast resulting in a loss of detail visibility. Local tone mapping operators can be used in addition to the global compression to increase the local contrast and thus improve detail visibility, but this tends to create artifacts. We developed a local tone mapping method that solves the problems generally encountered by local tone mapping algorithms. Namely, it does not create halo artifacts, nor graying-out of low contrast areas, and provides good color rendition. We then investigated specifically the rendition of color and confirmed that local tone mapping algorithms must be applied to the luminance channel only. We showed that the correlation between luminance and chrominance plays a role in the appearance of the final image but a perfect decorrelation is not necessary. Recently developed HDR monitors enable the display of HDR images with hardly any compression of their dynamic range. The arrival of these displays on the market create the need for new tone mapping algorithms. In particular, legacy images that were mapped to SDR displays must be re-rendered to HDR displays, taking best advantage of the increase in dynamic range. This operation can be seen as the reverse of the tone mapping to SDR. We propose a piecewise linear tone scale function that enhances the brightness of specular highlights so that the sensation of naturalness is improved. Our tone scale algorithm is based on the segmentation of the image into its diffuse and specular components as well as on the range of display luminance that is allocated to the specular component and the diffuse component, respectively. We performed a psychovisual experiment to validate the benefit of our tone scale. The results showed that, with HDR displays, allocating more luminance range to the specular component than what was allocated in the image rendered to SDR displays provides more natural looking images.

EPFL2006

Stereoscopic video content is usually being created by using two or more cameras which are recording the same scene. Traditionally, those cameras have the exact same intrinsic camera parameters. In this project, the exposure times of the cameras differ, allowing to record different parts of the dynamic range of the scene. Image processing techniques are then used to enhance the dynamic range of the captured data. A pipeline for the recording, processing, and displaying of high dynamic range (HDR) stereoscopic content, acquired using inexpensive low dynamic range (LDR) cameras, is proposed. Two different approaches to obtain stereoscopic HDR content are presented and compared. In the temporal approach, different parts of the luminance range of the scene are recorded by temporally changing the exposure time of both cameras. Information from adjacent frames captured by the same camera is then used in order to increase the dynamic range. In the spatial approach, both cameras are assigned a distinct, fixed exposure time. Here, the dynamic range is increased by combining data from the cameras. It is found that the intrinsic problems of the spatial approach are much more difficult to deal with than the ones of the temporal approach. In particular stereo matching, the critical component to combine data in the spatial approach, is more difficult than traditionally because the two cameras have different exposure times. The results are evaluated for both static scenes and scenes with object movement using an objective quality metric of the visible differences of the stereoscopic pair independently, and visual evaluation on a stereoscopic display to evaluate the stereoscopic quality.

2011

We study the oversampled binary image sensor in [1] under noisy scenario. The binary image sensor is similar to traditional photographic film with pixel value equal to "0" or "1". The potential application of the oversampled binary image sensor is high dynamic range imaging. Since the pixel value is binary, we model the noise as additive Bernoulli noise. We focus on the case that the threshold in the binary sensor is equal to a single photon. Because of noise, the dynamic range of the sensor is reduced. But the image sensor is quite robust to noise when the light intensity value is large. We use maximum-likelihood estimator (MLE) to reconstruct the light intensity field, and prove that when the threshold is a single photon, even if there is noise, the log-likelihood function is still concave, which guarantees to find the global optimal solution. Experimental results for 1-D signal and 2-D images verify our performance analysis and show the effectiveness of the reconstruction algorithm.

Ieee2013

Tone mapping for high dynamic range images

Laurence Meylan

EPFL2006