The virtual frame technique: ultrafast imaging with any camera

Many phenomena of interest in nature and industry occur rapidly and are difficult and cost-prohibitive to visualize properly without specialized cameras. Here we describe in detail the virtual frame technique (VFT), a simple, useful, and accessible mode of imaging that increases the frame acquisition rate of any camera by several orders of magnitude by leveraging its dynamic range. The VFT is a powerful tool for capturing rapid phenomena where the dynamics facilitate a transition between two states, and are thus binary. The advantages of the VFT are demonstrated by examining such dynamics in five physical processes at unprecedented rates and spatial resolution: fracture of an elastic solid, wetting of a solid surface, rapid fingerprint reading, peeling of adhesive tape, and impact of an elastic hemisphere on a hard surface. We show that the performance of the VFT exceeds that of any commercial high-speed camera not only in rate of imaging but also in field of view, achieving a 65MHz frame rate at 4MPx resolution. Finally, we discuss the performance of the VFT with several commercially available conventional and high-speed cameras. In principle, modern cell phones can achieve imaging rates of over a million frames per second using the VFT.

High sensitivity, incoherent differential imaging

Chiara Bonati

Microscopic visualisation of optically transparent samples has been a topic of interest for several decades. Features such as density or chemical composition can influence the optical phase of transmitted light, and phase contrast can reveal these structures. Several methods of phase contrast have been developed, which can be categorised as either interferometric or non-interferometric, based on the type of coherence properties of the light used. In this work, I focus on incoherent based phase contrast, in particular Differential Phase Contrast (DPC). The choice of incoherent light brings benefits such as the absence of distortions like speckle patterns and ringing patterns, increased spatial resolution, and a simpler setup that can be used for in-vivo applications. Moreover, DPC allows reconstruction of quantitative phase maps of the samples. On the other hand, coherent-based techniques demonstrate superior performance in terms of phase sensitivity. The first part of this thesis offers a quantitative analysis of the phase sensitivity of DPC and investigates the influence of optical parameters and sample characteristics. With simulations and experiments, a relation between numerical aperture and phase sensitivity is demonstrated, and the concept of spectral matching is introduced to enhance the contrast. The methods can be generalised to any DPC setup, and allow a-priori investigation of the sensitivity of a DPC microscope at the design stage rather than through testing. Comparison between the best sensitivity that can be achieved in DPC and state-of-the-art interferometric techniques, shows that it is not possible to reach comparable single-shot performances. In this thesis, it is shown that the reason for this limitation is the strong background in DPC images, which degrades the dynamic range. DPC images are obtained with mirrored illuminations, for which the background is identical and the phase term switches in sign. The difference between these pairs of images is computed digitally, which does not improve the limited dynamic range. Lock-in DPC is proposed as a solution: instead of sampling different illumination states, lock-in DPC demodulates the phase signal when the illumination is switched, and the background is never encoded. This is enabled by periodical switching of sources coupled with a smart pixel detector, the so-called "lock-in camera". Part of this work is dedicated to the theoretical description of this method, and the analysis of the expected benefit. Experiments are also described, that demonstrate a factor of 8 improvement in single-shot sensitivity compared to standard DPC. DPC is not the only imaging technique to suffer from high intensity background: it is easy to see how the use of a lock-in camera for differential imaging can be generalised to any situation where weak modulations can be induced over a strong background. Here, an example is presented with lock-in Shifted Excitation Raman Difference Spectroscopy (SERDS). SERDS is an established Raman spectroscopy technique that takes advantage of the Raman emission spectrum being relative to the excitation wavelength to remove unwanted fluorescence emission. Two spectra with shifted excitation wavelengths are measured, their difference is computed, and the fluorescence is thus digitally removed. The parallel with DPC is immediately apparent. Both simulations and experiments are used to demonstrate the advantage of analog demodulation.

EPFL2022

Stereoscopic High Dynamic Range Video

Dominic Rüfenacht

Stereoscopic video content is usually being created by using two or more cameras which are recording the same scene. Traditionally, those cameras have the exact same intrinsic camera parameters. In this project, the exposure times of the cameras differ, allowing to record different parts of the dynamic range of the scene. Image processing techniques are then used to enhance the dynamic range of the captured data. A pipeline for the recording, processing, and displaying of high dynamic range (HDR) stereoscopic content, acquired using inexpensive low dynamic range (LDR) cameras, is proposed. Two different approaches to obtain stereoscopic HDR content are presented and compared. In the temporal approach, different parts of the luminance range of the scene are recorded by temporally changing the exposure time of both cameras. Information from adjacent frames captured by the same camera is then used in order to increase the dynamic range. In the spatial approach, both cameras are assigned a distinct, fixed exposure time. Here, the dynamic range is increased by combining data from the cameras. It is found that the intrinsic problems of the spatial approach are much more difficult to deal with than the ones of the temporal approach. In particular stereo matching, the critical component to combine data in the spatial approach, is more difficult than traditionally because the two cameras have different exposure times. The results are evaluated for both static scenes and scenes with object movement using an objective quality metric of the visible differences of the stereoscopic pair independently, and visual evaluation on a stereoscopic display to evaluate the stereoscopic quality.

2011

Angular Resolved low loss EELS for Materials Characterization

Simon Schneider

Electron Energy Loss Spectrometry (EELS) in Transmission Electron Microscopy (TEM) is a powerful tool for the investigation of the electronic structure of materials. In the low loss regime, one can access the optical properties which are governed by the dielectric function ε(ω), which may be retrieved thanks to the so-called "loss function". The energy range covered by EELS goes from the infrared (less than 1 eV) to the hard X-rays (about 3 keV), each region having its own interest. The low loss region (0–100 eV) serves to investigate the valence electron structure and the inter-band transition behavior. Using angular resolved EELS gives further information about the dispersion behavior of the investigated material. This work is a part of a large project aiming a closer agreement between theory and experiment in angular resolved EELS by improving the state of the art in both fields. The purpose of this work is to set up a reliable experimental technique to retrieve the momentum transfer resolved single scattering distribution at very low energy with good accuracy and resolutions. One of the main challenges was to use the newly installed JEOL 2200 FS transmission electron microscope that is equipped with an in-column Ω filter for retrieval of the loss function in diffraction energy filtered TEM. Issues such as the angular resolution, contamination, image-coupling in diffraction mode and plural scattering have been solved. Several optical alignments and operational modes of the JEOL 2200 FS have been tested, and finally nano-beam diffraction was found to be the optimal running mode. This work provides for the first time a full 3D energy loss data cube in diffraction mode with energy and angular resolutions of 1 eV and 0.5 nm−1 respectively. After processing, the energy and angular relevant data span an energy loss range from 2.75 eV to 40.25 eV and the angular momentum transfer up to 12.5 nm−1. Although theoretically, without CCD camera binning and the maximum available camera length of the JEOL (250 cm), a momentum transfer resolution of 0.04 nm−1 would have been possible, the effective angular resolution was limited by the smallest obtainable beam convergence as well as by the remaining aberrations of the microscope. The presented technique can be reproduced on any transmission electron microscope equipped with an in-column energy filter. Furthermore, it is demonstrated that the proposed method provides working ranges in energy, spatial and angular resolutions limited only by the perfor- mance of the microscope. Previous techniques did not provide experimental results showing an energy resolution independent of the spatial and angular resolutions.