Imaging tissues and cells beyond the diffraction limit with structured illumination microscopy and Bayesian image reconstruction

Background: Structured illumination microscopy (SIM) is a family of methods in optical fluorescence microscopy that can achieve both optical sectioning and super-resolution effects. SIM is a valuable method for high-resolution imaging of fixed cells or tissues labeled with conventional fluorophores, as well as for imaging the dynamics of live cells expressing fluorescent protein constructs. In SIM, one acquires a set of images with shifting illumination patterns. This set of images is subsequently treated with image analysis algorithms to produce an image with reduced out-of-focus light (optical sectioning) and/or with improved resolution (super-resolution). Findings: Five complete, freely available SIM datasets are presented including raw and analyzed data. We report methods for image acquisition and analysis using open-source software along with examples of the resulting images when processed with different methods. We processed the data using established optical sectioning SIM and super-resolution SIM methods and with newer Bayesian restoration approaches that we are developing. Conclusions: Various methods for SIM data acquisition and processing are actively being developed, but complete raw data from SIM experiments are not typically published. Publically available, high-quality raw data with examples of processed results will aid researchers when developing new methods in SIM. Biologists will also find interest in the high-resolution images of animal tissues and cells we acquired. All of the data were processed with SIMToolbox, an open-source and freely available software solution for SIM.

Super-resolution microscopy live cell imaging and image analysis

Tomas Lukes

Novel fundamental research results provided new techniques going beyond the diffraction limit. These recent advances known as super-resolution microscopy have been awarded by the Nobel Prize as they promise new discoveries in biology and live sciences. All these techniques rely on complex signal and image processing. The applicability in biology, and particularly for live cell imaging, remains challenging and needs further investigation. Focusing on image processing and analysis, the thesis is devoted to a significant enhancement of structured illumination microscopy (SIM) and super-resolution optical fluctuation imaging (SOFI)methods towards fast live cell and quantitative imaging. The thesis presents a novel image reconstruction method for both 2D and 3D SIM data, compatible with weak signals, and robust towards unwanted image artifacts. This image reconstruction is efficient under low light conditions, reduces phototoxicity and facilitates live cell observations. We demonstrate the performance of our new method by imaging long super-resolution video sequences of live U2-OS cells and improving cell particle tracking. We develop an adapted 3D deconvolution algorithm for SOFI, which suppresses noise and makes 3D SOFI live cell imaging feasible due to reduction of the number of required input images. We introduce a novel linearization procedure for SOFI maximizing the resolution gain and show that SOFI and PALM can both be applied on the same dataset revealing more insights about the sample. This PALM and SOFI concept provides an enlarged quantitative imaging framework, allowing unprecedented functional exploration of the sample through the estimation of molecular parameters. For quantifying the outcome of our super-resolutionmethods, the thesis presents a novel methodology for objective image quality assessment measuring spatial resolution and signal to noise ratio in real samples. We demonstrate our enhanced SOFI framework by high throughput 3D imaging of live HeLa cells acquiring the whole super-resolution 3D image in 0.95 s, by investigating focal adhesions in live MEF cells, by fast optical readout of fluorescently labelled DNA strands and by unraveling the nanoscale organization of CD4 proteins on a plasma membrane of T-cells. Within the thesis, unique open-source software packages SIMToolbox and SOFI simulation tool were developed to facilitate implementation of super-resolution microscopy methods.

Czech Technical University in Prague2017

Nanoscopy in nonlinear scanning fluorescence imaging systems

Grégoire Pierre Jean Laporte

In the last 30 years, superresolution in optical microscopy has been a major field of research. During this time, different techniques have been created to break the diffraction limit in order to make observations at a nanometric scale. Given that optical microscopy is non-invasive, those superresolution methods pave the way for a better understanding of biological mechanism at a molecular level. Most of those methods are based on a nonlinear interaction between the excitation light intensity and the sample response (often fluorescent signal). In the same time, nanodiamonds containing fluorescent defects have been proven to be a choice probe for superresolution nanos-copy since they exhibit a strong and stable fluorescent signal even under high light intensities exposure (often required to obtain nonlinear photoresponse). Nanodiamonds containing Nitrogen Vacancy (NV) defects that exhibit a red fluorescent signal had been previously shown to be a viable biomarker for STED superresolved image. First, we demonstrated that green fluorescent nanodia-monds containing Nitrogen-Vacancy-Nitrogen (NVN) defects can be used with a Stimulated Emission Depletion (STED) superreso-lution microscope. Then, we implemented a STED microscope in our lab and compared the properties of NVN and NV centers for STED imaging. We conclude that even if nanodiamonds with NVN defects are less intense, they can be used as a second color nonbleaching biomarker. To illustrate the potential use of green nanodiamonds as bio-compatible probe, we superresolved them internalized into a cell with STED microscopy. Second, we tried to work on one of the main limitation in STED nanoscopy: the lack of information in the axial direction within a single scan. We combined our home made STED microscope with a Double Helix phase mask that modifies the detection point spread function in order to obtain axial localization of the superresolved emitters. We achieved three dimensional localization of nanometric fluorescent emitters but we note that photobleaching was the main limitation of this approach with organic dyes. We discussed different solutions to limit the photobleaching and their feasibility. We also worked on a different superresolution technique that we named Computational Nonlinear Saturated (CNS) microscopy. We showed that with digital post treatment of the acquired data, a nonlinear photoresponse can be harnessed to any scanning microscope equipped with a camera detector to enhance the resolution. We demonstrated that increasing the excitation power and inducing fluorescence saturation, it is possible to break the diffraction limit in a conventional confocal microscope (after data post-treatment). However, with this method, we did not obtain a gain in resolution as high as with other superresolution tech-niques involving fluorescence saturation, such as saturated structured illumination microscopy. To understand the origin of this limitation, we carried out simulation to investigate the performance of CNS microscopy in noisy environments compared with wide field techniques. We propose alternative implementation and quantify the possible resolution gain with simulations. Finally, we demonstrated how a technique, initially created for optical microscopy, can be adapted to lensless endoscopic imaging...

EPFL2016

Application of CMOS image sensors in optical sectioning and polarization microscopy

Jelena Mitic

In this thesis new imaging approaches for optical microscopy are proposed and studied. They are based on the use of dynamic structured illumination in combination with a demodulation detection concept employing CMOS image detectors. Two particular implementations are suggested: real-time optical sectioning microscopy and whole field quantitative polarization microscopy. Optical sectioning, i.e depth resolved imaging, allows observation of thin sections in volumetric samples. In its classical configuration the wide-field microscope does not allow optical sectioning of the investigated objects. In this thesis the optical sectioning in a wide-field microscope is achieved by illuminating the sample with a continuously moving single spatial frequency pattern, which temporarily modulates the signal obtained on the photodetector. Only the object parts that are in the focus have a good contrast and consequently generate stronger signal on the detector. The optically sectioned images are obtained employing a CMOS image detector, which demodulates the time-dependent component of the image. Two different systems for real-time acquisition of optically sectioned images are proposed. The first one is based on a specially designed smart-pixel-detector-array (SPDA), which allows performing the signal processing by an electronic circuit integrated to each pixel of the sensor. The second system utilizes a commercial CMOS image sensor. Here, the images are treated by a digital signal processor (DSP) integrated into the camera (iMVS-155). Both approaches provide real-time acquisition of optically sectioned images. The proof of principle for the new method is demonstrated by imaging artificial three-dimensional reflective samples. The optical sectioning imaging of biological samples in bright-field mode and in fluorescence mode is also demonstrated. The optical sectioning performances of the studied systems are similar to that of the confocal microscope. However the new method has some advantages over the classical confocal system: e.g. the difficulties with the alignment and the post-processing inherent to the confocal system are avoided. The theoretical framework presented in the thesis describes the image formation in structured illumination for both reflective and fluorescent samples. The influence of longitudinal chromatic aberration and spherical aberration caused by specimen induced index mismatch on depth discrimination property are studied. In extension to the work related to optically sectioned microscopy, the quantitative polarization microscopy imaging method is proposed as a new application for CMOS detectors. The polarization state of the illuminating light is dynamically changed and the demodulation detection approach is employed to extract the retardance and azimuth of the birefringent sample in real-time; for a whole field of view. Examples of polarization sensitive measurements for different samples are presented. The theoretical analysis is performed using the Jones formalism. Finally, the potentials and limitations of the CMOS detectors for applications in optical microscopy are discussed. Thanks to constant advancements in CMOS technology, the acquisition speed, resolution and sensitivity of new CMOS detectors generations have been improved. This will allow adapting the methods proposed in this thesis for investigations of fast dynamic process where high temporal and spatial resolution is required.

EPFL2004