Automated Three-Dimensional Microbial Sensing and Recognition Using Digital Holography and Statistical Sampling

We overview an approach to providing automated three-dimensional (3D) sensing and recognition of biological micro/nanoorganisms integrating Gabor digital holographic microscopy and statistical sampling methods. For 3D data acquisition of biological specimens, a coherent beam propagates through the specimen and its transversely and longitudinally magnified diffraction pattern observed by the microscope objective is optically recorded with an image sensor array interfaced with a computer. 3D visualization of the biological specimen from the magnified diffraction pattern is accomplished by using the computational Fresnel propagation algorithm. For 3D recognition of the biological specimen, a watershed image segmentation algorithm is applied to automatically remove the unnecessary background parts in the reconstructed holographic image. Statistical estimation and inference algorithms are developed to the automatically segmented holographic image. Overviews of preliminary experimental results illustrate how the holographic image reconstructed from the Gabor digital hologram of biological specimen contains important information for microbial recognition

Random-subset fitting of digital holograms for fast three-dimensional particle tracking

Fitting scattering solutions to time series of digital holograms is a precise way to measure three-dimensional dynamics of microscale objects such as colloidal particles. However, this inverse-problem approach is computationally expensive. We show that the computational time can be reduced by an order of magnitude or more by fitting to a random subset of the pixels in a hologram. We demonstrate our algorithm on experimentally measured holograms of micrometer-scale colloidal particles, and we show that 20-fold increases in speed, relative to fitting full frames, can be attained while introducing errors in the particle positions of 10 nm or less. The method is straightforward to implement and works for any scattering model. It also enables a parallelization strategy wherein random-subset fitting is used to quickly determine initial guesses that are subsequently used to fit full frames in parallel. This approach may prove particularly useful for studying rare events, such as nucleation, that can only be captured with high frame rates over long times.Engineering and Applied SciencesPhysic

Accurate single-shot quantitative phase imaging of biological specimens with telecentric digital holographic microscopy

The advantages of using a telecentric imaging system in digital holographic microscopy (DHM) to study biological specimens are highlighted. To this end, the performances of nontelecentric DHM and telecentric DHM are evaluated from the quantitative phase imaging (QPI) point of view. The evaluated stability of the microscope allows single-shot QPI in DHM by using telecentric imaging systems. Quantitative phase maps of a section of the head of the drosophila melanogaster fly and of red blood cells are obtained via single-shot DHM with no numerical postprocessing. With these maps we show that the use of telecentric DHM provides larger field of view for a given magnification and permits more accurate QPI measurements with less number of computational operations

No-search focus prediction at the single cell level in digital holographic imaging with deep convolutional neural network

Digital propagation of an off-axis hologram can provide the quantitative phase-contrast image if the exact distance between the sensor plane (such as CCD) and the reconstruction plane is correctly provided. In this paper, we present a deep-learning convolutional neural network with a regression layer as the top layer to estimate the best reconstruction distance. The experimental results obtained using microsphere beads and red blood cells show that the proposed method can accurately predict the propagation distance from a filtered hologram. The result is compared with the conventional automatic focus-evaluation function. Additionally, our approach can be utilized at the single-cell level, which is useful for cell-to-cell depth measurement and cell adherent studies. © 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement.1

Automated red blood cells extraction from holographic images using fully convolutional neural networks

In this paper, we present two models for automatically extracting red blood cells (RBCs) from RBCs holographic images based on a deep learning fully convolutional neural network (FCN) algorithm. The first model, called FCN-1, only uses the FCN algorithm to carry out RBCs prediction, whereas the second model, called FCN-2, combines the FCN approach with the marker-controlled watershed transform segmentation scheme to achieve RBCs extraction. Both models achieve good segmentation accuracy. In addition, the second model has much better performance in terms of cell separation than traditional segmentation methods. In the proposed methods, the RBCs phase images are first numerically reconstructed from RBCs holograms recorded with off-axis digital holographic microscopy. Then, some RBCs phase images are manually segmented and used as training data to fine-tune the FCN. Finally, each pixel in new input RBCs phase images is predicted into either foreground or background using the trained FCN models. The RBCs prediction result from the first model is the final segmentation result, whereas the result from the second model is used as the internal markers of the marker-controlled transform algorithm for further segmentation. Experimental results show that the given schemes can automatically extract RBCs from RBCs phase images and much better RBCs separation results are obtained when the FCN technique is combined with the marker-controlled watershed segmentation algorithm. © 2017 Optical Society of America.1

Holographic particle localization under multiple scattering

We introduce a novel framework that incorporates multiple scattering for large-scale 3D particle-localization using single-shot in-line holography. Traditional holographic techniques rely on single-scattering models which become inaccurate under high particle-density. We demonstrate that by exploiting multiple-scattering, localization is significantly improved. Both forward and back-scattering are computed by our method under a tractable recursive framework, in which each recursion estimates the next higher-order field within the volume. The inverse scattering is presented as a nonlinear optimization that promotes sparsity, and can be implemented efficiently. We experimentally reconstruct 100 million object voxels from a single 1-megapixel hologram. Our work promises utilization of multiple scattering for versatile large-scale applications

Quantitative analysis of three-dimensional morphology and membrane dynamics of red blood cells during temperature elevation

The optimal functionality of red blood cells is closely associated with the surrounding environment. This study was undertaken to analyze the changes in membrane profile, mean corpuscular hemoglobin (MCH), and cell membrane fluctuations (CMF) of healthy red blood cells (RBC) at varying temperatures. The temperature was elevated from 17 °C to 41 °C within a duration of less than one hour, and the holograms were recorded by an off-axis configuration. After hologram reconstruction, we extracted single RBCs and evaluated their morphologically related features (projected surface area and sphericity coefficient), MCH, and CMF. We observed that elevating the temperature results in changes in the three-dimensional (3D) profile. Since CMF amplitude is highly correlated to the bending curvature of RBC membrane, temperature-induced shape changes can alter CMF’s map and amplitude; mainly larger fluctuations appear on dimple area at a higher temperature. Regardless of the shape changes, no alterations in MCH were seen with temperature variation. © 2019, The Author(s).1

Roadmap on digital holography [Invited]

This Roadmap article on digital holography provides an overview of a vast array of research activities in the field of digital holography. The paper consists of a series of 25 sections from the prominent experts in digital holography presenting various aspects of the field on sensing, 3D imaging and displays, virtual and augmented reality, microscopy, cell identification, tomography, label-free live cell imaging, and other applications. Each section represents the vision of its author to describe the significant progress, potential impact, important developments, and challenging issues in the field of digital holography

Automated multi-parameter measurement of cardiomyocytes dynamics with digital holographic microscopy

Compounds tested during drug development may have adverse effects on the heart; therefore all new chemical entities have to undergo extensive preclinical assessment for cardiac liability. Conventional intensity-based imaging techniques are not robust enough to provide detailed information for cell structure and the captured images result in low-contrast, especially to cell with semi-transparent or transparent feature, which would affect the cell analysis. In this paper we show, for the first time, that digital holographic microscopy (DHM) integrated with information processing algorithms automatically provide dynamic quantitative phase profiles of beating cardiomyocytes. We experimentally demonstrate that relevant parameters of cardiomyocytes can be obtained by our automated algorithm based on DHM phase signal analysis and used to characterize the physiological state of resting cardiomyocytes. Our study opens the possibility of automated quantitative analysis of cardiomyocyte dynamics suitable for further drug safety testing and compounds selection as a new paradigm in drug toxicity screen