Liquid crystal hyperspectral imager

Hyperspectral imaging is the collection, processing and analysis of spectral data in numerous contiguous wavelength bands while also providing spatial context. Some of the commonly used instruments for hyperspectral imaging are pushbroom scanning imaging systems, grating based imaging spectrometers and more recently electronically tunable filters. Electronically tunable filters offer the advantages of compactness and absence of mechanically movable parts. Electronically tunable filters have the ability to rapidly switch between wavelengths and provide spatial and spectral information over a large wavelength range. They involve the use of materials whose response to light can be altered in the presence of an external stimulus. While these filters offer some unique advantages, they also present some equally unique challenges. This research work involves the design and development of a multichannel imaging system using electronically tunable Liquid Crystal Fabry-Perot etalons. This instrument is called the Liquid Crystal Hyperspectral Imager (LiCHI). LiCHI images four spectral regions simultaneously and presents a trade-off between spatial and spectral domains. This simultaneity of measurements in multiple wavelengths can be exploited for dynamic and ephemeral events. LiCHI was initially designed for multispectral imaging of space plasmas but its versatility was demonstrated by testing in the field for multiple applications including landscape analysis and anomaly detection. The results obtained after testing of this instrument and analysis of the images are promising and demonstrate LiCHI as a good candidate for hyperspectral imaging. The challenges posed by LiCHI for each of these applications have also been explored

Miniaturization of optical spectrometers

Spectroscopic analysis is one of the most widely used analytical tools across both scientific research and industry. Whilst laboratory bench-top spectrometer systems offer superlative resolution and spectral range, their miniaturization is crucial for applications where portability is paramount, or in-situ measurements must be made. Advancement in this field over the last three decades is now yielding microspectrometers with performance and footprint near those viable for lab-on-a-chip systems, smartphones and other consumer technologies. In this review, we briefly summarize the technologies that have emerged toward achieving these aims - including miniaturized dispersive optics, narrowband filter systems, Fourier transform interferometers and reconstructive microspectrometers - and discuss the challenges associated with improving spectral resolution while device dimensions shrink ever further.EPSRC: EP/L016087/1 National Natural Science Foundation of China (51706141, 51976122

Hyperspectral Data Acquisition and Its Application for Face Recognition

Current face recognition systems are rife with serious challenges in uncontrolled conditions: e.g., unrestrained lighting, pose variations, accessories, etc. Hyperspectral imaging (HI) is typically employed to counter many of those challenges, by incorporating the spectral information within different bands. Although numerous methods based on hyperspectral imaging have been developed for face recognition with promising results, three fundamental challenges remain: 1) low signal to noise ratios and low intensity values in the bands of the hyperspectral image specifically near blue bands; 2) high dimensionality of hyperspectral data; and 3) inter-band misalignment (IBM) correlated with subject motion during data acquisition. This dissertation concentrates mainly on addressing the aforementioned challenges in HI. First, to address low quality of the bands of the hyperspectral image, we utilize a custom light source that has more radiant power at shorter wavelengths and properly adjust camera exposure times corresponding to lower transmittance of the filter and lower radiant power of our light source. Second, the high dimensionality of spectral data imposes limitations on numerical analysis. As such, there is an emerging demand for robust data compression techniques with lows of less relevant information to manage real spectral data. To cope with these challenging problems, we describe a reduced-order data modeling technique based on local proper orthogonal decomposition in order to compute low-dimensional models by projecting high-dimensional clusters onto subspaces spanned by local reduced-order bases. Third, we investigate 11 leading alignment approaches to address IBM correlated with subject motion during data acquisition. To overcome the limitations of the considered alignment approaches, we propose an accurate alignment approach ( A3) by incorporating the strengths of point correspondence and a low-rank model. In addition, we develop two qualitative prediction models to assess the alignment quality of hyperspectral images in determining improved alignment among the conducted alignment approaches. Finally, we show that the proposed alignment approach leads to promising improvement on face recognition performance of a probabilistic linear discriminant analysis approach

Multispectral Imaging For Face Recognition Over Varying Illumination

This dissertation addresses the advantage of using multispectral narrow-band images over conventional broad-band images for improved face recognition under varying illumination. To verify the effectiveness of multispectral images for improving face recognition performance, three sequential procedures are taken into action: multispectral face image acquisition, image fusion for multispectral and spectral band selection to remove information redundancy. Several efficient image fusion algorithms are proposed and conducted on spectral narrow-band face images in comparison to conventional images. Physics-based weighted fusion and illumination adjustment fusion make good use of spectral information in multispectral imaging process. The results demonstrate that fused narrow-band images outperform the conventional broad-band images under varying illuminations. In the case where multispectral images are acquired over severe changes in daylight, the fused images outperform conventional broad-band images by up to 78%. The success of fusing multispectral images lies in the fact that multispectral images can separate the illumination information from the reflectance of objects which is impossible for conventional broad-band images. To reduce the information redundancy among multispectral images and simplify the imaging system, distance-based band selection is proposed where a quantitative evaluation metric is defined to evaluate and differentiate the performance of multispectral narrow-band images. This method is proved to be exceptionally robust to parameter changes. Furthermore, complexity-guided distance-based band selection is proposed using model selection criterion for an automatic selection. The performance of selected bands outperforms the conventional images by up to 15%. From the significant performance improvement via distance-based band selection and complexity-guided distance-based band selection, we prove that specific facial information carried in certain narrow-band spectral images can enhance face recognition performance compared to broad-band images. In addition, both algorithms are proved to be independent to recognition engines. Significant performance improvement is achieved by proposed image fusion and band selection algorithms under varying illumination including outdoor daylight conditions. Our proposed imaging system and image processing algorithms lead to a new avenue of automatic face recognition system towards a better recognition performance than the conventional peer system over varying illuminations

System of System Integration for Hyperspectral Imaging Microscopy

Hyperspectral imaging (HSI) has become a leading tool in the medical field due to its capabilities for providing assessments of tissue pathology and separation of fluorescence signals. Acquisition speeds have been slow due to the need to acquire signal in many spectral bands and the light losses associated with technologies of spectral filtering. Traditional methods resulted in limited signal strength which placed limitations on time sensitive and photosensitive assays. For example, the distribution of cyclic adenosine monophosphate (cAMP) is largely undetermined because current microscope technologies lack the combination of speed, resolution, and spectral ability to accurately measure Forster resonance energy transfer (FRET). The work presented in this dissertation assesses the feasibility of integrating excitation-scanning hyperspectral imaging methods in widefield and confocal microscopy as a potential solution to improving acquisition speeds without compromising sensitivity and specificity. Our laboratory has previously proposed excitation-scanning approaches to improve signal-to-noise ratio (SNR) and showed that by using excitation-scanning, most-to-all emitted light at each excitation wavelength band can be detected which in turn, increases the SNR. This dissertation describes development and early feasibility studies for two novel prototype concepts as an alternative excitation-scanning HSI technology that may xvi increase acquisition speeds without compromising sensitivity or specificity. To achieve this, two new technologies for excitation-scanning HSI were conceptually designed: - LED-based spectral illumination for widefield microscopy - Supercontinuum-laser-based spectral illumination for spinning disk confocal microscopy. Next, design concepts were theoretically evaluated and optimized, leading to prototype testing. To evaluate the performance of each concept, prototype systems were integrated with other systems and subsystems, calibrated and feasibility assays were executed. This dissertation is divided into three main sections: 1) early development feasibility results of an excitation-scanning widefield system of systems prototype utilizing LED-based HSI, 2) Excitation-scanning HSI and image analysis methods used for endmember identification in fluorescence microscopy studies, and 3) early development feasibility of an excitation-scanning confocal SoS prototype utilizing a supercontinuum laser light source. Integration and testing results proved initial feasibility of both LED-based and broadband-based SoSs. The LED-based light source was successfully tested on a widefield microscope, while the broadband light source system was successfully tested on a confocal microscope. Feasibility for the LED-based system showed that further optical transmission optimization is needed to achieve high acquisition rates without compromising sensitivity or specificity. Early feasibility study results for the broadband-based system showed a successful proof of concept. Findings presented in this dissertation are expected to impact the fields of cellular physiology, medical sciences, and clinical diagnostics by providing the ability for high speed, high sensitivity microscopic imaging with spectroscopic discrimination

High-quality hyperspectral reconstruction using a spectral prior

We present a novel hyperspectral image reconstruction algorithm, which overcomes the long-standing tradeoff between spectral accuracy and spatial resolution in existing compressive imaging approaches. Our method consists of two steps: First, we learn nonlinear spectral representations from real-world hyperspectral datasets; for this, we build a convolutional autoencoder, which allows reconstructing its own input through its encoder and decoder networks. Second, we introduce a novel optimization method, which jointly regularizes the fidelity of the learned nonlinear spectral representations and the sparsity of gradients in the spatial domain, by means of our new fidelity prior. Our technique can be applied to any existing compressive imaging architecture, and has been thoroughly tested both in simulation, and by building a prototype hyperspectral imaging system. It outperforms the state-of-the-art methods from each architecture, both in terms of spectral accuracy and spatial resolution, while its computational complexity is reduced by two orders of magnitude with respect to sparse coding techniques. Moreover, we present two additional applications of our method: hyperspectral interpolation and demosaicing. Last, we have created a new high-resolution hyperspectral dataset containing sharper images of more spectral variety than existing ones, available through our project website