One-shot ultraspectral imaging with reconfigurable metasurfaces

One-shot spectral imaging that can obtain spectral information from thousands of different points in space at one time has always been difficult to achieve. Its realization makes it possible to get spatial real-time dynamic spectral information, which is extremely important for both fundamental scientific research and various practical applications. In this study, a one-shot ultraspectral imaging device fitting thousands of micro-spectrometers (6336 pixels) on a chip no larger than 0.5 cm$^2$, is proposed and demonstrated. Exotic light modulation is achieved by using a unique reconfigurable metasurface supercell with 158400 metasurface units, which enables 6336 micro-spectrometers with dynamic image-adaptive performances to simultaneously guarantee the density of spectral pixels and the quality of spectral reconstruction. Additionally, by constructing a new algorithm based on compressive sensing, the snapshot device can reconstruct ultraspectral imaging information ($\Delta\lambda$/$\lambda$~0.001) covering a broad (300-nm-wide) visible spectrum with an ultra-high center-wavelength accuracy of 0.04-nm standard deviation and spectral resolution of 0.8 nm. This scheme of reconfigurable metasurfaces makes the device can be directly extended to almost any commercial camera with different spectral bands to seamlessly switch the information between image and spectral image, and will open up a new space for the application of spectral analysis combining with image recognition and intellisense

Advances in multispectral and hyperspectral imaging for archaeology and art conservation

Multispectral imaging has been applied to the field of art conservation and art history since the early 1990s. It is attractive as a noninvasive imaging technique because it is fast and hence capable of imaging large areas of an object giving both spatial and spectral information. This paper gives an overview of the different instrumental designs, image processing techniques and various applications of multispectral and hyperspectral imaging to art conservation, art history and archaeology. Recent advances in the development of remote and versatile multispectral and hyperspectral imaging as well as techniques in pigment identification will be presented. Future prospects including combination of spectral imaging with other noninvasive imaging and analytical techniques will be discussed

QWIPs, SLS, Landsat and the International Space Station

In 1988 DARPA provided funding to NASAs Goddard Space Flight Center to support the development of GaAs Quantum Well Infrared Photodetectors (QWIP). The goal was to make a single element photodetector that might be expandable to a two-dimensional array format. Ultimately, this led to the development of a 128 x 128 element array in collaboration with AT&T Bell Labs and Rockwell Science Center in 1990. We continued to develop numerous generations of QWIP arrays most recently resulting in the multi-QWIP focal plane for the NASA-US Geological Survey (USGS) Landsat 8 mission launched in 2013 and a similar instrument on the Landsat 9 mission to be launched in 2020. Toward the end of the Landsat 8 QWIP-based Thermal Infrared Sensor (TIRS) instrument the potential of the newly developed Strained Layer Superlattice (SLS) detector array technology became of great interest to NASA for three primary reasons: 1) higher operating temperature; 2) broad spectral response and; 3) higher sensitivity. We have collaborated extensively with QmagiQ, LLC and Northwestern University to further pursue and advance the SLS technology ever since we started back in 2012. In December of 2018 we launched the first SLS-based IR camera system to the International Space Station on board the Robotic Refueling Mission #3 (RRM3). This paper will describe the evolution of QWIP technology leading to the current development of SLS-based imaging systems at the Goddard Space Flight Center over the past 30 years

Multispectral Imaging For Face Recognition Over Varying Illumination

This dissertation addresses the advantage of using multispectral narrow-band images over conventional broad-band images for improved face recognition under varying illumination. To verify the effectiveness of multispectral images for improving face recognition performance, three sequential procedures are taken into action: multispectral face image acquisition, image fusion for multispectral and spectral band selection to remove information redundancy. Several efficient image fusion algorithms are proposed and conducted on spectral narrow-band face images in comparison to conventional images. Physics-based weighted fusion and illumination adjustment fusion make good use of spectral information in multispectral imaging process. The results demonstrate that fused narrow-band images outperform the conventional broad-band images under varying illuminations. In the case where multispectral images are acquired over severe changes in daylight, the fused images outperform conventional broad-band images by up to 78%. The success of fusing multispectral images lies in the fact that multispectral images can separate the illumination information from the reflectance of objects which is impossible for conventional broad-band images. To reduce the information redundancy among multispectral images and simplify the imaging system, distance-based band selection is proposed where a quantitative evaluation metric is defined to evaluate and differentiate the performance of multispectral narrow-band images. This method is proved to be exceptionally robust to parameter changes. Furthermore, complexity-guided distance-based band selection is proposed using model selection criterion for an automatic selection. The performance of selected bands outperforms the conventional images by up to 15%. From the significant performance improvement via distance-based band selection and complexity-guided distance-based band selection, we prove that specific facial information carried in certain narrow-band spectral images can enhance face recognition performance compared to broad-band images. In addition, both algorithms are proved to be independent to recognition engines. Significant performance improvement is achieved by proposed image fusion and band selection algorithms under varying illumination including outdoor daylight conditions. Our proposed imaging system and image processing algorithms lead to a new avenue of automatic face recognition system towards a better recognition performance than the conventional peer system over varying illuminations

Hyperspectral monitoring of green roof vegetation health state in sub-mediterranean climate: preliminary results

In urban and industrial environments, the constant increase of impermeable surfaces has produced drastic changes in the natural hydrological cycle. Decreasing green areas not only produce negative effects from a hydrological-hydraulic perspective, but also from an energy point of view, modifying the urban microclimate and generating, as shown in the literature, heat islands in our cities. In this context, green infrastructures may represent an environmental compensation action that can be used to re-equilibrate the hydrological and energy balance and reduce the impact of pollutant load on receiving water bodies. To ensure that a green infrastructure will work properly, vegetated areas have to be continuously monitored to verify their health state. This paper presents a ground spectroscopy monitoring survey of a green roof installed at the University of Calabria fulfilled via the acquisition and analysis of hyperspectral data. This study is part of a larger research project financed by European Structural funds aimed at understanding the influence of green roofs on rainwater management and energy consumption for air conditioning in the Mediterranean area. Reflectance values were acquired with a field-portable spectroradiometer that operates in the range of wavelengths 350–2500 nm. The survey was carried out during the time period November 2014–June 2015 and data were acquired weekly. Climatic, thermo-physical, hydrological and hydraulic quantities were acquired as well and related to spectral data. Broadband and narrowband spectral indices, related to chlorophyll content and to chlorophyll–carotenoid ratio, were computed. The two narrowband indices NDVI705 and SIPI turned out to be the most representative indices to detect the plant health status

Trying to break new ground in aerial archaeology

Aerial reconnaissance continues to be a vital tool for landscape-oriented archaeological research. Although a variety of remote sensing platforms operate within the earth’s atmosphere, the majority of aerial archaeological information is still derived from oblique photographs collected during observer-directed reconnaissance flights, a prospection approach which has dominated archaeological aerial survey for the past century. The resulting highly biased imagery is generally catalogued in sub-optimal (spatial) databases, if at all, after which a small selection of images is orthorectified and interpreted. For decades, this has been the standard approach. Although many innovations, including digital cameras, inertial units, photogrammetry and computer vision algorithms, geographic(al) information systems and computing power have emerged, their potential has not yet been fully exploited in order to re-invent and highly optimise this crucial branch of landscape archaeology. The authors argue that a fundamental change is needed to transform the way aerial archaeologists approach data acquisition and image processing. By addressing the very core concepts of geographically biased aerial archaeological photographs and proposing new imaging technologies, data handling methods and processing procedures, this paper gives a personal opinion on how the methodological components of aerial archaeology, and specifically aerial archaeological photography, should evolve during the next decade if developing a more reliable record of our past is to be our central aim. In this paper, a possible practical solution is illustrated by outlining a turnkey aerial prospection system for total coverage survey together with a semi-automated back-end pipeline that takes care of photograph correction and image enhancement as well as the management and interpretative mapping of the resulting data products. In this way, the proposed system addresses one of many bias issues in archaeological research: the bias we impart to the visual record as a result of selective coverage. While the total coverage approach outlined here may not altogether eliminate survey bias, it can vastly increase the amount of useful information captured during a single reconnaissance flight while mitigating the discriminating effects of observer-based, on-the-fly target selection. Furthermore, the information contained in this paper should make it clear that with current technology it is feasible to do so. This can radically alter the basis for aerial prospection and move landscape archaeology forward, beyond the inherently biased patterns that are currently created by airborne archaeological prospection

Optimized spectral filter design enables more accurate estimation of oxygen saturation in spectral imaging

Oxygen saturation (SO2) in tissue is a crucially important physiological parameter with ubiquitous clinical utility in diagnosis, treatment, and monitoring, as well as widespread use as an invaluable preclinical research tool. Multispectral imaging can be used to visualize SO2 non-invasively, non-destructively and without contact in real-time using narrow spectral filter sets, but typically, these spectral filter sets are poorly suited to a specific clinical task, application, or tissue type. In this work, we demonstrate the merit of optimizing spectral filter sets for more accurate estimation of SO2. Using tissue modelling and simulated multispectral imaging, we demonstrate filter optimization reduces the root-mean-square-error (RMSE) in estimating SO2 by up to 37% compared with evenly spaced filters. Moreover, we demonstrate up to a 79% decrease in RMSE for optimized filter sets compared with filter sets chosen to minimize mutual information. Wider adoption of this approach will result in more effective multispectral imaging systems that can address specific clinical needs and consequently, more widespread adoption of multispectral imaging technologies in disease diagnosis and treatment

Selection of the key earth observation sensors and platforms focusing on applications for Polar Regions in the scope of Copernicus system 2020-2030

An optimal payload selection conducted in the frame of the H2020 ONION project (id 687490) is presented based on the ability to cover the observation needs of the Copernicus system in the time period 2020–2030. Payload selection is constrained by the variables that can be measured, the power consumption, and weight of the instrument, and the required accuracy and spatial resolution (horizontal or vertical). It involved 20 measurements with observation gaps according to the user requirements that were detected in the top 10 use cases in the scope of Copernicus space infrastructure, 9 potential applied technologies, and 39 available commercial platforms. Additional Earth Observation (EO) infrastructures are proposed to reduce measurements gaps, based on a weighting system that assigned high relevance for measurements associated to Marine for Weather Forecast over Polar Regions. This study concludes with a rank and mapping of the potential technologies and the suitable commercial platforms to cover most of the requirements of the top ten use cases, analyzing the Marine for Weather Forecast, Sea Ice Monitoring, Fishing Pressure, and Agriculture and Forestry: Hydric stress as the priority use cases.Peer ReviewedPostprint (published version