One-shot ultraspectral imaging with reconfigurable metasurfaces

One-shot spectral imaging that can obtain spectral information from thousands of different points in space at one time has always been difficult to achieve. Its realization makes it possible to get spatial real-time dynamic spectral information, which is extremely important for both fundamental scientific research and various practical applications. In this study, a one-shot ultraspectral imaging device fitting thousands of micro-spectrometers (6336 pixels) on a chip no larger than 0.5 cm$^2$, is proposed and demonstrated. Exotic light modulation is achieved by using a unique reconfigurable metasurface supercell with 158400 metasurface units, which enables 6336 micro-spectrometers with dynamic image-adaptive performances to simultaneously guarantee the density of spectral pixels and the quality of spectral reconstruction. Additionally, by constructing a new algorithm based on compressive sensing, the snapshot device can reconstruct ultraspectral imaging information ($\Delta\lambda$/$\lambda$~0.001) covering a broad (300-nm-wide) visible spectrum with an ultra-high center-wavelength accuracy of 0.04-nm standard deviation and spectral resolution of 0.8 nm. This scheme of reconfigurable metasurfaces makes the device can be directly extended to almost any commercial camera with different spectral bands to seamlessly switch the information between image and spectral image, and will open up a new space for the application of spectral analysis combining with image recognition and intellisense

Light field super resolution through controlled micro-shifts of light field sensor

Light field cameras enable new capabilities, such as post-capture refocusing and aperture control, through capturing directional and spatial distribution of light rays in space. Micro-lens array based light field camera design is often preferred due to its light transmission efficiency, cost-effectiveness and compactness. One drawback of the micro-lens array based light field cameras is low spatial resolution due to the fact that a single sensor is shared to capture both spatial and angular information. To address the low spatial resolution issue, we present a light field imaging approach, where multiple light fields are captured and fused to improve the spatial resolution. For each capture, the light field sensor is shifted by a pre-determined fraction of a micro-lens size using an XY translation stage for optimal performance

On evolution of CMOS image sensors

CMOS Image Sensors have become the principal technology in majority of digital cameras. They started replacing the film and Charge Coupled Devices in the last decade with the promise of lower cost, lower power requirement, higher integration and the potential of focal plane processing. However, the principal factor behind their success has been the ability to utilise the shrinkage in CMOS technology to make smaller pixels, and thereby have more resolution without increasing the cost. With the market of image sensors exploding courtesy their inte- gration with communication and computation devices, technology developers improved the CMOS processes to have better optical performance. Nevertheless, the promises of focal plane processing as well as on-chip integration have not been fulfilled. The market is still being pushed by the desire of having higher number of pixels and better image quality, however, differentiation is being difficult for any image sensor manufacturer. In the paper, we will explore potential disruptive growth directions for CMOS Image sensors and ways to achieve the same

Measurements of wall-shear stress fields on the piston crown in an IC engine flow using fluorescent labelled micro-pillar imaging

The measurement of wall shear-stress along the crown of a moving piston is accomplished with an array of hair-like, flexible micro-pillar sensors (MPS) in an internal combustion (IC) engine during intake flow conditions. The MPS are wall-clamped flexible micro-cylinders of 20micron diameter made of polydimethylsiloxane (PDMS) positioned on the surface of a transparent planar piston crown and protruding into the boundary layer flow above the piston at a height of 390micron. Their tips are labelled with fluorophores and are illuminated with a scanning laser-sheet system that follows the piston motion in synchronous manner. The flow-induced deflection is recorded through the transparent piston crown from below with a compact shaft-mounted high-speed camera recording the fluorescent re-emitted light from the pillar tips and using the fact of optical wave-guide features of the transparent micro-pillars. The experiments were performed in a transparent 4-valve engine setup (1.6 liter Prince 2, N13B16) during the intake phase. In order to improve the temporal resolution, the running speed of the engine was scaled down using water as working liquid. A static and dynamic sensor-calibration enabled the precise measurements of the wall-shear stress distribution with the sensor array. Due to spatial resolution limits of current available compact high-speed camera the recorded region along the piston was limited to 4x2 mm2 with 8x4 pillars in full view. The recordings at 300fps show the WSS fluctuations induced by the valve-jet / piston-wall interaction in the beginning of the intake with strong wall-normal motion forming critical points in the WSS field such as saddles, nodes and foci. Over the intake cycle > CA 80° these fluctuations die out and flow is transformed into wall-parallel coherent motion prescribed by the formation of the tumble

Micro Fourier Transform Profilometry (μ\muFTP): 3D shape measurement at 10,000 frames per second

Recent advances in imaging sensors and digital light projection technology have facilitated a rapid progress in 3D optical sensing, enabling 3D surfaces of complex-shaped objects to be captured with improved resolution and accuracy. However, due to the large number of projection patterns required for phase recovery and disambiguation, the maximum fame rates of current 3D shape measurement techniques are still limited to the range of hundreds of frames per second (fps). Here, we demonstrate a new 3D dynamic imaging technique, Micro Fourier Transform Profilometry ($\mu$FTP), which can capture 3D surfaces of transient events at up to 10,000 fps based on our newly developed high-speed fringe projection system. Compared with existing techniques, $\mu$FTP has the prominent advantage of recovering an accurate, unambiguous, and dense 3D point cloud with only two projected patterns. Furthermore, the phase information is encoded within a single high-frequency fringe image, thereby allowing motion-artifact-free reconstruction of transient events with temporal resolution of 50 microseconds. To show $\mu$FTP's broad utility, we use it to reconstruct 3D videos of 4 transient scenes: vibrating cantilevers, rotating fan blades, bullet fired from a toy gun, and balloon's explosion triggered by a flying dart, which were previously difficult or even unable to be captured with conventional approaches.Comment: This manuscript was originally submitted on 30th January 1

Advances on CMOS image sensors

This paper offers an introduction to the technological advances of image sensors designed using complementary metal–oxide–semiconductor (CMOS) processes along the last decades. We review some of those technological advances and examine potential disruptive growth directions for CMOS image sensors and proposed ways to achieve them. Those advances include breakthroughs on image quality such as resolution, capture speed, light sensitivity and color detection and advances on the computational imaging. The current trend is to push the innovation efforts even further as the market requires higher resolution, higher speed, lower power consumption and, mainly, lower cost sensors. Although CMOS image sensors are currently used in several different applications from consumer to defense to medical diagnosis, product differentiation is becoming both a requirement and a difficult goal for any image sensor manufacturer. The unique properties of CMOS process allows the integration of several signal processing techniques and are driving the impressive advancement of the computational imaging. With this paper, we offer a very comprehensive review of methods, techniques, designs and fabrication of CMOS image sensors that have impacted or might will impact the images sensor applications and markets

The ASTRO-H X-ray Observatory

The joint JAXA/NASA ASTRO-H mission is the sixth in a series of highly successful X-ray missions initiated by the Institute of Space and Astronautical Science (ISAS). ASTRO-H will investigate the physics of the high-energy universe via a suite of four instruments, covering a very wide energy range, from 0.3 keV to 600 keV. These instruments include a high-resolution, high-throughput spectrometer sensitive over 0.3-2 keV with high spectral resolution of Delta E < 7 eV, enabled by a micro-calorimeter array located in the focal plane of thin-foil X-ray optics; hard X-ray imaging spectrometers covering 5-80 keV, located in the focal plane of multilayer-coated, focusing hard X-ray mirrors; a wide-field imaging spectrometer sensitive over 0.4-12 keV, with an X-ray CCD camera in the focal plane of a soft X-ray telescope; and a non-focusing Compton-camera type soft gamma-ray detector, sensitive in the 40-600 keV band. The simultaneous broad bandpass, coupled with high spectral resolution, will enable the pursuit of a wide variety of important science themes.Comment: 22 pages, 17 figures, Proceedings of the SPIE Astronomical Instrumentation "Space Telescopes and Instrumentation 2012: Ultraviolet to Gamma Ray

ORIGAMIX, a CdTe-based spectro-imager development for nuclear applications

The Astrophysics Division of CEA Saclay has a long history in the development of CdTe based pixelated detection planes for X and gamma-ray astronomy, with time-resolved imaging and spectrometric capabilities. The last generation, named Caliste HD, is an all-in-one modular instrument that fulfills requirements for space applications. Its full-custom front-end electronics is designed to work over a large energy range from 2 keV to 1 MeV with excellent spectroscopic performances, in particular between 10 and 100 keV (0.56 keV FWHM and 0.67 keV FWHM at 13.9 and 59.5 keV). In the frame of the ORIGAMIX project, a consortium based on research laboratories and industrials has been settled in order to develop a new generation of gamma camera. The aim is to develop a system based on the Caliste architecture for post-accidental interventions or homeland security, but integrating new properties (advanced spectrometry, hybrid working mode) and suitable for industry. A first prototype was designed and tested to acquire feedback for further developments. In this study, we particularly focused on spectrometric performances with high energies and high fluxes. Therefore, our device was exposed to energies up to 700 keV (133Ba, 137Cs) and we measured the evolution of energy resolution (0.96 keV at 80 keV, 2.18 keV at 356 keV, 3.33 keV at 662 keV). Detection efficiency decreases after 150 keV, as Compton effect becomes dominant. However, CALISTE is also designed to handle multiple events, enabling Compton scattering reconstruction, which can drastically improve detection efficiencies and dynamic range for higher energies up to 1408 keV (22Na, 60Co, 152Eu) within a 1-mm thick detector. In particular, such spectrometric performances obtained with 152Eu and 60Co were never measured before with this kind of detector.Comment: Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment. Available online 9 January 2015, ISSN 0168-9002 (http://www.sciencedirect.com/science/article/pii/S0168900215000133). Keywords: CdTe; X-ray; Gamma-ray; Spectrometry; Charge-sharing; Astrophysics Instrumentation; Nuclear Instrumentation; Gamma-ray camera