44,993 research outputs found
A Russian Dolls ordering of the Hadamard basis for compressive single-pixel imaging
Single-pixel imaging is an alternate imaging technique particularly well-suited to imaging modalities such as hyper-spectral imaging, depth mapping, 3D profiling. However, the single-pixel technique requires sequential measurements resulting in a trade-off between spatial resolution and acquisition time, limiting real-time video applications to relatively low resolutions. Compressed sensing techniques can be used to improve this trade-off. However, in this low resolution regime, conventional compressed sensing techniques have limited impact due to lack of sparsity in the datasets. Here we present an alternative compressed sensing method in which we optimize the measurement order of the Hadamard basis, such that at discretized increments we obtain complete sampling for different spatial resolutions. In addition, this method uses deterministic acquisition, rather than the randomized sampling used in conventional compressed sensing. This so-called ‘Russian Dolls’ ordering also benefits from minimal computational overhead for image reconstruction. We find that this compressive approach performs as well as other compressive sensing techniques with greatly simplified post processing, resulting in significantly faster image reconstruction. Therefore, the proposed method may be useful for single-pixel imaging in the low resolution, high-frame rate regime, or video-rate acquisition
Programmable Spectrometry -- Per-pixel Classification of Materials using Learned Spectral Filters
Many materials have distinct spectral profiles. This facilitates estimation
of the material composition of a scene at each pixel by first acquiring its
hyperspectral image, and subsequently filtering it using a bank of spectral
profiles. This process is inherently wasteful since only a set of linear
projections of the acquired measurements contribute to the classification task.
We propose a novel programmable camera that is capable of producing images of a
scene with an arbitrary spectral filter. We use this camera to optically
implement the spectral filtering of the scene's hyperspectral image with the
bank of spectral profiles needed to perform per-pixel material classification.
This provides gains both in terms of acquisition speed --- since only the
relevant measurements are acquired --- and in signal-to-noise ratio --- since
we invariably avoid narrowband filters that are light inefficient. Given
training data, we use a range of classical and modern techniques including SVMs
and neural networks to identify the bank of spectral profiles that facilitate
material classification. We verify the method in simulations on standard
datasets as well as real data using a lab prototype of the camera
Coherent Raman spectro-imaging with laser frequency combs
Optical spectroscopy and imaging of microscopic samples have opened up a wide
range of applications throughout the physical, chemical, and biological
sciences. High chemical specificity may be achieved by directly interrogating
the fundamental or low-lying vibrational energy levels of the compound
molecules. Amongst the available prevailing label-free techniques, coherent
Raman scattering has the distinguishing features of high spatial resolution
down to 200 nm and three-dimensional sectioning. However, combining fast
imaging speed and identification of multiple - and possibly unexpected-
compounds remains challenging: existing high spectral resolution schemes
require long measurement times to achieve broad spectral spans. Here we
overcome this difficulty and introduce a novel concept of coherent anti-Stokes
Raman scattering (CARS) spectro-imaging with two laser frequency combs. We
illustrate the power of our technique with high resolution (4 cm-1) Raman
spectra spanning more than 1200 cm-1 recorded within less than 15 microseconds.
Furthermore, hyperspectral images combining high spectral (10 cm-1) and spatial
(2 micrometers) resolutions are acquired at a rate of 50 pixels per second.
Real-time multiplex accessing of hyperspectral images may dramatically expand
the range of applications of nonlinear microscopy.Comment: 8 pages, 3 figure
Quality criteria benchmark for hyperspectral imagery
Hyperspectral data appear to be of a growing interest
over the past few years. However, applications for hyperspectral
data are still in their infancy as handling the significant size of
the data presents a challenge for the user community. Efficient
compression techniques are required, and lossy compression,
specifically, will have a role to play, provided its impact on remote
sensing applications remains insignificant. To assess the data
quality, suitable distortion measures relevant to end-user applications
are required. Quality criteria are also of a major interest
for the conception and development of new sensors to define their
requirements and specifications. This paper proposes a method to
evaluate quality criteria in the context of hyperspectral images.
The purpose is to provide quality criteria relevant to the impact
of degradations on several classification applications. Different
quality criteria are considered. Some are traditionnally used in
image and video coding and are adapted here to hyperspectral
images. Others are specific to hyperspectral data.We also propose
the adaptation of two advanced criteria in the presence of different
simulated degradations on AVIRIS hyperspectral images. Finally,
five criteria are selected to give an accurate representation of the
nature and the level of the degradation affecting hyperspectral
data
In vivo volumetric imaging of human retinal circulation with phase-variance optical coherence tomography
We present in vivo volumetric images of human retinal micro-circulation using Fourier-domain optical coherence tomography (Fd-OCT) with the phase-variance based motion contrast method. Currently fundus fluorescein angiography (FA) is the standard technique in clinical settings for visualizing blood circulation of the retina. High contrast imaging of retinal vasculature is achieved by injection of a fluorescein dye into the systemic circulation. We previously reported phase-variance optical coherence tomography (pvOCT) as an alternative and non-invasive technique to image human retinal capillaries. In contrast to FA, pvOCT allows not only noninvasive visualization of a two-dimensional retinal perfusion map but also volumetric morphology of retinal microvasculature with high sensitivity. In this paper we report high-speed acquisition at 125 kHz A-scans with pvOCT to reduce motion artifacts and increase the scanning area when compared with previous reports. Two scanning schemes with different sampling densities and scanning areas are evaluated to find optimal parameters for high acquisition speed in vivo imaging. In order to evaluate this technique, we compare pvOCT capillary imaging at 3x3 mm^2 and 1.5x1.5 mm^2 with fundus FA for a normal human subject. Additionally, a volumetric view of retinal capillaries and a stitched image acquired with ten 3x3 mm^2 pvOCT sub-volumes are presented. Visualization of retinal vasculature with pvOCT has potential for diagnosis of retinal vascular diseases
GPU accelerated real-time multi-functional spectral-domain optical coherence tomography system at 1300 nm.
We present a GPU accelerated multi-functional spectral domain optical coherence tomography system at 1300 nm. The system is capable of real-time processing and display of every intensity image, comprised of 512 pixels by 2048 A-lines acquired at 20 frames per second. The update rate for all four images with size of 512 pixels by 2048 A-lines simultaneously (intensity, phase retardation, flow and en face view) is approximately 10 frames per second. Additionally, we report for the first time the characterization of phase retardation and diattenuation by a sample comprised of a stacked set of polarizing film and wave plate. The calculated optic axis orientation, phase retardation and diattenuation match well with expected values. The speed of each facet of the multi-functional OCT CPU-GPU hybrid acquisition system, intensity, phase retardation, and flow, were separately demonstrated by imaging a horseshoe crab lateral compound eye, a non-uniformly heated chicken muscle, and a microfluidic device. A mouse brain with thin skull preparation was imaged in vivo and demonstrated the capability of the system for live multi-functional OCT visualization
Increased mesiotemporal delta activity characterizes virtual navigation in humans
Hippocampal theta or rhythmic slow activity (RSA) occurring during exploratory behaviors
and rapid-eye-movement (REM) sleep is a characteristic and well-identifiable oscillatory rhythm in
animals. In contrast, controversy surrounds the existence and electrophysiological correlates of this
activity in humans. Some argue that the human hippocampal theta occurs in short and phasic bursts.
On the contrary, our earlier studies provide evidence that REM-dependent mesiotemporal RSA is
continuous like in animals but instead of the theta it falls in the delta frequency range. Here we used a
virtual navigation task in 24 epilepsy patients implanted with foramen ovale electrodes. EEG was
analyzed for 1-Hz wide frequency bins up to 10 Hz according to four conditions: resting, non-learning
route-following, acquisition and recall. We found progressively increasing spectral power in frequency
bins up the 4 Hz across these conditions. No spectral power increase relative to resting was revealed
within the traditional theta band and above in any of the navigation conditions. Thus the affected
frequency bins were below the theta band and were similar to those characterizing REM sleep in our
previous studies providing further indication that it is delta rather than theta that should be regarded
as a human analogue of the animal RSA
Trying to break new ground in aerial archaeology
Aerial reconnaissance continues to be a vital tool for landscape-oriented archaeological research. Although a variety of remote sensing platforms operate within the earth’s atmosphere, the majority of aerial archaeological information is still derived from oblique photographs collected during observer-directed reconnaissance flights, a prospection approach which has dominated archaeological aerial survey for the past century. The resulting highly biased imagery is generally catalogued in sub-optimal (spatial) databases, if at all, after which a small selection of images is orthorectified and interpreted. For decades, this has been the standard approach. Although many innovations, including digital cameras, inertial units, photogrammetry and computer vision algorithms, geographic(al) information systems and computing power have emerged, their potential has not yet been fully exploited in order to re-invent and highly optimise this crucial branch of landscape archaeology. The authors argue that a fundamental change is needed to transform the way aerial archaeologists approach data acquisition and image processing. By addressing the very core concepts of geographically biased aerial archaeological photographs and proposing new imaging technologies, data handling methods and processing procedures, this paper gives a personal opinion on how the methodological components of aerial archaeology, and specifically aerial archaeological photography, should evolve during the next decade if developing a more reliable record of our past is to be our central aim. In this paper, a possible practical solution is illustrated by outlining a turnkey aerial prospection system for total coverage survey together with a semi-automated back-end pipeline that takes care of photograph correction and image enhancement as well as the management and interpretative mapping of the resulting data products. In this way, the proposed system addresses one of many bias issues in archaeological research: the bias we impart to the visual record as a result of selective coverage. While the total coverage approach outlined here may not altogether eliminate survey bias, it can vastly increase the amount of useful information captured during a single reconnaissance flight while mitigating the discriminating effects of observer-based, on-the-fly target selection. Furthermore, the information contained in this paper should make it clear that with current technology it is feasible to do so. This can radically alter the basis for aerial prospection and move landscape archaeology forward, beyond the inherently biased patterns that are currently created by airborne archaeological prospection
mHealth hyperspectral learning for instantaneous spatiospectral imaging of hemodynamics
Hyperspectral imaging acquires data in both the spatial and frequency domains
to offer abundant physical or biological information. However, conventional
hyperspectral imaging has intrinsic limitations of bulky instruments, slow data
acquisition rate, and spatiospectral tradeoff. Here we introduce hyperspectral
learning for snapshot hyperspectral imaging in which sampled hyperspectral data
in a small subarea are incorporated into a learning algorithm to recover the
hypercube. Hyperspectral learning exploits the idea that a photograph is more
than merely a picture and contains detailed spectral information. A small
sampling of hyperspectral data enables spectrally informed learning to recover
a hypercube from an RGB image. Hyperspectral learning is capable of recovering
full spectroscopic resolution in the hypercube, comparable to high spectral
resolutions of scientific spectrometers. Hyperspectral learning also enables
ultrafast dynamic imaging, leveraging ultraslow video recording in an
off-the-shelf smartphone, given that a video comprises a time series of
multiple RGB images. To demonstrate its versatility, an experimental model of
vascular development is used to extract hemodynamic parameters via statistical
and deep-learning approaches. Subsequently, the hemodynamics of peripheral
microcirculation is assessed at an ultrafast temporal resolution up to a
millisecond, using a conventional smartphone camera. This spectrally informed
learning method is analogous to compressed sensing; however, it further allows
for reliable hypercube recovery and key feature extractions with a transparent
learning algorithm. This learning-powered snapshot hyperspectral imaging method
yields high spectral and temporal resolutions and eliminates the spatiospectral
tradeoff, offering simple hardware requirements and potential applications of
various machine-learning techniques.Comment: This paper will appear in PNAS Nexu
- …