5,090 research outputs found
Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches
Imaging spectrometers measure electromagnetic energy scattered in their
instantaneous field view in hundreds or thousands of spectral channels with
higher spectral resolution than multispectral cameras. Imaging spectrometers
are therefore often referred to as hyperspectral cameras (HSCs). Higher
spectral resolution enables material identification via spectroscopic analysis,
which facilitates countless applications that require identifying materials in
scenarios unsuitable for classical spectroscopic analysis. Due to low spatial
resolution of HSCs, microscopic material mixing, and multiple scattering,
spectra measured by HSCs are mixtures of spectra of materials in a scene. Thus,
accurate estimation requires unmixing. Pixels are assumed to be mixtures of a
few materials, called endmembers. Unmixing involves estimating all or some of:
the number of endmembers, their spectral signatures, and their abundances at
each pixel. Unmixing is a challenging, ill-posed inverse problem because of
model inaccuracies, observation noise, environmental conditions, endmember
variability, and data set size. Researchers have devised and investigated many
models searching for robust, stable, tractable, and accurate unmixing
algorithms. This paper presents an overview of unmixing methods from the time
of Keshava and Mustard's unmixing tutorial [1] to the present. Mixing models
are first discussed. Signal-subspace, geometrical, statistical, sparsity-based,
and spatial-contextual unmixing algorithms are described. Mathematical problems
and potential solutions are described. Algorithm characteristics are
illustrated experimentally.Comment: This work has been accepted for publication in IEEE Journal of
Selected Topics in Applied Earth Observations and Remote Sensin
EEG in the classroom: Synchronised neural recordings during video presentation
We performed simultaneous recordings of electroencephalography (EEG) from
multiple students in a classroom, and measured the inter-subject correlation
(ISC) of activity evoked by a common video stimulus. The neural reliability, as
quantified by ISC, has been linked to engagement and attentional modulation in
earlier studies that used high-grade equipment in laboratory settings. Here we
reproduce many of the results from these studies using portable low-cost
equipment, focusing on the robustness of using ISC for subjects experiencing
naturalistic stimuli. The present data shows that stimulus-evoked neural
responses, known to be modulated by attention, can be tracked in for groups of
students with synchronized EEG acquisition. This is a step towards real-time
inference of engagement in the classroom.Comment: 14 pages, 5 figures, 3 tables. Preprint version. Revision of original
preprint. Supplementary materials added as ancillary fil
Dynamical spectral unmixing of multitemporal hyperspectral images
In this paper, we consider the problem of unmixing a time series of
hyperspectral images. We propose a dynamical model based on linear mixing
processes at each time instant. The spectral signatures and fractional
abundances of the pure materials in the scene are seen as latent variables, and
assumed to follow a general dynamical structure. Based on a simplified version
of this model, we derive an efficient spectral unmixing algorithm to estimate
the latent variables by performing alternating minimizations. The performance
of the proposed approach is demonstrated on synthetic and real multitemporal
hyperspectral images.Comment: 13 pages, 10 figure
Nonlinear unmixing of hyperspectral images: Models and algorithms
When considering the problem of unmixing hyperspectral images, most of the literature in the geoscience and image processing areas relies on the widely used linear mixing model (LMM). However, the LMM may be not valid, and other nonlinear models need to be considered, for instance, when there are multiscattering effects or intimate interactions. Consequently, over the last few years, several significant contributions have been proposed to overcome the limitations inherent in the LMM. In this article, we present an overview of recent advances in nonlinear unmixing modeling
Local Descriptor by Zernike Moments for Real-time Keypoint Matching
This paper presents a real-time keypoint matching
algorithm using a local descriptor derived by Zernike
moments. From an input image, we find a set of keypoints
by using an existing corner detection algorithm.
At each keypoint we extract a fixed size image patch
and compute a local descriptor derived by Zernike
moments. The proposed local descriptor is invariant to
rotation and illumination changes. In order to speed
up the computation of Zernike moments, we compute
the Zernike basis functions in advance and store them
in a set of lookup tables. The matching is performed
with an Approximate Nearest Neighbor (ANN) method
and refined by a RANSAC algorithm. In the
experiments we confirmed that videos of frame size
320×240 with the scale, rotation, illumination and
even 3D viewpoint changes are processed at 25~30Hz
using the proposed method. Unlike existing keypoint
matching algorithms, our approach also works in realtime
for registering a reference image
Full waveform analysis for long-range 3D imaging laser radar
The new generation of 3D imaging systems based on laser radar (ladar) offers significant advantages in defense and security applications. In particular, it is possible to retrieve 3D shape information directly from the scene and separate a target from background or foreground clutter by extracting a narrow depth range from the field of view by range gating, either in the sensor or by postprocessing. We discuss and demonstrate the applicability of full-waveform ladar to produce multilayer 3D imagery, in which each pixel produces a complex temporal response that describes the scene structure. Such complexity caused by multiple and distributed reflection arises in many relevant scenarios, for example in viewing partially occluded targets, through semitransparent materials (e.g., windows) and through distributed reflective media such as foliage. We demonstrate our methodology on 3D image data acquired by a scanning time-of-flight system, developed in our own laboratories, which uses the time-correlated single-photon counting technique
- …