2,270 research outputs found
From 3D Point Clouds to Pose-Normalised Depth Maps
We consider the problem of generating either pairwise-aligned or pose-normalised depth maps from noisy 3D point clouds in a relatively unrestricted poses. Our system is deployed in a 3D face alignment application and consists of the following four stages: (i) data filtering, (ii) nose tip identification and sub-vertex localisation, (iii) computation of the (relative) face orientation, (iv) generation of either a pose aligned or a pose normalised depth map. We generate an implicit radial basis function (RBF) model of the facial surface and this is employed within all four stages of the process. For example, in stage (ii), construction of novel invariant features is based on sampling this RBF over a set of concentric spheres to give a spherically-sampled RBF (SSR) shape histogram. In stage (iii), a second novel descriptor, called an isoradius contour curvature signal, is defined, which allows rotational alignment to be determined using a simple process of 1D correlation. We test our system on both the University of York (UoY) 3D face dataset and the Face Recognition Grand Challenge (FRGC) 3D data. For the more challenging UoY data, our SSR descriptors significantly outperform three variants of spin images, successfully identifying nose vertices at a rate of 99.6%. Nose localisation performance on the higher quality FRGC data, which has only small pose variations, is 99.9%. Our best system successfully normalises the pose of 3D faces at rates of 99.1% (UoY data) and 99.6% (FRGC data)
Phase Retrieval with Application to Optical Imaging
This review article provides a contemporary overview of phase retrieval in
optical imaging, linking the relevant optical physics to the information
processing methods and algorithms. Its purpose is to describe the current state
of the art in this area, identify challenges, and suggest vision and areas
where signal processing methods can have a large impact on optical imaging and
on the world of imaging at large, with applications in a variety of fields
ranging from biology and chemistry to physics and engineering
Toward single particle reconstruction without particle picking: Breaking the detection limit
Single-particle cryo-electron microscopy (cryo-EM) has recently joined X-ray
crystallography and NMR spectroscopy as a high-resolution structural method for
biological macromolecules. In a cryo-EM experiment, the microscope produces
images called micrographs. Projections of the molecule of interest are embedded
in the micrographs at unknown locations, and under unknown viewing directions.
Standard imaging techniques first locate these projections (detection) and then
reconstruct the 3-D structure from them. Unfortunately, high noise levels
hinder detection. When reliable detection is rendered impossible, the standard
techniques fail. This is a problem especially for small molecules, which can be
particularly hard to detect. In this paper, we propose a radically different
approach: we contend that the structure could, in principle, be reconstructed
directly from the micrographs, without intermediate detection. As a result,
even small molecules should be within reach for cryo-EM. To support this claim,
we setup a simplified mathematical model and demonstrate how our
autocorrelation analysis technique allows to go directly from the micrographs
to the sought signals. This involves only one pass over the micrographs, which
is desirable for large experiments. We show numerical results and discuss
challenges that lay ahead to turn this proof-of-concept into a competitive
alternative to state-of-the-art algorithms
Sparse and structured decomposition of audio signals on hybrid dictionaries using musical priors
International audienceThis paper investigates the use of musical priors for sparse expansion of audio signals of music, on an overcomplete dual-resolution dictionary taken from the union of two orthonormal bases that can describe both transient and tonal components of a music audio signal. More specifically, chord and metrical structure information are used to build a structured model that takes into account dependencies between coefficients of the decomposition, both for the tonal and for the transient layer. The denoising task application is used to provide a proof of concept of the proposed musical priors. Several configurations of the model are analyzed. Evaluation on monophonic and complex polyphonic excerpts of real music signals shows that the proposed approach provides results whose quality measured by the signal-to-noise ratio is competitive with state-of-the-art approaches, and more coherent with the semantic content of the signal. A detailed analysis of the model in terms of sparsity and in terms of interpretability of the representation is also provided, and shows that the model is capable of giving a relevant and legible representation of Western tonal music audio signals
A machine learning route between band mapping and band structure
The electronic band structure (BS) of solid state materials imprints the
multidimensional and multi-valued functional relations between energy and
momenta of periodically confined electrons. Photoemission spectroscopy is a
powerful tool for its comprehensive characterization. A common task in
photoemission band mapping is to recover the underlying quasiparticle
dispersion, which we call band structure reconstruction. Traditional methods
often focus on specific regions of interests yet require extensive human
oversight. To cope with the growing size and scale of photoemission data, we
develop a generic machine-learning approach leveraging the information within
electronic structure calculations for this task. We demonstrate its capability
by reconstructing all fourteen valence bands of tungsten diselenide and
validate the accuracy on various synthetic data. The reconstruction uncovers
previously inaccessible momentum-space structural information on both global
and local scales in conjunction with theory, while realizing a path towards
integrating band mapping data into materials science databases
Global Climate and Atmospheric Composition of the Ultra-Hot Jupiter WASP-103b from HST and Spitzer Phase Curve Observations
We present thermal phase curve measurements for the hot Jupiter WASP-103b
observed with Hubble/WFC3 and Spitzer/IRAC. The phase curves have large
amplitudes and negligible hotspot offsets, indicative of poor heat
redistribution to the nightside. We fit the phase variation with a range of
climate maps and find that a spherical harmonics model generally provides the
best fit. The phase-resolved spectra are consistent with blackbodies in the
WFC3 bandpass, with brightness temperatures ranging from K on the
nightside to K on the dayside. The dayside spectrum has a
significantly higher brightness temperature in the Spitzer bands, likely due to
CO emission and a thermal inversion. The inversion is not present on the
nightside. We retrieved the atmospheric composition and found the composition
is moderately metal-enriched ( solar)
and the carbon-to-oxygen ratio is below 0.9 at confidence. In
contrast to cooler hot Jupiters, we do not detect spectral features from water,
which we attribute to partial HO dissociation. We compare the phase curves
to 3D general circulation models and find magnetic drag effects are needed to
match the data. We also compare the WASP-103b spectra to brown dwarfs and young
directly imaged companions and find these objects have significantly larger
water features, indicating that surface gravity and irradiation environment
play an important role in shaping the spectra of hot Jupiters. These results
highlight the 3D structure of exoplanet atmospheres and illustrate the
importance of phase curve observations for understanding their complex
chemistry and physics.Comment: 25 pages, 17 figures, 7 tables; accepted to A
- …