A multi-sensor approach for volcanic ash cloud retrieval and eruption characterization: the 23 November 2013 Etna lava fountain

Volcanic activity is observed worldwide with a variety of ground and space-based remote sensing instruments, each with advantages and drawbacks. No single system can give a comprehensive description of eruptive activity, and so, a multi-sensor approach is required. This work integrates infrared and microwave volcanic ash retrievals obtained from the geostationary Meteosat Second Generation (MSG)-Spinning Enhanced Visible and Infrared Imager (SEVIRI), the polar-orbiting Aqua-MODIS and ground-based weather radar. The expected outcomes are improvements in satellite volcanic ash cloud retrieval (altitude, mass, aerosol optical depth and effective radius), the generation of new satellite products (ash concentration and particle number density in the thermal infrared) and better characterization of volcanic eruptions (plume altitude, total ash mass erupted and particle number density from thermal infrared to microwave). This approach is the core of the multi-platform volcanic ash cloud estimation procedure being developed within the European FP7-APhoRISM project. The Mt. Etna (Sicily, Italy) volcano lava fountaining event of 23 November 2013 was considered as a test case. The results of the integration show the presence of two volcanic cloud layers at different altitudes. The improvement of the volcanic ash cloud altitude leads to a mean difference between the SEVIRI ash mass estimations, before and after the integration, of about the 30%. Moreover, the percentage of the airborne “fine” ash retrieved from the satellite is estimated to be about 1%–2% of the total ash emitted during the eruption. Finally, all of the estimated parameters (volcanic ash cloud altitude, thickness and total mass) were also validated with ground-based visible camera measurements, HYSPLIT forward trajectories, Infrared Atmospheric Sounding Interferometer (IASI) satellite data and tephra deposits

Stairs detection with odometry-aided traversal from a wearable RGB-D camera

Stairs are one of the most common structures present in human-made scenarios, but also one of the most dangerous for those with vision problems. In this work we propose a complete method to detect, locate and parametrise stairs with a wearable RGB-D camera. Our algorithm uses the depth data to determine if the horizontal planes in the scene are valid steps of a staircase judging their dimensions and relative positions. As a result we obtain a scaled model of the staircase with the spatial location and orientation with respect to the subject. The visual odometry is also estimated to continuously recover the current position and orientation of the user while moving. This enhances the system giving the ability to come back to previously detected features and providing location awareness of the user during the climb. Simultaneously, the detection of the staircase during the traversal is used to correct the drift of the visual odometry. A comparison of results of the stair detection with other state-of-the-art algorithms was performed using public dataset. Additional experiments have also been carried out, recording our own natural scenes with a chest-mounted RGB-D camera in indoor scenarios. The algorithm is robust enough to work in real-time and even under partial occlusions of the stair

On Martian Surface Exploration: Development of Automated 3D Reconstruction and Super-Resolution Restoration Techniques for Mars Orbital Images

Very high spatial resolution imaging and topographic (3D) data play an important role in modern Mars science research and engineering applications. This work describes a set of image processing and machine learning methods to produce the “best possible” high-resolution and high-quality 3D and imaging products from existing Mars orbital imaging datasets. The research work is described in nine chapters of which seven are based on separate published journal papers. These include a) a hybrid photogrammetric processing chain that combines the advantages of different stereo matching algorithms to compute stereo disparity with optimal completeness, fine-scale details, and minimised matching artefacts; b) image and 3D co-registration methods that correct a target image and/or 3D data to a reference image and/or 3D data to achieve robust cross-instrument multi-resolution 3D and image co-alignment; c) a deep learning network and processing chain to estimate pixel-scale surface topography from single-view imagery that outperforms traditional photogrammetric methods in terms of product quality and processing speed; d) a deep learning-based single-image super-resolution restoration (SRR) method to enhance the quality and effective resolution of Mars orbital imagery; e) a subpixel-scale 3D processing system using a combination of photogrammetric 3D reconstruction, SRR, and photoclinometric 3D refinement; and f) an optimised subpixel-scale 3D processing system using coupled deep learning based single-view SRR and deep learning based 3D estimation to derive the best possible (in terms of visual quality, effective resolution, and accuracy) 3D products out of present epoch Mars orbital images. The resultant 3D imaging products from the above listed new developments are qualitatively and quantitatively evaluated either in comparison with products from the official NASA planetary data system (PDS) and/or ESA planetary science archive (PSA) releases, and/or in comparison with products generated with different open-source systems. Examples of the scientific application of these novel 3D imaging products are discussed

A variational technique for three-dimensional reconstruction of local structure

Thesis (S.M.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, February 1999.Includes bibliographical references (leaves 66-70).by Eric Raphaël Amram.S.M

Accurate Eye Tracking from Dense 3D Surface Reconstructions using Single-Shot Deflectometry

Eye-tracking plays a crucial role in the development of virtual reality devices, neuroscience research, and psychology. Despite its significance in numerous applications, achieving an accurate, robust, and fast eye-tracking solution remains a considerable challenge for current state-of-the-art methods. While existing reflection-based techniques (e.g., "glint tracking") are considered the most accurate, their performance is limited by their reliance on sparse 3D surface data acquired solely from the cornea surface. In this paper, we rethink the way how specular reflections can be used for eye tracking: We propose a novel method for accurate and fast evaluation of the gaze direction that exploits teachings from single-shot phase-measuring-deflectometry (PMD). In contrast to state-of-the-art reflection-based methods, our method acquires dense 3D surface information of both cornea and sclera within only one single camera frame (single-shot). Improvements in acquired reflection surface points("glints") of factors $>3300 \times$ are easily achievable. We show the feasibility of our approach with experimentally evaluated gaze errors of only $\leq 0.25^\circ$ demonstrating a significant improvement over the current state-of-the-art