Geometrical Calibration for the Panrover: a Stereo Omnidirectional System for Planetary Rover

Abstract. A novel panoramic stereo imaging system is proposed in this paper. The system is able to carry out a 360° stereoscopic vision, useful for rover autonomous-driving, and capture simultaneously a high-resolution stereo scene. The core of the concept is a novel "bifocal panoramic lens" (BPL) based on hyper hemispheric model (Pernechele et al. 2016). This BPL is able to record a panoramic field of view (FoV) and, simultaneously, an area (belonging to the panoramic FoV) with a given degree of magnification by using a unique image sensor. This strategy makes possible to avoid rotational mechanisms. Using two BPLs settled in a vertical baseline (system called PANROVER) allows the monitoring of the surrounding environment in stereoscopic (3D) mode and, simultaneously, capturing an high-resolution stereoscopic images to analyse scientific cases, making it a new paradigm in the planetary rovers framework.Differently from the majority of the Mars systems which are based on rotational mechanisms for the acquisition of the panoramic images (mosaicked on ground), the PANROVER does not contain any moving components and can rescue a hi-rate stereo images of the context panorama.Scope of this work is the geometric calibration of the panoramic acquisition system by the omnidirectional calibration methods (Scaramuzza et al. 2006) based on Zhang calibration grid. The procedures are applied in order to obtain well rectified synchronized stereo images to be available for 3D reconstruction. We applied a Zhang chess boards based approach even during STC/SIMBIO-SYS stereo camera calibration (Simioni et al. 2014, 2017). In this case the target of the calibration will be the stereo heads (the BPLs) of the PANROVER with the scope of extracting the intrinsic parameters of the optical systems. Differently by previous pipelines, using the same data bench the estimate of the extrinsic parameters is performed

A Testbed for Design and Performance Evaluation of Visual Localization Technique inside the Small Intestine

Wireless video capsule endoscopy (VCE) plays an increasingly important role in assisting clinical diagnoses of gastrointestinal (GI) diseases. It provides a non-invasive way to examine the entire small intestine, where other conventional endoscopic instruments can barely reach. Existing examination systems for the VCE cannot track the location of a endoscopic capsule, which prevents the physician from identifying the exact location of the diseases. During the eight hour examination time, the video capsule continuously keeps taking images at a frame rate up to six frame per sec, so it is possible to extract the motion information from the content of the image sequence. Many attempts have been made to develop computer vision algorithms to detect the motion of the capsule based on the small changes in the consecutive video frames and then trace the location of the capsule. However, validation of those algorithms has become a challenging topic because conducting experiments on the human body is extremely difficult due to individual differences and legal issues. In this thesis, two validation approaches for motion tracking of the VCE are presented in detail respectively. One approach is to build a physical testbed with a plastic pipe and an endoscopy camera; the other is to build a virtual testbed by creating a three-dimensional virtual small intestine model and simulating the motion of the capsule. Based on the virtual testbed, a physiological factor, intestinal contraction, has been studied in terms of its influence on visual based localization algorithm and a geometric model for measuring the amount of contraction is proposed and validated via the virtual testbed. Empirical results have made contributions in support of the performance evaluation of other research on the visual based localization algorithm of VCE

Real-time tissue viability assessment using near-infrared light

Despite significant advances in medical imaging technologies, there currently exist no tools to effectively assist healthcare professionals during surgical procedures. In turn, procedures remain subjective and dependent on experience, resulting in avoidable failure and significant quality of care disparities across hospitals. Optical techniques are gaining popularity in clinical research because they are low cost, non-invasive, portable, and can retrieve both fluorescence and endogenous contrast information, providing physiological information relative to perfusion, oxygenation, metabolism, hydration, and sub-cellular content. Near-infrared (NIR) light is especially well suited for biological tissue and does not cause tissue damage from ionizing radiation or heat. My dissertation has been focused on developing rapid imaging techniques for mapping endogenous tissue constituents to aid surgical guidance. These techniques allow, for the first time, video-rate quantitative acquisition over a large field of view (> 100 cm2) in widefield and endoscopic implementations. The optical system analysis has been focused on the spatial-frequency domain for its ease of quantitative measurements over large fields of view and for its recent development in real-time acquisition, single snapshot of optical properties (SSOP) imaging. Using these methods, this dissertation provides novel improvements and implementations to SSOP, including both widefield and endoscopic instrumentations capable of video-rate acquisition of optical properties and sample surface profile maps. In turn, these measures generate profile-corrected maps of hemoglobin concentration that are highly beneficial for perfusion and overall tissue viability. Also utilizing optical property maps, a novel technique for quantitative fluorescence imaging was also demonstrated, showing large improvement over standard and ratiometric methods. To enable real-time feedback, rapid processing algorithms were designed using lookup tables that provide a 100x improvement in processing speed. Finally, these techniques were demonstrated in vivo to investigate their ability for early detection of tissue failure due to ischemia. Both pre-clinical studies show endogenous contrast imaging can provide early measures of future tissue viability. The goal of this work has been to provide the foundation for real-time imaging systems that provide tissue constituent quantification for tissue viability assessments.2018-01-09T00:00:00

X-ray Imaging of Transplanar Liquid Transport Mechanisms in Single Layer Textiles

Understanding the penetration of liquids within textile fibers is critical for the development of next-generation smart textiles. Despite substantial research on liquid penetration in the plane of the textile, little is known about how the liquid penetrates in the thickness direction. Here we report a time-resolved high-resolution X-ray measurement of the motion of the liquid–air interface within a single layer textile, as the liquid is transported across the textile thickness following the deposition of a droplet. The measurement of the time-dependent position of the liquid meniscus is made possible by the use of ultrahigh viscosity liquids (dynamic viscosity from 10⁵ to 2.5 × 10⁶ times larger than water). This approach enables imaging due to the slow penetration kinetics. Imaging results suggest a three-stage penetration process with each stage being associated with one of the three types of capillary channels existing in the textile geometry, providing insights into the effect of the textile structure on the path of the three-dimensional liquid meniscus. One dimensional kinetics studies show that our data for the transplanar penetration depth Δ<i>x</i>_L vs time do not conform to a power law, and that the measured rate of penetration for long times is smaller than that predicted by Lucas–Washburn kinetics, challenging commonly held assumptions regarding the validity of power laws when applied to relatively thin textiles

Developing a dual-wavelength full-waveform terrestrial laser scanner to characterise forest canopy structure

The development of a dual-wavelength full-waveform terrestrial laser scanner to measure the three-dimensional structure of forest canopies is described, and field measurements used to evaluate and test the instrument measurement characteristics. The Salford Advanced Laser Canopy Analyser (SALCA) measures the full-waveform of backscattered radiation at two laser wavelengths, one in the near-infrared (1063 nm) and one in the shortwave infrared (1545 nm). The instrument is field-portable and measures up to nine million waveforms, at the two wavelengths, across a complete hemisphere above the instrument. SALCA was purpose-built to measure structural characteristics of forest canopies and this paper reports the first results of field-based data collection using the instrument. Characteristics of the waveforms, and waveform data processing are outlined, applications of dual wavelength measurements are evaluated, and field deployment of the instrument at a forest test site described. Preliminary instrument calibration results are presented and challenges in extracting useful information on forest structure are highlighted. Full-waveform multiple-wavelength terrestrial laser scanners are likely to provide more detailed and more accurate forest structural measurement in the future. This research demonstrates how SALCA provides a key step to develop, test and apply this new technology in a range of forest-related problems

Fully three-dimensional sound speed-corrected multi-wavelength photoacoustic breast tomography

Photoacoustic tomography is a contrast agent-free imaging technique capable of visualizing blood vessels and tumor-associated vascularization in breast tissue. While sophisticated breast imaging systems have been recently developed, there is yet much to be gained in imaging depth, image quality and tissue characterization capability before clinical translation is possible. In response, we have developed a hybrid photoacoustic and ultrasound-transmission tomographic system PAM3. The photoacoustic component has for the first time three-dimensional multi-wavelength imaging capability, and implements substantial technical advancements in critical hardware and software sub-systems. The ultrasound component enables for the first time, a three-dimensional sound speed map of the breast to be incorporated in photoacoustic reconstruction to correct for inhomogeneities, enabling accurate target recovery. The results demonstrate the deepest photoacoustic breast imaging to date namely 48 mm, with a more uniform field of view than hitherto, and an isotropic spatial resolution that rivals that of Magnetic Resonance Imaging. The in vivo performance achieved, and the diagnostic value of interrogating angiogenesis-driven optical contrast as well as tumor mass sound speed contrast, gives confidence in the system's clinical potential.Comment: 33 pages Main Body, 9 pages Supplementary Materia