Enhancement Of Stereo Imagery By Artificial Texture Projection Generated Using A Lidar

Passive stereo imaging is capable of producing dense 3D data, but image matching algorithms generally perform poorly on images with large regions of homogenous texture due to ambiguous match costs. Stereo systems can be augmented with an additional light source that can project some form of unique texture onto surfaces in the scene. Methods include structured light, laser projection through diffractive optical elements, data projectors and laser speckle. Pattern projection using lasers has the advantage of producing images with a high signal to noise ratio. We have investigated the use of a scanning visible-beam LIDAR to simultaneously provide enhanced texture within the scene and to provide additional opportunities for data fusion in unmatched regions. The use of a LIDAR rather than a laser alone allows us to generate highly accurate ground truth data sets by scanning the scene at high resolution. This is necessary for evaluating different pattern projection schemes. Results from LIDAR generated random dots are presented and compared to other texture projection techniques. Finally, we investigate the use of image texture analysis to intelligently project texture where it is required while exploiting the texture available in the ambient light image

Interaction for creative applications with the Kinect v2 device

Human-Computer Interaction (HCI) is a multidisciplinary field of research that designs, evaluates and implements interactive ways of communication between computer systems and people. The evolution of different technologies in the last decades has contributed to the expansion of HCI into other fields of study as computer vision, cognitive science, psychology, industrial design, and also into interactive art. The present document contains a case of HCI in the context of interactive art. In a first step we analyse what kind of interaction can be achieved with the available equipment: a range imaging camera, a computer and a video projector. Then, three range imaging techniques capable of fulfilling our objective are studied and some devices available for purchasing and based on these techniques are compared. Thereafter, we study and compare the two acquired range imaging devices: the Kinect for Windows v1 and the Kinect for Windows v2. In a later step we build our interaction system with the Kinect for Windows v2 and we test it. We use Processing as a programming environment in order to apply creative coding and to try the different types of interaction that this device allows. Finally, with the experience gained in the previous studies and in these test, we present three final interactive programs

Study of Computational Image Matching Techniques: Improving Our View of Biomedical Image Data

Image matching techniques are proven to be necessary in various fields of science and engineering, with many new methods and applications introduced over the years. In this PhD thesis, several computational image matching methods are introduced and investigated for improving the analysis of various biomedical image data. These improvements include the use of matching techniques for enhancing visualization of cross-sectional imaging modalities such as Computed Tomography (CT) and Magnetic Resonance Imaging (MRI), denoising of retinal Optical Coherence Tomography (OCT), and high quality 3D reconstruction of surfaces from Scanning Electron Microscope (SEM) images. This work greatly improves the process of data interpretation of image data with far reaching consequences for basic sciences research. The thesis starts with a general notion of the problem of image matching followed by an overview of the topics covered in the thesis. This is followed by introduction and investigation of several applications of image matching/registration in biomdecial image processing: a) registration-based slice interpolation, b) fast mesh-based deformable image registration and c) use of simultaneous rigid registration and Robust Principal Component Analysis (RPCA) for speckle noise reduction of retinal OCT images. Moving towards a different notion of image matching/correspondence, the problem of view synthesis and 3D reconstruction, with a focus on 3D reconstruction of microscopic samples from 2D images captured by SEM, is considered next. Starting from sparse feature-based matching techniques, an extensive analysis is provided for using several well-known feature detector/descriptor techniques, namely ORB, BRIEF, SURF and SIFT, for the problem of multi-view 3D reconstruction. This chapter contains qualitative and quantitative comparisons in order to reveal the shortcomings of the sparse feature-based techniques. This is followed by introduction of a novel framework using sparse-dense matching/correspondence for high quality 3D reconstruction of SEM images. As will be shown, the proposed framework results in better reconstructions when compared with state-of-the-art sparse-feature based techniques. Even though the proposed framework produces satisfactory results, there is room for improvements. These improvements become more necessary when dealing with higher complexity microscopic samples imaged by SEM as well as in cases with large displacements between corresponding points in micrographs. Therefore, based on the proposed framework, a new approach is proposed for high quality 3D reconstruction of microscopic samples. While in case of having simpler microscopic samples the performance of the two proposed techniques are comparable, the new technique results in more truthful reconstruction of highly complex samples. The thesis is concluded with an overview of the thesis and also pointers regarding future directions of the research using both multi-view and photometric techniques for 3D reconstruction of SEM images

Extraction of spatial information from sterioscopic SAR images

Synthetic Aperture Radar (SAR) is now widely used for generating Digital Elevation Models (DEMs) and has advantages over optical data in terms of availability as it allows all-day and all-weather operations. The stereoscopic SAR method, which allows direct extraction of spatial information in three-dimensional space, has been established for decades. However, the traditional stereoscopic methods developed for SAR data depend on many human operations and need ground control points (GCPs), to set up geometric models. The aims of the thesis are not only to propose a refined rigorous stereoscopic SAR method and a new error model to predict theoretic errors, but also to achieve a higher level of automation and accuracy. By using a weighting matrix, which is derived by considering different observations in the space intersection algorithm, the minimal number of the GCPs required for the refined algorithm is only two. To achieve a high degree of automation, an optimized strategy of parameter selection for the pyramidal image correlation scheme employing a region-growing technique has been proposed. This avoids a trial-and-error approach to produce digital parallax data from the same-side SAR image pairs. A new method to derive GCPs automatically has been developed using a SAR image simulation technique, under the condition that a known DEM chip is available, to minimize human interventions and operator error. The proposed method for providing GCPs and the DEMs generated from space intersection have been incorporated into the procedures for geocoding SAR images to validate the proposed algorithms. The results derived show that the stereoscopic SAR data can be applied to geometric rectification in flat-to-moderate areas, and other applications of extraction of spatial information are promising