Advanced retinal imaging: Feature extraction, 2-D registration, and 3-D reconstruction

In this dissertation, we have studied feature extraction and multiple view geometry in the context of retinal imaging. Specifically, this research involves three components, i.e., feature extraction, 2-D registration, and 3-D reconstruction. First, the problem of feature extraction is investigated. Features are significantly important in motion estimation techniques because they are the input to the algorithms. We have proposed a feature extraction algorithm for retinal images. Bifurcations/crossovers are used as features. A modified local entropy thresholding algorithm based on a new definition of co-occurrence matrix is proposed. Then, we consider 2-D retinal image registration which is the problem of the transformation of 2-D/2-D. Both linear and nonlinear models are incorporated to account for motions and distortions. A hybrid registration method has been introduced in order to take advantages of both feature-based and area-based methods have offered along with relevant decision-making criteria. Area-based binary mutual information is proposed or translation estimation. A feature-based hierarchical registration technique, which involves the affine and quadratic transformations, is developed. After that, a 3-D retinal surface reconstruction issue has been addressed. To generate a 3-D scene from 2-D images, a camera projection or transformations of 3-D/2-D techniques have been investigated. We choose an affine camera to characterize for 3-D retinal reconstruction. We introduce a constrained optimization procedure which incorporates a geometrically penalty function and lens distortion into the cost function. The procedure optimizes all of the parameters, camera's parameters, 3-D points, the physical shape of human retina, and lens distortion, simultaneously. Then, a point-based spherical fitting method is introduced. The proposed retinal imaging techniques will pave the path to a comprehensive visual 3-D retinal model for many medical applications

A structure from motion inequality

We state an elementary inequality for the structure from motion problem for m cameras and n points. This structure from motion inequality relates space dimension, camera parameter dimension, the number of cameras and number points and global symmetry properties and provides a rigorous criterion for which reconstruction is not possible with probability 1. Mathematically the inequality is based on Frobenius theorem which is a geometric incarnation of the fundamental theorem of linear algebra. The paper also provides a general mathematical formalism for the structure from motion problem. It includes the situation the points can move while the camera takes the pictures.Comment: 15 pages, 22 figure

Space and camera path reconstruction for omni-directional vision

In this paper, we address the inverse problem of reconstructing a scene as well as the camera motion from the image sequence taken by an omni-directional camera. Our structure from motion results give sharp conditions under which the reconstruction is unique. For example, if there are three points in general position and three omni-directional cameras in general position, a unique reconstruction is possible up to a similarity. We then look at the reconstruction problem with m cameras and n points, where n and m can be large and the over-determined system is solved by least square methods. The reconstruction is robust and generalizes to the case of a dynamic environment where landmarks can move during the movie capture. Possible applications of the result are computer assisted scene reconstruction, 3D scanning, autonomous robot navigation, medical tomography and city reconstructions

Towards automated capture of 3D foot geometry for custom orthoses

This thesis presents a novel method of capturing 3D foot geometry from images for custom shoe insole manufacture. Orthopedic footwear plays an important role as a treatment and prevention of foot conditions associated with diabetes. Through the use of customized shoe insoles, a podiatrist can provide a means to better distribute the pressure around the foot, and can also correct the biomechanics of the foot. Different foot scanners are used to obtain the geometric plantar surface of foot, but are expensive and more generic in nature. The focus of this thesis is to build 3D foot structure from a pair of calibrated images. The process begins with considering a pair of good images of the foot, obtained from the scanner utility frame. The next step involves identifying corners or features in the images. Correlation between the selected features forms the fundamental part of epipolar analysis. Rigorous techniques are implemented for robust feature matching. A 3D point cloud is then obtained by applying the 8-point algorithm and linear 3D triangulation method. The advantage of this system is quick capture of foot geometry and minimal intervention from the user. A reconstructed 3D point cloud of foot is presented to verify this method as inexpensive and more suited to the needs of the podiatrist

3D Image Reconstruction Using Multiple Images

The point in this thesis is to use a robot using which we can get photographs of a given thing from known edges. We mean to repeat and model these 2D photos to get the 3D sort of the article, which will be created and demonstrated in MATLAB. Demonstrating of 3D items from different pictures is one of the testing undertakings. Therefore our endeavor does not keep itself to giving the customer the adaptability of survey the article at any edge and in any presentation however outfits him with the complete model in space. This is an approach which retrieves the calibration from the image sequence only. A 3D image reconstruction strategy from stereo pictures is displayed next that needs insignificant mediation from the client .The upside of this framework is that the stereo pictures don't have to be calibrated to acquire a remaking. Results for both the cam alignment and reproduction are displayed to confirm that it is conceivable to acquire a 3D model specifically from features of pictures 3D reproduction and demonstrating is utilized as a part of numerous fields like Virtual Reality, perceiving and controlling items and so on

Reconstruction of Three-Dimensional Blood Vessel Model Using Fractal Interpolation

Fractal method is used in the image processing and studying the irregular and the complex shapes in the image. It is also used in the reconstruction and smoothing of one-, two-, and three-dimensional data. In this chapter, we present an interpolating fractal algorithm to reconstruct 3D blood vessels. Firstly, the proposed method determines the blood vessel centerline from the 2D retina image, and then it uses the Douglas-Peucker algorithm to detect the control points. Secondly, we use the 3D fractal interpolation and iterated function systems for the visualization and reconstruction of these blood vessels. The results showed that the obtained reduction rate is between 71 and 94% depending on the tolerance value. The 3D blood vessels model can be reconstructed efficiently by using the 3D fractal interpolation method

Low-cost interactive active monocular range finder

This paper describes a low-cost interactive active monocular range finder and illustrates the effect of introducing interactivity to the range acquisition process. The range finder consists of only one camera and a laser pointer, to which three LEDs are attached. When a user scans the laser along surfaces of objects, the camera captures the image of spots (one from the laser, and the others from LEDs), and triangulation is carried out using the camera\u27s viewing direction and the optical axis of the laser. The user interaction allows the range finder to acquire range data in which the sampling rate varies across the object depending on the underlying surface structures. Moreover, the processes of separating objects from the background and/or finding parts in the object can be achieved using the operator\u27s knowledge of the objects