Rectification of panoramic photographs

Thesis (M.A.)--Boston UniversityPanoramic photography is quite old, but is becoming increasingly important in the field of aerial photography. Due to increased efficiency of aircraft warning facilities and accuracy of anti-aircraft missles the problem of obtaining photographs for aerial reconnaissance and mapping and charting becomes extremely hazardous. The obvious solution is to fly higher and further away and to take oblique photographs. This doesn't seem to be difficult, at first glance, but the object to camera distance becomes extremely long, thereby reducing the scale of the photograph. Decreasing the scale of a photograph decreases its usability. The only way to keep a proper scale then, is to increase the focal length. Increasing the focal length increases the format size and the overall camera dimensions, and more important weight. Weight and size are at a premium in an aircraft and to combat this a folded optical system is coupled to a slit scan device which utilizes moving film. This reduces weight and size, but introduces other technical problems, which are presently being solved by the U. S. Air Force. Assuming that the panoramic camera is built and is operational suitable. A method of rectification must be devised in order to effectively utilize the photography. Three methods of rectification are discussed. First, a pancratic lens coupled to a slit scanning device. Second, a mechanical rectifier, utilizing moving film and paper. Third, a mathematical Solution. The pancratic lens-slit scan system tends to recreate the conditions in existence at the time of exposure. The Scheimpflug condition is neglected by selecting a slit width so small that the image remains within the focal range. During the exposure the images were in perfect focus from nadir to horizon, as the distances involved are considered to be infinity. But in rectifier the object to image distance varies from 4 feet at the nadir to 6 feet at 0 = 60°. Therefore a lens system had to be designed to keep proper focus for all object to image distances and the proper magnification, (to insure the correct scale). These two variables are a function of the angle of scan (0). The basic design for this pancratic lens starts with selecting 2 lenses of 22 inch focal length and computing the movements necessary to accomplish the required magnifications and focal distances. It was found that this could be easily accomplished, but the final lens system would have to be designed by a competent lens designer and would be much more complicated, due to a aberration corrections. For proper illumination the filament of the light source has to move as a function of 0 in order to keep imaged onto the aperture. The effective f/no very nicely stayed approximately the same, 14.75 to 17.25, throughout all the lens movements. For overall illumination the speed of the scan has to vary to compensate for loss due to the inverse square law, due to tilting of the image plane, and due to increased density of negative toward the horizon. The second system, the mechanical system, consists of either a pancratic or a fixed lens system, with the negative moving past a slit and the image being projected down on a table onto moving paper. The moving parts that have to be calibrated are: the negative, printing paper, light source filament, 1st projection lens, 2nd projection lens, rotation of lens system, image to object distance, and tilt of easel. Most of these relationships are easy to compute and control, but the paper speed when determined will be difficult to control. As has been observed in the field , continuous printing devices do not operate efficiently in operational organizations. The third system, the mathematical solution, uses surfaces which were derived by trial and error after extensive mathematical research. This system can be proved, mathematically, not to be perfect. In fact the distortion has not been reduced less than 14 per cent. This is too much for reconnaissance and charting purposes. In view of the limitations of the various rectifiers it is felt that the pancratic lens-slit scan system would be the most practical rectifier for field use. If accepted for field use this pancratic lens system could eventually replace the current tri-metrago method of charting. The panoramic rectification system would eliminate many operations and specialized techniques and save money by reducing man-power requirements per chart

Assessment of the CORONA series of satellite imagery for landscape archaeology: a case study from the Orontes valley, Syria

In 1995, a large database of satellite imagery with worldwide coverage taken from 1960 until 1972 was declassified. The main advantages of this imagery known as CORONA that made it attractive for archaeology were its moderate cost and its historical value. The main disadvantages were its unknown quality, format, geometry and the limited base of known applications. This thesis has sought to explore the properties and potential of CORONA imagery and thus enhance its value for applications in landscape archaeology. In order to ground these investigations in a real dataset, the properties and characteristics of CORONA imagery were explored through the case study of a landscape archaeology project working in the Orontes Valley, Syria. Present-day high-resolution IKONOS imagery was integrated within the study and assessed alongside CORONA imagery. The combination of these two image datasets was shown to provide a powerful set of tools for investigating past archaeological landscape in the Middle East. The imagery was assessed qualitatively through photointerpretation for its ability to detect archaeological remains, and quantitatively through the extraction of height information after the creation of stereomodels. The imagery was also assessed spectrally through fieldwork and spectroradiometric analysis, and for its Multiple View Angle (MVA) capability through visual and statistical analysis. Landscape archaeology requires a variety of data to be gathered from a large area, in an effective and inexpensive way. This study demonstrates an effective methodology for the deployment of CORONA and IKONOS imagery and raises a number of technical points of which the archaeological researcher community need to be aware of. Simultaneously, it identified certain limitations of the data and suggested solutions for the more effective exploitation of the strengths of CORONA imagery

Omnidirectional Stereo Vision for Autonomous Vehicles

Environment perception with cameras is an important requirement for many applications for autonomous vehicles and robots. This work presents a stereoscopic omnidirectional camera system for autonomous vehicles which resolves the problem of a limited field of view and provides a 360° panoramic view of the environment. We present a new projection model for these cameras and show that the camera setup overcomes major drawbacks of traditional perspective cameras in many applications

Earth Observation: Data, Processing and Applications. Volume 2B: Processing — Image Rectification

Eds. Harrison, B.A., Jupp, D.L.B., Lewis, M.M., Sparks, T., Mueller, N., Byrne, G

Spherical Image Processing for Immersive Visualisation and View Generation

This research presents the study of processing panoramic spherical images for immersive visualisation of real environments and generation of in-between views based on two views acquired. For visualisation based on one spherical image, the surrounding environment is modelled by a unit sphere mapped with the spherical image and the user is then allowed to navigate within the modelled scene. For visualisation based on two spherical images, a view generation algorithm is developed for modelling an indoor manmade environment and new views can be generated at an arbitrary position with respect to the existing two. This allows the scene to be modelled using multiple spherical images and the user to move smoothly from one sphere mapped image to another one by going through in-between sphere mapped images generated

Image Geometry

International audienc

Three-dimensional modeling of the human jaw/teeth using optics and statistics.

Object modeling is a fundamental problem in engineering, involving talents from computer-aided design, computational geometry, computer vision and advanced manufacturing. The process of object modeling takes three stages: sensing, representation, and analysis. Various sensors may be used to capture information about objects; optical cameras and laser scanners are common with rigid objects, while X-ray, CT and MRI are common with biological organs. These sensors may provide a direct or an indirect inference about the object, requiring a geometric representation in the computer that is suitable for subsequent usage. Geometric representations that are compact, i.e., capture the main features of the objects with a minimal number of data points or vertices, fall into the domain of computational geometry. Once a compact object representation is in the computer, various analysis steps can be conducted, including recognition, coding, transmission, etc. The subject matter of this dissertation is object reconstruction from a sequence of optical images using shape from shading (SFS) and SFS with shape priors. The application domain is dentistry. Most of the SFS approaches focus on the computational part of the SFS problem, i.e. the numerical solution. As a result, the imaging model in most conventional SFS algorithms has been simplified under three simple, but restrictive assumptions: (1) the camera performs an orthographic projection of the scene, (2) the surface has a Lambertian reflectance and (3) the light source is a single point source at infinity. Unfortunately, such assumptions are no longer held in the case of reconstruction of real objects as intra-oral imaging environment for human teeth. In this work, we introduce a more realistic formulation of the SFS problem by considering the image formation components: the camera, the light source, and the surface reflectance. This dissertation proposes a non-Lambertian SFS algorithm under perspective projection which benefits from camera calibration parameters. The attenuation of illumination is taken account due to near-field imaging. The surface reflectance is modeled using the Oren-Nayar-Wolff model which accounts for the retro-reflection case. In this context, a new variational formulation is proposed that relates an evolving surface model with image information, taking into consideration that the image is taken by a perspective camera with known parameters. A new energy functional is formulated to incorporate brightness, smoothness and integrability constraints. In addition, to further improve the accuracy and practicality of the results, 3D shape priors are incorporated in the proposed SFS formulation. This strategy is motivated by the fact that humans rely on strong prior information about the 3D world around us in order to perceive 3D shape information. Such information is statistically extracted from training 3D models of the human teeth. The proposed SFS algorithms have been used in two different frameworks in this dissertation: a) holistic, which stitches a sequence of images in order to cover the entire jaw, and then apply the SFS, and b) piece-wise, which focuses on a specific tooth or a segment of the human jaw, and applies SFS using physical teeth illumination characteristics. To augment the visible portion, and in order to have the entire jaw reconstructed without the use of CT or MRI or even X-rays, prior information were added which gathered from a database of human jaws. This database has been constructed from an adult population with variations in teeth size, degradation and alignments. The database contains both shape and albedo information for the population. Using this database, a novel statistical shape from shading (SSFS) approach has been created. Extending the work on human teeth analysis, Finite Element Analysis (FEA) is adapted for analyzing and calculating stresses and strains of dental structures. Previous Finite Element (FE) studies used approximate 2D models. In this dissertation, an accurate three-dimensional CAD model is proposed. 3D stress and displacements of different teeth type are successfully carried out. A newly developed open-source finite element solver, Finite Elements for Biomechanics (FEBio), has been used. The limitations of the experimental and analytical approaches used for stress and displacement analysis are overcome by using FEA tool benefits such as dealing with complex geometry and complex loading conditions

Digital Vertical Aerial Camera System for High-resolution Site Inspections in Conservation Easment Monitoring

A three-level satellite to ground monitoring scheme for conservation easement monitoring has been implemented in which high-resolution imagery serves as an intermediate step for inspecting high priority sites. A digital vertical aerial camera system was developed to fulfill the need for an economical source of imagery for this intermediate step. A method for attaching the camera system to small aircraft was designed, and the camera system was calibrated and tested. To ensure that the images obtained were of suitable quality for use in Level 2 inspections, rectified imagery was required to provide positional accuracy of 5 meters or less to be comparable to current commercially available high-resolution satellite imagery. Focal length calibration was performed to discover the infinity focal length at two lens settings (24mm and 35mm) with a precision of O.1mm. Known focal length is required for creation of navigation points representing locations to be photographed (waypoints). Photographing an object of known size at distances on a test range allowed estimates of focal lengths of 25.lmm and 35.4mm for the 24mm and 35mm lens settings, respectively. Constants required for distortion removal procedures were obtained using analytical plumb-line calibration procedures for both lens settings, with mild distortion at the 24mm setting and virtually no distortion found at the 35mm setting. The system was designed to operate in a series of stages: mission planning, mission execution, and post-mission processing. During mission planning, waypoints were created using custom tools in geographic information system (GIs) software. During mission execution, the camera is connected to a laptop computer with a global positioning system (GPS) receiver attached. Customized mobile GIs software accepts position information from the GPS receiver, provides information for navigation, and automatically triggers the camera upon reaching the desired location. Post-mission processing (rectification) of imagery for removal of lens distortion effects, correction of imagery for horizontal displacement due to terrain variations (relief displacement), and relating the images to ground coordinates were performed with no more than a second-order polynomial warping function. Accuracy testing was performed to verify the positional accuracy capabilities of the system in an ideal-case scenario as well as a real-world case. Using many welldistributed and highly accurate control points on flat terrain, the rectified images yielded median positional accuracy of 0.3 meters. Imagery captured over commercial forestland with varying terrain in eastern Maine, rectified to digital orthophoto quadrangles, yielded median positional accuracies of 2.3 meters with accuracies of 3.1 meters or better in 75 percent of measurements made. These accuracies were well within performance requirements. The images from the digital camera system are of high quality, displaying significant detail at common flying heights. At common flying heights the ground resolution of the camera system ranges between 0.07 meters and 0.67 meters per pixel, satisfying the requirement that imagery be of comparable resolution to current highresolution satellite imagery. Due to the high resolution of the imagery, the positional accuracy attainable, and the convenience with which it is operated, the digital aerial camera system developed is a potentially cost-effective solution for use in the intermediate step of a satellite to ground conservation easement monitoring scheme

Omnidirectional Stereo Vision for Autonomous Vehicles

Environment perception with cameras is an important requirement for many applications for autonomous vehicles and robots. This work presents a stereoscopic omnidirectional camera system for autonomous vehicles which resolves the problem of a limited field of view and provides a 360° panoramic view of the environment. We present a new projection model for these cameras and show that the camera setup overcomes major drawbacks of traditional perspective cameras in many applications

Lunar cartographic dossier, volume 1

The dossier is designed to provide an up to date summary of the extent and quality of cartographic information as well as describing materials available to support lunar scientific investigation and study. It covers the specific photographic, selenodetic and cartographic data considered to be of continuing significance to users of lunar cartographic information. Historical background data is included. Descriptive and evaluative information is presented concerning lunar maps, photomaps and photo mosaics. Discussion comprises identification of series or individual sheet characteristics, control basis, source materials and compilation methodology used. The global, regional and local selenodetic control are described which were produced for lunar feature location in support of lunar mapping or positional study. Further discussion covers the fundamental basis for each control system, number of points produced, techniques employed and evaluated accuracy. Although lunar photography is an informational source rather than a cartographic product, a photography section was included to facilitate correlation to the mapping and control works described. Description of lunar photographic systems, photography and photo support data are presented from a cartographic-photogrammetric viewpoint with commentary on cartographic applications