Roadmap on 3D integral imaging: Sensing, processing, and display

This Roadmap article on three-dimensional integral imaging provides an overview of some of the research activities in the field of integral imaging. The article discusses various aspects of the field including sensing of 3D scenes, processing of captured information, and 3D display and visualization of information. The paper consists of a series of 15 sections from the experts presenting various aspects of the field on sensing, processing, displays, augmented reality, microscopy, object recognition, and other applications. Each section represents the vision of its author to describe the progress, potential, vision, and challenging issues in this field

Modern lithographic techniques applied to stereographic imaging

The main aim of the research has been to produce and evaluate a high-quality diffusion screen to display projected film and television images. The screens have also been found to effectively de-pixelate LCD arrays viewed at a magnification of approximately 4x. The production process relies on the formation of localized refractive index gradients in a photopolymer. The photopolymer, specially formulated and supplied by Du Pont, is exposed to actinic light through a precision contact mask to initiate polymerization within the exposed areas. As polymerization proceeds, a monomer concentration gradient exists between the exposed and unexposed regions allowing the monomer molecules to diffuse. Since the longer polymer chains do not diffuse as readily, the molecular concentration of the material, which is related to its refractive index, is then no longer uniform. The generation of this refractive index profile can, to some extent, be controlled by careful exposure of the photopolymer through the correct mask so that the resulting diffusion screen can be tailored to suit specific viewing requirements. [Continues.

Exploring the optical perception of image within glass

Within the contemporary world, 3D film and television imagery is at the cutting edge of visual technology, but for centuries we have been captivated by the creation of visual illusions/allusions that play with our perception of the world, from the auto-stereoscopic barrier methods pioneered in the late 17th century by the French painter G. A. Bois-Clair to the ‘Op’ art movement of the 1960s and, more recently, Patrick Hughes’ ‘reverse perspective’ paintings. By building on these new and old technologies I have extended my own practice, which engages with the 2D image as a 3D allusion/illusion in glass, by examining how this type of image can be created and perceived within glass. I have explored theories of optical perception in connection with the binocular recognition of depth and space, as well as kinetic clues to distance through motion parallax monitoring and assumptions about default linear perspective, light and inference within our personal schemata. - ‘Optical illusion’ is used to mean an instance of a wrong or misinterpreted perception of a sensory experience; the distortion of senses revealing how the brain organises and interprets visual information; an individual’s ability to perceive depth, 3D form and motion. - ‘Allusion’ is used to imply a symbolic or covert reference. My practical research focuses on the perceived creation of the 3D image within glass and explores the notion of glass as a facilitator in working with and challenging the themes of 3D image perception. I have particularly addressed artistic spatial illusionary methods, reverse perspective techniques, auto-stereoscopic image-based systems, parallax stereograms and lenticular print and lens technology. Through building on my previous practice of working with multiple-layered images within cast glass, combined with more complex and scientific optical methods, I have explored the perception of the image by working with new and old 3D technologies in order to produce a body of work which examines this perception within glass. During my research I have developed an original casting process, a vacuum-casting lost wax process for glass, in addition to producing an accurate industry standard lenticular glass lens. This research intends to provide a theoretical basis for new glass working techniques, both within the glass artist’s studio and in the commercial world of print, towards applications within architectural design, installation art and image-based artwork in general. This thesis is therefore a summation of the research that I have undertaken over the past six years and an attempt to give substance to the ideas and references that have preoccupied my own investigations over that period. I have structured the thesis into three themes: perspective; perception; and process but those three elements were never separate from each other and not only do they depend on each other, their purpose is, in some way, to combine in the creation of my finished pieces

Holoscopic 3D imaging and display technology: Camera/ processing/ display

This thesis was submitted for the award of Doctor of Philosophy and was awarded by Brunel University LondonHoloscopic 3D imaging “Integral imaging” was first proposed by Lippmann in 1908. It has become an attractive technique for creating full colour 3D scene that exists in space. It promotes a single camera aperture for recording spatial information of a real scene and it uses a regularly spaced microlens arrays to simulate the principle of Fly’s eye technique, which creates physical duplicates of light field “true 3D-imaging technique”. While stereoscopic and multiview 3D imaging systems which simulate human eye technique are widely available in the commercial market, holoscopic 3D imaging technology is still in the research phase. The aim of this research is to investigate spatial resolution of holoscopic 3D imaging and display technology, which includes holoscopic 3D camera, processing and display. Smart microlens array architecture is proposed that doubles spatial resolution of holoscopic 3D camera horizontally by trading horizontal and vertical resolutions. In particular, it overcomes unbalanced pixel aspect ratio of unidirectional holoscopic 3D images. In addition, omnidirectional holoscopic 3D computer graphics rendering techniques are proposed that simplify the rendering complexity and facilitate holoscopic 3D content generation. Holoscopic 3D image stitching algorithm is proposed that widens overall viewing angle of holoscopic 3D camera aperture and pre-processing of holoscopic 3D image filters are proposed for spatial data alignment and 3D image data processing. In addition, Dynamic hyperlinker tool is developed that offers interactive holoscopic 3D video content search-ability and browse-ability. Novel pixel mapping techniques are proposed that improves spatial resolution and visual definition in space. For instance, 4D-DSPM enhances 3D pixels per inch from 44 3D-PPIs to 176 3D-PPIs horizontally and achieves spatial resolution of 1365 × 384 3D-Pixels whereas the traditional spatial resolution is 341 × 1536 3D-Pixels. In addition distributed pixel mapping is proposed that improves quality of holoscopic 3D scene in space by creating RGB-colour channel elemental images

Multispectral photography for earth resources

A guide for producing accurate multispectral results for earth resource applications is presented along with theoretical and analytical concepts of color and multispectral photography. Topics discussed include: capabilities and limitations of color and color infrared films; image color measurements; methods of relating ground phenomena to film density and color measurement; sensitometry; considerations in the selection of multispectral cameras and components; and mission planning

Holography: A survey

The development of holography and the state of the art in recording and displaying information, microscopy, motion, pictures, and television applications are discussed. In addition to optical holography, information is presented on microwave, acoustic, ultrasonic, and seismic holography. Other subjects include data processing, data storage, pattern recognition, and computer-generated holography. Diagrams of holographic installations are provided. Photographs of typical holographic applications are used to support the theoretical aspects

On the popularization of digital close-range photogrammetry: a handbook for new users.

Εθνικό Μετσόβιο Πολυτεχνείο--Μεταπτυχιακή Εργασία. Διεπιστημονικό-Διατμηματικό Πρόγραμμα Μεταπτυχιακών Σπουδών (Δ.Π.Μ.Σ.) “Γεωπληροφορική

Semi-automated geomorphological mapping applied to landslide hazard analysis

Computer-assisted three-dimensional (3D) mapping using stereo and multi-image (“softcopy”) photogrammetry is shown to enhance the visual interpretation of geomorphology in steep terrain with the direct benefit of greater locational accuracy than traditional manual mapping. This would benefit multi-parameter correlations between terrain attributes and landslide distribution in both direct and indirect forms of landslide hazard assessment. Case studies involve synthetic models of a landslide, and field studies of a rock slope and steep undeveloped hillsides with both recently formed and partly degraded, old landslide scars. Diagnostic 3D morphology was generated semi-automatically both using a terrain-following cursor under stereo-viewing and from high resolution digital elevation models created using area-based image correlation, further processed with curvature algorithms. Laboratory-based studies quantify limitations of area-based image correlation for measurement of 3D points on planar surfaces with varying camera orientations. The accuracy of point measurement is shown to be non-linear with limiting conditions created by both narrow and wide camera angles and moderate obliquity of the target plane. Analysis of the results with the planar surface highlighted problems with the controlling parameters of the area-based image correlation process when used for generating DEMs from images obtained with a low-cost digital camera. Although the specific cause of the phase-wrapped image artefacts identified was not found, the procedure would form a suitable method for testing image correlation software, as these artefacts may not be obvious in DEMs of non-planar surfaces.Modelling of synthetic landslides shows that Fast Fourier Transforms are an efficient method for removing noise, as produced by errors in measurement of individual DEM points, enabling diagnostic morphological terrain elements to be extracted. Component landforms within landslides are complex entities and conversion of the automatically-defined morphology into geomorphology was only achieved with manual interpretation; however, this interpretation was facilitated by softcopy-driven stereo viewing of the morphological entities across the hillsides.In the final case study of a large landslide within a man-made slope, landslide displacements were measured using a photogrammetric model consisting of 79 images captured with a helicopter-borne, hand-held, small format digital camera. Displacement vectors and a thematic geomorphological map were superimposed over an animated, 3D photo-textured model to aid non-stereo visualisation and communication of results