Location of Repository

3D Panoramic Imaging for Virtual Environment\ud Construction

By Duke Gledhill

Abstract

The project is concerned with the development of algorithms for the creation of photo-realistic 3D virtual environments, overcoming problems in mosaicing, colour and lighting changes, correspondence search speed and correspondence errors due to lack of surface texture.\ud \ud \ud A number of related new algorithms have been investigated for image stitching, content based colour correction and efficient 3D surface reconstruction. All of the investigations were undertaken by using multiple views from normal digital cameras, web cameras and a ”one-shot” panoramic system. In the process of 3D reconstruction a new interest points based mosaicing method, a new interest points based colour correction method, a new hybrid feature and area based correspondence constraint\ud and a new structured light based 3D reconstruction method have been investigated.\ud \ud \ud The major contributions and results can be summarised as follows:\ud \ud \ud • A new interest point based image stitching method has been proposed and investigated.\ud The robustness of interest points has been tested and evaluated. Interest points have been proved robust to changes in lighting, viewpoint, rotation\ud and scale.\ud \ud \ud • A new interest point based method for colour correction has been proposed and investigated. The results of linear and linear plus affine colour transforms have proved more accurate than traditional diagonal transforms in accurately\ud matching colours in panoramic images.\ud \ud \ud • A new structured light based method for correspondence point based 3D reconstruction\ud has been proposed and investigated. The method has been proved to increase the accuracy of the correspondence search for areas with low texture.\ud Correspondence speed has also been increased with a new hybrid feature and area based correspondence search constraint.\ud \ud \ud • Based on the investigation, a software framework has been developed for image based 3D virtual environment construction. The GUI includes abilities for importing images, colour correction, mosaicing, 3D surface reconstruction, texture recovery and visualisation.\ud \ud \ud • 11 research papers have been published

Topics: QA75, QA76
OAI identifier: oai:eprints.hud.ac.uk:6981

Suggested articles

Preview

Citations

  1. (1996). 3D Deformation Measurement in Small Areas based on Grating Method and Photogrammetry”.
  2. (2003). 3D reconstruction of sport events for digital TV”.
  3. (1988). A combined corner and edge detector”.
  4. (1986). A Computational Approach to Edge Detection”.
  5. (1981). A computer algorithm for reconstructing a scene from two projections”.
  6. (2000). A Cooperative Algorithm for Stereo Matching and Occlusion Detection”.
  7. (1997). A Direct Method for Stereo Correspondence Based on Singular Value Decomposition”.
  8. (1998). A Fast 3D Object Reconstruction Using Trinocular Vision and Structured Light”.
  9. (2000). A Flexible New Technique for Camera Calibration”.
  10. (1983). A Multiresolution Spline with Application to Image Mosaics”.
  11. (2000). A Review of Image-based Rendering Techniques”.
  12. (1995). A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry”.
  13. (1994). A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment”.
  14. (1992). A Survey of Image Registration Techniques”.
  15. (1999). Accuracy Bounds and Optimal Computation of Homograph for Image Mosaicing Applications”.
  16. (1996). Accurate 3D Measurement using a Structured Light System”. Image and Vision Computing,
  17. (1995). Acquiring Immersive Virtual Environments with an Uncalibrated Camera”.
  18. (2002). An efficient motion estimation algorithm for video coding using kalman filter”. Real-time imaging,
  19. (2001). An Optical See-through Display for Mutual Occlusion with a Real-time Stereovision System”.
  20. (1995). Apple Computer Inc. ”An Overview of Apple’s QuickTime
  21. Applications of 2D Image Registration”. Research Memorandum RM/99/15,
  22. (1997). Automated Creation of Image Based Virtual Reality”.
  23. (2002). Binocular matching constraints from motion”.
  24. (1998). Central Panoramic Cameras: Design and Geometry”. Third Computer Vision Winter Workshop,
  25. (1994). Color Constancy: Generalized Diagonal Transforms Suffice”.
  26. (1999). Colour indexing across illumination”. The proceedings of CIR 99,
  27. (1999). Colour normalisation for colour object recognition”.
  28. (1998). Comparing and evaluating interest points”.
  29. (1999). Complex Wavelet-Based Image Mosaics using EdgePreserving Visual Perception Modelling”.
  30. (2003). Comprehensive interest points based imaging mosaic”.
  31. (1998). Construction and Refinement of Panoramic Mosaics with Global and Local Alignment”. In
  32. (1999). Content-based image retrieval based on local affinity invariant regions”.
  33. (1997). Creating Full View Panoramic Image Mosaics and Environment Maps”.
  34. (1999). Dense Disparity Estimation with a Divide-andConquer Disparity Space Image Technique”.
  35. Diagonal versus Affine Transformations for Colour Correction”.
  36. (1998). Disparity and Occlusion Estimation in Multiocular Systems and Their Coding for the Communication of Multiview Image Sequences”.
  37. (1998). Disparity Field and Depth Map Coding for Multiview 3D Image Generation”. Signal Processing:
  38. (2004). Distinctive Image Features from Scale-Invariant Keypoints”.
  39. (1997). Efficient Stereo with Multiple Windowing”.
  40. (1999). Estimating Multiple Depths in Semi-transparent Stereo Images”.
  41. (2000). Evaluation of Interest Point Detectors”.
  42. (2002). Fast Stereo Matching Using Rectangular Sub-regioning and 3D Maximum-surface Techniques”.
  43. (2000). Generating Animatable 3D Virtual Humans from Photographs”. Eurographics
  44. (2000). Geometric Camera Calibration using Circular Control Points”.
  45. (1995). Global color constancy: recognition of objects by use of illumination invariant properties of color distributions”.
  46. (2001). Hierarchical Block-Based Disparity Estimation Using Mean Absolute Difference and Dynamic Programming”.
  47. (1997). Hierarchical depth mapping from multiple cameras”.
  48. (2001). High Dynamic Range Panoramic Imaging”.
  49. http://www.canon.co.uk/About Us/About Canon/Research Development/3D Softw
  50. (1998). Image Analysis for 3D Modelling, Rendering and Virtual View Generation”.
  51. (1994). Image mosaicing for tele-reality applications”.
  52. (1996). Image Retrieval using Local Characterisation”.
  53. (2001). Image-Based Modeling and Photo Editing”.
  54. (2001). Indexing Based Scale Invariant Interest
  55. (1999). Integrating Stereo and Shape from Shading”.
  56. (2008). Integration of Real and Virtual Light Sources in Augmented Reality Worlds”,
  57. (1998). Introductory Techniques for 3D Computer Vision”.
  58. (1971). Lightness and retinex theory”.
  59. (1997). Local gray-value invariants for image retrieval”.
  60. (1996). Modeling and Rendering Architecture from Photographs: A Hybrid Geometry and Image Based Approach”.
  61. Mosaic image method: a local and global method”. The IEICE Transactions Information and Systems.
  62. (1989). Motion and Structure from Two Perspective Views: Algorithms, Error Analysis and Error Estimation”.
  63. (2007). Multi-View Correspondence by Enforcement of Rigidity Constraints.
  64. (1997). Nonparameteric texture analysis using spatial operators, with applications in visual inspection”.
  65. (1999). Notes on the Applications of Homographies
  66. (1999). Object Recognition from Local Scale-Invariant Features”.
  67. (1995). Obstacle Avoidance with Omnidirectional Image Sensor HyperOmni Vision”.
  68. (1992). Omni-directional stereo.
  69. (1999). Omnivergent Stereo”.
  70. (2001). Optics for Omnistereo Imaging”. Foundations of Image Understanding,
  71. (1998). Optimal Recovery of Depth from Defocused Images Using an MRF Model”.
  72. (2000). Panoramic Cameras for 3D Computation”.
  73. (2003). Panoramic imaging -a review”.
  74. (1998). Panoramic Stereo Imaging System with Automatic Disparity Warping and Seaming”.
  75. (1970). Panoramic Television Viewing System”.
  76. (2001). Panoramic video capturing and compressed domain virtual camera control”.
  77. (1999). Panoramic Video Representation using Mosaic Image”.
  78. (1997). Patch-based Stereo in a General Binocular Viewing Geometry”.
  79. (1995). Physically-valid View Synthesis by Image Interpolation”.
  80. (2001). Plenoptic Stitching: A Scalable Method for Reconstructing 3D Interactive Walkthroughs”.
  81. (1995). Quicktime VR - An Image Based Approach to Virtual Environment Navigation”.
  82. (1993). Real time correlation based stereo: algorithm implementations and applications”.
  83. (1999). Real-time Image Mosaicing From a Video Sequence”.
  84. (1998). Real-Time Omnidirectional and Panoramic Stereo”. Image Understanding Workshop (IUW),
  85. (2001). Real-time omnidirectional stereo for obstacle detection and tracking in dynamic environments”.
  86. (2001). Reconstruction of Linearly Parameterized Models from Single Images with a Camera of Unknown Focal Length”.
  87. (1999). Robust hierarchical algorithm for constructing a mosaic from images of the curved human retina”.
  88. (1981). Rover Visual Obstacle Avoidance”.
  89. (1983). Scale-space filtering”.
  90. (1997). Self-Calibration of a Moving Camera from Point Correspondences and Fundamental Matrices”.
  91. (1992). Shape and motion from image streams under orthography: a factorisation approach”.
  92. (2002). Stereo correspondence with compact windows via minimum ratio cycle”.
  93. (1999). Stereo Mosaics from a Moving Video Camera for Environmental Monitoring”.
  94. (1999). Stereo Panorama with a Single Camera”. CVPR99, 1:1395,
  95. (1999). Stereo Reconstruction from Multiperspective Panoramas”.
  96. (2000). Stitching reliability for estimating camera focal length in panoramic image mosaicing”.
  97. (2001). Structure and motion from silhouettes”.
  98. (1991). Structure from Motion - a Critical Analysis of Methods”.
  99. (1989). Structure from Stereo - A Review”.
  100. (1989). Surface from stereo: integrating feature matching, disparity estimation and contour detection”.
  101. (1997). SUSAN - A New Approach to Low Level Image Processing”.
  102. (1998). Telepresence by Realtime View-Dependent Image Generation from Omnidirectional Video Streams”.
  103. (2000). Tensor Voting: Theory and Applications”.
  104. (2005). The Beagle 2 stereo camera system. Planetary and Space Science,
  105. (1996). The Fundamental Matrix: Theory, Algorithms and Stability Analysis”.
  106. (1912). The Relation Between the Color of the Illuminant and the Color of the Illuminated Object”.
  107. (2001). The Space of All Stereo Images”.
  108. (1993). Three Dimensional Computer Vision: a Geometric Viewpoint”.
  109. (2001). Three-dimensional Modelling from two-dimensional Video”.
  110. (1997). Using geometric corners to build a 2D mosaic from a set of images”.
  111. (1996). Video mosaics for virtual environments”.
  112. (1994). Virtual Bellows: Contructing High Quality Stills from Video”.

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.