Volumetric 3D reconstruction and characterization of external anatomical structures from images

Three-dimensional (3D) reconstruction and characterization of external anatomical structures from images has been one of the major topics in Computer Vision.3D models of human external structures are normally built using 3D scanners. Although frequently expensive, they are usually easy to use and can provide 3D models of great accuracy.Recently, volumetric methods have been successfully used in 3D reconstruction of objects with complex shapes. Comparing with stereo-based methods, they are more efficient in building 3D models of smooth objects. They work in the object volumetric space and do not require a matching process between the images used, which is usually very complex with smooth objects.The work presented here is based on the Generalized Voxel Coloring (GVC) method. GVC does not impose any restriction on the objects shape or in the cameras displacement. Having as starting point a set of correctly calibrated images, GVC reconstructs the 3D shape of the desired object and colorizes the reconstructed 3D models surface.First, in GVC, a 3D volume of voxels surrounding the object to be built is defined. During the reconstruction process, inconsistent voxels are removed (carved). Consistency of a voxel is determined by analyzing the color standard deviation of the pixels that the same reproject in the images used. Finally, with the 3D volumetric model built, it is possible to get a polygonal approach of the objects surface, using, for example, the Marching Cubes algorithm.In this work, a simple fixed off-the-shelf CCD camera is used. To calibrate it, a planar chessboard pattern is placed in front of the same in different orientations. On this first image sequence, Zhangs method is applied to obtain the cameras intrinsic parameters and radial and tangential distortion coefficients. After that, the object to be reconstructed is placed on a simple turntable device and under it the calibration pattern is positioned. Using again Zhangs method, this configuration allows us to obtain the cameras extrinsic parameters. During the reconstruction process, the intrinsic cameras parameters do not change. Background/object segmentation is performed on all images of the second image sequence, using usual image processing algorithms, like image binarization by threshold value. Having as inputs the second image sequence, the binary images associated and the calibration parameters, GVC is applied to obtain the 3D model for the object to be reconstructed. Finally, the volumetric model obtained is polygonized and smoothed.Two objects were experimentally used: a hand and a human torso. The cameras calibration parameters were obtained with good precision and the 3D reconstructions built were quite satisfactory as well. Some characteristic measurements were obtained from the models built: volume, centroid, extreme points, etc.With this work, we can conclude that the building of an accurate 3D model of an external anatomical structure from images is difficult and complex. It was also verified that the errors obtained in the cameras calibration process have a strong influence on the considered reconstruction process. Thus, the future work will be concentrated in the improvement of the cameras calibration method used, as well as in the development of adequate photo-consistency criteria for objects with almost uniform colors on their surfaces, as is the case of human anatomical structures, in order to enhance the 3D models obtained

External Anatomical Shapes Reconstruction from Turntable Image Sequences using a Single off-the-shelf Camera

ABSTRACT: Three-dimensional (3D) human body reconstruction and modeling from multiple twodimensional (2D) images is a topic of great interest and research but still remains a difficult problem. Volumetric based methods are commonly used to solve this type of problem. With those methods, from a turntable image sequence of an object, a 3D model can be built. The final goal of the work presented in this paper is to reconstruct all-round 3D models of the human body, using a single off-the-shelf camera and volumetric techniques, with the best accuracy and photorealistic appearance. 1 HUMAN BODY 3D RECONSTRUCTION 3D imaging of physical objects has become a strong topic of research, mostly due to the increasing improvements in computational resources. Particularly, 3D reconstruction of the human body promise to open a very wide variety of applications: medicine, virtual reality, ergonomics applications, etc. Classical devices for external anatomical shape reconstruction are 3D scanners ((Levoy, Pulli et al.

External Anatomical Shapes Reconstruction from Turntable Image Sequences using a Single off-the-shelf Camera

Three-dimensional (3D) human body reconstruction and modeling from two-dimensional (2D) images is a topic of great interest and research but still remains a difficult problem to solve. Volumetric based methods are commonly used to solve this type of problem. With those methods, from a turntable image sequence of an object, a 3D model can be built. The final goal of the work presented in this paper is to reconstruct all-round 3D models of external anatomical shapes with good accuracy and photorealistic appearance, using a single off-the-shelf camera and a volumetric method