Recovering facial shape using a statistical model of surface normal direction

In this paper, we show how a statistical model of facial shape can be embedded within a shape-from-shading algorithm. We describe how facial shape can be captured using a statistical model of variations in surface normal direction. To construct this model, we make use of the azimuthal equidistant projection to map the distribution of surface normals from the polar representation on a unit sphere to Cartesian points on a local tangent plane. The distribution of surface normal directions is captured using the covariance matrix for the projected point positions. The eigenvectors of the covariance matrix define the modes of shape-variation in the fields of transformed surface normals. We show how this model can be trained using surface normal data acquired from range images and how to fit the model to intensity images of faces using constraints on the surface normal direction provided by Lambert's law. We demonstrate that the combination of a global statistical constraint and local irradiance constraint yields an efficient and accurate approach to facial shape recovery and is capable of recovering fine local surface details. We assess the accuracy of the technique on a variety of images with ground truth and real-world images

Approaching Visual Search in Photo-Realistic Scenes

Visual search is extended from the domain of polygonal figures presented on a uniform background to scenes in which search is for a photo-realistic object in a dense, naturalistic background. Scene generation for these displays relies on a powerful solid modeling program to define the three dimensional forms, surface properties, relative positions, and illumination of the objects and a rendering program to produce an image. Search in the presented experiments is for a rock with specific properties among other, similar rocks, although the method described can be generalized to other situations. Using this technique we explore the effects of illumination and shadows in aiding search for a rock in front of and closer to the viewer than other rocks in the scene. For these scenes, shadows of two different contrast levels can significantly deet·ease reaction times for displays in which target rocks are similar to distractor rocks. However, when the target rock is itself easily distinguishable from dis tractors on the basis of form, the presence or absence of shadows has no discernible effect. To relate our findings to those for earlier polygonal displays, we simplified the non-shadow displays so that only boundary information remained. For these simpler displays, search slopes (the reaction time as a function of the number of distractors) were significantly faster, indicating that the more complex photo-realistic objects require more time to process for visual search. In contrast with several previous experiments involving polygonal figures, we found no evidence for an effect of illumination direction on search times

Accurate Analysis of the Spatial Pattern of Reflected Light and Surface Orientations Based on Color Illumination

3D Recovery approaches require a variety of clues to obtain shape information. The shape from shading (SFS) method uses shading information in images to estimate depth maps. Although shading contains detailed information, it causes some well-known ambiguities such as convex-concave ambiguity. In this study, a system installation, using red, green, and blue illumination, and an algorithm, processing reflections on the surface, were proposed for the accurate analysis of surface orientations, and ambiguity problems. Surface orientations, erroneously predicted by six different methods, were improved by implementing the proposed system. Consequently, the correct orientation of the surface points was determined by removing the ambiguities in images taken without considering the location of illumination, and all the tested methods provided successful results using the proposed system

Shading Beats Binocular Disparity in Depth from Luminance Gradients: Evidence against a Maximum Likelihood Principle for Cue Combination

Perceived depth is conveyed by multiple cues, including binocular disparity and luminance shading. Depth perception from luminance shading information depends on the perceptual assumption for the incident light, which has been shown to default to a diffuse illumination assumption. We focus on the case of sinusoidally corrugated surfaces to ask how shading and disparity cues combine defined by the joint luminance gradients and intrinsic disparity modulation that would occur in viewing the physical corrugation of a uniform surface under diffuse illumination. Such surfaces were simulated with a sinusoidal luminance modulation (0.26 or 1.8 cy/deg, contrast 20%-80%) modulated either in-phase or in opposite phase with a sinusoidal disparity of the same corrugation frequency, with disparity amplitudes ranging from 0’-20’. The observers’ task was to adjust the binocular disparity of a comparison random-dot stereogram surface to match the perceived depth of the joint luminance/disparitymodulated corrugation target. Regardless of target spatial frequency, the perceived target depth increased with the luminance contrast and depended on luminance phase but was largely unaffected by the luminance disparity modulation. These results validate the idea that human observers can use the diffuse illumination assumption to perceive depth from luminance gradients alone without making an assumption of light direction. For depth judgments with combined cues, the observers gave much greater weighting to the luminance shading than to the disparity modulation of the targets. The results were not well-fit by a Bayesian cue-combination model weighted in proportion to the variance of the measurements for each cue in isolation. Instead, they suggest that the visual system uses disjunctive mechanisms to process these two types of information rather than combining them according to their likelihood ratios

The perception of shape from shading in a new light

How do humans see three-dimensional shape based on two-dimensional shading? Much research has assumed that a ‘light from above’ bias solves the ambiguity of shape from shading. Counter to the ‘light from above’ bias, studies of Bayesian priors have found that such a bias can be swayed by other light cues. Despite the persuasive power of the Bayesian models, many new studies and books cite the original ‘light from above’ findings. Here I present a version of the Bayesian result that can be experienced. The perception of shape-from-shading was found here to be influenced by an external light source, even when the light was obstructed and did not directly illuminate a two-dimensional stimulus. The results imply that this effect is robust and not low-level in nature. The perception of shape from shading is not necessarily based on a hard-wired internal representation of lighting direction, but rather assesses the direction of lighting in the scene adaptively. Here, for the first time, is an experiential opportunity to see what the Bayesian models have supported all along

Recognising the ageing face: the role of age in face processing

The effects of age-induced changes on face recognition were investigated as a means of exploring the role of age in the encoding of new facial memories. The ability of participants to recognise each of six previously learnt faces was tested with versions which were either identical to the learnt faces, the same age (but different in pose and expression), or younger or older in age. Participants were able to cope well with facial changes induced by ageing: their performance with older, but not younger, versions was comparable to that with faces which differed only in pose and expression. Since the large majority of different age versions were recognised successfully, it can be concluded that the process of recognition does not require an exact match in age characteristics between the stored representation of a face and the face currently in view. As the age-related changes explored here were those that occur during the period of growth, this in turn implies that the underlying structural physical properties of the face are (in addition to pose and facial expression) invariant to a certain extent

Perceiving, Measuring and Modeling Materials

This paper focuses in the interpretation of material properties of reflectivity and specularity assessed by the visual system under illumination consisting of both a focal and a diffuse component (the ‘sun-and-sky’ illumination assumption). This assumption provides for four kinds of luminance gradients: gradients of incident illumination, gradients of reflectivity, gradients of secondary self-illumination and gradients of shadowing. The analysis considers the dissociation of the material properties carried by specularity from the geometric properties of object shape, taking the sinusoidal surface as a canonical shape exemplar

Improving Shape Depiction under Arbitrary Rendering

International audienceBased on the observation that shading conveys shape information through intensity gradients, we present a new technique called Radiance Scaling that modifies the classical shading equations to offer versatile shape depiction functionalities. It works by scaling reflected light intensities depending on both surface curvature and material characteristics. As a result, diffuse shading or highlight variations become correlated to surface feature variations, enhancing concavities and convexities. The first advantage of such an approach is that it produces satisfying results with any kind of material for direct and global illumination: we demonstrate results obtained with Phong and Ashikmin-Shirley BRDFs, Cartoon shading, sub-Lambertian materials, perfectly reflective or refractive objects. Another advantage is that there is no restriction to the choice of lighting environment: it works with a single light, area lights, and inter-reflections. Third, it may be adapted to enhance surface shape through the use of precomputed radiance data such as Ambient Occlusion, Prefiltered Environment Maps or Lit Spheres. Finally, our approach works in real-time on modern graphics hardware making it suitable for any interactive 3D visualization