Analysis and approximation of some Shape-from-Shading models for non-Lambertian surfaces

The reconstruction of a 3D object or a scene is a classical inverse problem in Computer Vision. In the case of a single image this is called the Shape-from-Shading (SfS) problem and it is known to be ill-posed even in a simplified version like the vertical light source case. A huge number of works deals with the orthographic SfS problem based on the Lambertian reflectance model, the most common and simplest model which leads to an eikonal type equation when the light source is on the vertical axis. In this paper we want to study non-Lambertian models since they are more realistic and suitable whenever one has to deal with different kind of surfaces, rough or specular. We will present a unified mathematical formulation of some popular orthographic non-Lambertian models, considering vertical and oblique light directions as well as different viewer positions. These models lead to more complex stationary nonlinear partial differential equations of Hamilton-Jacobi type which can be regarded as the generalization of the classical eikonal equation corresponding to the Lambertian case. However, all the equations corresponding to the models considered here (Oren-Nayar and Phong) have a similar structure so we can look for weak solutions to this class in the viscosity solution framework. Via this unified approach, we are able to develop a semi-Lagrangian approximation scheme for the Oren-Nayar and the Phong model and to prove a general convergence result. Numerical simulations on synthetic and real images will illustrate the effectiveness of this approach and the main features of the scheme, also comparing the results with previous results in the literature.Comment: Accepted version to Journal of Mathematical Imaging and Vision, 57 page

An approximation scheme for an Eikonal Equation with discontinuous coefficient

We consider the stationary Hamilton-Jacobi equation where the dynamics can vanish at some points, the cost function is strictly positive and is allowed to be discontinuous. More precisely, we consider special class of discontinuities for which the notion of viscosity solution is well-suited. We propose a semi-Lagrangian scheme for the numerical approximation of the viscosity solution in the sense of Ishii and we study its properties. We also prove an a-priori error estimate for the scheme in an integral norm. The last section contains some applications to control and image processing problems

Curvature induced magnonic crystal in nanowires

A new type of magnonic crystals, curvature induced ones, is realized in ferromagnetic nanowires with periodically deformed shape. A magnon band structure of such crystal is fully determined by its curvature: the developed theory is well confirmed by simulations. An application to nanoscale spintronic devises with the geometrically tunable parameters is proposed, namely, to filter elements.Comment: 21 pages, 6 figures, for submission to SciPos

A unifying and rigorous Shape From Shading method adapted to realistic data and applications

International audienceWe propose a new method for the Lambertian Shape From Shading (SFS) problem based on the notion of Crandall-Lions viscosity solution. This method has the advantage of requiring the knowledge of the solution (the surface to be reconstructed) only on some part of the boundary and/or of the singular set (the set of the points at maximal intensity). Moreover it unifies in an unique mathematical formulation the works of Rouy and Tourin, Falcone et al., Prados and Faugeras, based on the notion of viscosity solutions and the work of Dupuis and Oliensis dealing with classical solutions and value functions. Also, it allows to generalize their results to the "perspective SFS" problem

Numerical algorithms for perspective shape from shading

The Shape-From-Shading (SFS) problem is a fundamental and classic problem in computer vision. It amounts to compute the 3-D depth of objects in a single given 2-D image. This is done by exploiting information about the illumination and the image brightness. We deal with a recent model for Perspective SFS (PSFS) for Lambertian surfaces. It is defined by a Hamilton-Jacobi equation and complemented by state constraints boundary conditions. In this paper we investigate and compare three state-of-the-art numerical approaches. We begin with a presentation of the methods. Then we discuss the use of some acceleration techniques, including cascading multigrid, for all the tested algorithms. The main goal of our paper is to analyze and compare recent solvers for the PSFS problem proposed in the literature

A rigorous and realistic Shape From Shading method and some of its applications

This article proposes a rigorous and realistic solution of the Lambertian Shape From Shading (SFS) problem. The power of our approach is threefolds. First, our work is based on a rigorous mathematical method: we define a new notion of weak solutions (in the viscosity sense) which does not necessarily requires boundary data (contrary to the work of [rouy-tourin:92,prados-faugeras-etal:02,prados-faugeras:03,camilli-falcone:96,falcone-sagona-etal:01]) and which allows to define a solution as soon as the image is (Lipschitz) continuous (contrary to the work of [oliensis:91,dupuis-oliensis:94]). We prove the existence and uniqueness of this (new) solution and we approximate it by using a provably convergent algorithm. Second, it improves the applicability of the SFS to real images: we complete the realistic work of [prados-faugeras:03,tankus-sochen-etal:03], by modeling the problem with a pinhole camera and with a single point light source located at the optical center. This new modelization appears very relevant for applications. Moreover, our algorithm can deal with images containing discontinuities and black shadows. It is very robust to pixel noise and to errors on parameters. It is also generic: i.e. we propose a unique algorithm which can compute numerical solutions of the various perspective and orthographic SFS models. Finally, our algorithm seems to be the most efficient iterative algorithm of the SFS literature. Third, we propose three applications (in three different areas) based on our SFS method

Terrain analysis using radar shape-from-shading

This paper develops a maximum a posteriori (MAP) probability estimation framework for shape-from-shading (SFS) from synthetic aperture radar (SAR) images. The aim is to use this method to reconstruct surface topography from a single radar image of relatively complex terrain. Our MAP framework makes explicit how the recovery of local surface orientation depends on the whereabouts of terrain edge features and the available radar reflectance information. To apply the resulting process to real world radar data, we require probabilistic models for the appearance of terrain features and the relationship between the orientation of surface normals and the radar reflectance. We show that the SAR data can be modeled using a Rayleigh-Bessel distribution and use this distribution to develop a maximum likelihood algorithm for detecting and labeling terrain edge features. Moreover, we show how robust statistics can be used to estimate the characteristic parameters of this distribution. We also develop an empirical model for the SAR reflectance function. Using the reflectance model, we perform Lambertian correction so that a conventional SFS algorithm can be applied to the radar data. The initial surface normal direction is constrained to point in the direction of the nearest ridge or ravine feature. Each surface normal must fall within a conical envelope whose axis is in the direction of the radar illuminant. The extent of the envelope depends on the corrected radar reflectance and the variance of the radar signal statistics. We explore various ways of smoothing the field of surface normals using robust statistics. Finally, we show how to reconstruct the terrain surface from the smoothed field of surface normal vectors. The proposed algorithm is applied to various SAR data sets containing relatively complex terrain structure

Self-induced transparency and giant nonlinearity in doped photonic crystals

Photonic crystals doped with resonant atoms allow for uniquely advantageous nonlinear modes of optical propagation: (a) Self-induced transparency (SIT) solitons and multi-dimensional localized "bullets" propagating at photonic band gap frequencies. These modes can exist even at ultraweak intensities (few photons) and therefore differ substantially either from solitons in Kerr-nonlinear photonic crystals or from SIT solitons in uniform media. (b) Cross-coupling between pulses exhibiting electromagnetically induced transparency (EIT) and SIT gap solitons. We show that extremely strong correlations (giant cross-phase modulation) can be formed between the two pulses. These features may find applications in high-fidelity classical and quantum optical communications.Comment: 11 pages, 7 figures, to appear in JOSA-

Shape from Shading: a well-posed problem?

International audienceShape From Shading is known to be an ill-posed problem. Contrary to the previous work, we show here that if we model the problem in a more realistic way than it is usually done (we take into account the 1/r2 attenuation term of the lighting), Shape From Shading can be completely well-posed. Thus the shading allows to recover (almost) any surface from only one image (of this surface), without any additional data (in particular, without regularity assumptions and without the knowledge of the heights of the solution at the local "minima". More precisely, in this report we formulate the problem as that of solving a new PDE, we develop a complete mathematical study of this equation (existence and uniqueness of the solution) and we design a new provably convergent numerical method. Finally, we test our new SFS method on various synthetic images and on our database of real images of faces, with success