Inpainting color images in learned dictionary

Sparse representation of natural images over redundant dictionary enables solution of the inpainting problem. A major challenge, in this regard, is learning of a dictionary that is well adapted to the image. Efficient methods are developed for grayscale images represented in patch space by using, for example, K-SVD or independent component analysis algorithms. Here, we address the problem of patch space-based dictionary learning for color images. To this end, an image in RGB color space is represented as a collection of vectorized 3D patch tensors. This leads to the state-of-the-art results in inpainting random and structured patterns of missing values as it is demonstrated in the paper

Audio Inpainting

(c) 2012 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works. Published version: IEEE Transactions on Audio, Speech and Language Processing 20(3): 922-932, Mar 2012. DOI: 10.1090/TASL.2011.2168211

Optical mammography combined with fluorescence imaging: lesion detection using scatterplots

Using scatterplots of 2 or 3 parameters, diffuse optical tomography and fluorescence imaging are combined to improve detectability of breast lesions. Small or low contrast phantom-lesions that were missed in the optical and fluorescence images were detected in the scatterplots. In patient measurements, all tumors were visible and easily differentiated from artifacts and areolas in the scatterplots. The different rate of intake and wash out of the fluorescent contrast agent in the healthy versus malignant tissues was also observed in the scatterplot: this information can be used to discriminate malignant lesion from normal structures

Inverse Shade Trees for Non-Parametric Material Representation and Editing

Recent progress in the measurement of surface reflectance has created a demand for non-parametric appearance representations that are accurate, compact, and easy to use for rendering. Another crucial goal, which has so far received little attention, is editability: for practical use, we must be able to change both the directional and spatial behavior of surface reflectance (e.g., making one material shinier, another more anisotropic, and changing the spatial "texture maps" indicating where each material appears). We introduce an Inverse Shade Tree framework that provides a general approach to estimating the "leaves" of a user-specified shade tree from high-dimensional measured datasets of appearance. These leaves are sampled 1- and 2-dimensional functions that capture both the directional behavior of individual materials and their spatial mixing patterns. In order to compute these shade trees automatically, we map the problem to matrix factorization and introduce a flexible new algorithm that allows for constraints such as non-negativity, sparsity, and energy conservation. Although we cannot infer every type of shade tree, we demonstrate the ability to reduce multi-gigabyte measured datasets of the Spatially-Varying Bidirectional Reflectance Distribution Function (SVBRDF) into a compact representation that may be edited in real time.Engineering and Applied Science