522 research outputs found
Accurate and robust image superresolution by neural processing of local image representations
Image superresolution involves the processing of an image sequence to generate a still image with higher resolution. Classical approaches, such as bayesian MAP methods, require iterative minimization procedures, with high computational costs. Recently, the authors proposed a method to tackle this problem, based on the use of a hybrid MLP-PNN architecture. In this paper, we present a novel superresolution method, based on an evolution of this concept, to incorporate the use of local image models. A neural processing stage receives as input the value of model coefficients on local windows. The data dimension-ality is firstly reduced by application of PCA. An MLP, trained on synthetic se-quences with various amounts of noise, estimates the high-resolution image data. The effect of varying the dimension of the network input space is exam-ined, showing a complex, structured behavior. Quantitative results are presented showing the accuracy and robustness of the proposed method
A hybrid MLP-PNN architecture for fast image superresolution
Proceedings of Joint International Conference ICANN/ICONIP 2003 Istanbul, Turkey, June 26–29, 2003The final publication is available at Springer via http://dx.doi.org/10.1007/3-540-44989-2_50Image superresolution methods process an input image sequence of a scene to obtain a still image with increased resolution. Classical approaches to this problem involve complex iterative minimization procedures, typically with high computational costs. In this paper is proposed a novel algorithm for superresolution that enables a substantial decrease in computer load. First, a probabilistic neural network architecture is used to perform a scattered-point interpolation of the image sequence data. The network kernel function is optimally determined for this problem by a multi-layer perceptron trained on synthetic data. Network parameters dependence on sequence noise level is quantitatively analyzed. This super-sampled image is spatially filtered to correct finite pixel size effects, to yield the final high-resolution estimate. Results on a real outdoor sequence are presented, showing the quality of the proposed method.This work has been partially supported by TIC2001-0572-C02-02 gran
Light field super resolution through controlled micro-shifts of light field sensor
Light field cameras enable new capabilities, such as post-capture refocusing
and aperture control, through capturing directional and spatial distribution of
light rays in space. Micro-lens array based light field camera design is often
preferred due to its light transmission efficiency, cost-effectiveness and
compactness. One drawback of the micro-lens array based light field cameras is
low spatial resolution due to the fact that a single sensor is shared to
capture both spatial and angular information. To address the low spatial
resolution issue, we present a light field imaging approach, where multiple
light fields are captured and fused to improve the spatial resolution. For each
capture, the light field sensor is shifted by a pre-determined fraction of a
micro-lens size using an XY translation stage for optimal performance
A novel disparity-assisted block matching-based approach for super-resolution of light field images
Currently, available plenoptic imaging technology has limited resolution. That makes it challenging to use this technology in applications, where sharpness is essential, such as film industry. Previous attempts aimed at enhancing the spatial resolution of plenoptic light field (LF) images were based on block and patch matching inherited from classical image super-resolution, where multiple views were considered as separate frames. By contrast to these approaches, a novel super-resolution technique is proposed in this paper with a focus on exploiting estimated disparity information to reduce the matching area in the super-resolution process. We estimate the disparity information from the interpolated LR view point images (VPs). We denote our method as light field block matching super-resolution. We additionally combine our novel super-resolution method with directionally adaptive image interpolation from [1] to preserve sharpness of the high-resolution images. We prove a steady gain in the PSNR and SSIM quality of the super-resolved images for the resolution enhancement factor 8x8 as compared to the recent approaches and also to our previous work [2]
Quantum Theory of Superresolution for Two Incoherent Optical Point Sources
Rayleigh's criterion for resolving two incoherent point sources has been the
most influential measure of optical imaging resolution for over a century. In
the context of statistical image processing, violation of the criterion is
especially detrimental to the estimation of the separation between the sources,
and modern farfield superresolution techniques rely on suppressing the emission
of close sources to enhance the localization precision. Using quantum optics,
quantum metrology, and statistical analysis, here we show that, even if two
close incoherent sources emit simultaneously, measurements with linear optics
and photon counting can estimate their separation from the far field almost as
precisely as conventional methods do for isolated sources, rendering Rayleigh's
criterion irrelevant to the problem. Our results demonstrate that
superresolution can be achieved not only for fluorophores but also for stars.Comment: 18 pages, 11 figures. v1: First draft. v2: Improved the presentation
and added a section on the issues of unknown centroid and misalignment. v3:
published in Physical Review
Comparative performance of airyscan and structured illumination superresolution microscopy in the study of the surface texture and 3D shape of pollen
The visualization of taxonomically diagnostic features of individual pollen grains can be a challenge for many ecologically and phylogenetically important pollen types. The resolution of traditional optical microscopy is limited by the diffraction of light (250 nm), while high resolution tools such as electron microscopy are limited by laborious preparation and imaging workflows. Airyscan confocal superresolution and structured illumination superresolution (SR-SIM) microscopy are powerful new tools for the study of nanoscale pollen morphology and three-dimensional structure that can overcome these basic limitations. This study demonstrates their utility in capturing morphological details below the diffraction limit of light. Using three distinct pollen morphotypes (Croton hirtus, Dactylis glomerata, and Helianthus sp.) and contrast-enhancing fluorescent staining, we were able to assess the effectiveness of the Airyscan and SR-SIM. We further demonstrate that these new superresolution methods can be easily applied to the study of fossil pollen material
Confidence-aware Levenberg-Marquardt optimization for joint motion estimation and super-resolution
Motion estimation across low-resolution frames and the reconstruction of
high-resolution images are two coupled subproblems of multi-frame
super-resolution. This paper introduces a new joint optimization approach for
motion estimation and image reconstruction to address this interdependence. Our
method is formulated via non-linear least squares optimization and combines two
principles of robust super-resolution. First, to enhance the robustness of the
joint estimation, we propose a confidence-aware energy minimization framework
augmented with sparse regularization. Second, we develop a tailor-made
Levenberg-Marquardt iteration scheme to jointly estimate motion parameters and
the high-resolution image along with the corresponding model confidence
parameters. Our experiments on simulated and real images confirm that the
proposed approach outperforms decoupled motion estimation and image
reconstruction as well as related state-of-the-art joint estimation algorithms.Comment: accepted for ICIP 201
Superresolution imaging: A survey of current techniques
CristĂłbal, G., Gil, E., Ĺ roubek, F., Flusser, J., Miravet, C., RodrĂguez, F. B., “Superresolution imaging: A survey of current techniques”, Proceedings of SPIE - The International Society for Optical Engineering, 7074, 2008. Copyright 2008. Society of Photo Optical Instrumentation Engineers. One print or electronic copy may be made for personal use only. Systematic reproduction and distribution, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited.Imaging plays a key role in many diverse areas of application, such as astronomy, remote sensing, microscopy, and
tomography. Owing to imperfections of measuring devices (e.g., optical degradations, limited size of sensors) and
instability of the observed scene (e.g., object motion, media turbulence), acquired images can be indistinct, noisy,
and may exhibit insufficient spatial and temporal resolution. In particular, several external effects blur images.
Techniques for recovering the original image include blind deconvolution (to remove blur) and superresolution
(SR). The stability of these methods depends on having more than one image of the same frame. Differences
between images are necessary to provide new information, but they can be almost unperceivable. State-of-the-art
SR techniques achieve remarkable results in resolution enhancement by estimating the subpixel shifts between
images, but they lack any apparatus for calculating the blurs. In this paper, after introducing a review of
current SR techniques we describe two recently developed SR methods by the authors. First, we introduce a
variational method that minimizes a regularized energy function with respect to the high resolution image and
blurs. In this way we establish a unifying way to simultaneously estimate the blurs and the high resolution
image. By estimating blurs we automatically estimate shifts with subpixel accuracy, which is inherent for good
SR performance. Second, an innovative learning-based algorithm using a neural architecture for SR is described.
Comparative experiments on real data illustrate the robustness and utilization of both methods.This research has been partially supported by the following grants: TEC2007-67025/TCM, TEC2006-28009-E,
BFI-2003-07276, TIN-2004-04363-C03-03 by the Spanish Ministry of Science and Innovation, and by PROFIT
projects FIT-070000-2003-475 and FIT-330100-2004-91. Also, this work has been partially supported by the
Czech Ministry of Education under the project No. 1M0572 (Research Center DAR) and by the Czech Science
Foundation under the project No. GACR 102/08/1593 and the CSIC-CAS bilateral project 2006CZ002
- …