520 research outputs found
Deep Learning for Single Image Super-Resolution: A Brief Review
Single image super-resolution (SISR) is a notoriously challenging ill-posed
problem, which aims to obtain a high-resolution (HR) output from one of its
low-resolution (LR) versions. To solve the SISR problem, recently powerful deep
learning algorithms have been employed and achieved the state-of-the-art
performance. In this survey, we review representative deep learning-based SISR
methods, and group them into two categories according to their major
contributions to two essential aspects of SISR: the exploration of efficient
neural network architectures for SISR, and the development of effective
optimization objectives for deep SISR learning. For each category, a baseline
is firstly established and several critical limitations of the baseline are
summarized. Then representative works on overcoming these limitations are
presented based on their original contents as well as our critical
understandings and analyses, and relevant comparisons are conducted from a
variety of perspectives. Finally we conclude this review with some vital
current challenges and future trends in SISR leveraging deep learning
algorithms.Comment: Accepted by IEEE Transactions on Multimedia (TMM
Optimal sparsity allows reliable system-aware restoration of fluorescence microscopy images
Incluye: artÃculo, material suplementario, videos y software.Fluorescence microscopy is one of the most indispensable and informative driving forces for biological research, but the extent of observable biological phenomena is essentially determined by the content and quality of the acquired images. To address the different noise sources that can degrade these images, we introduce an algorithm for multiscale image restoration through optimally sparse representation (MIRO). MIRO is a deterministic framework that models the acquisition process and uses pixelwise noise correction to improve image quality. Our study demonstrates that this approach yields a remarkable restoration of the fluorescence signal for a wide range of microscopy systems, regardless of the detector used (e.g., electron-multiplying charge-coupled device, scientific complementary metal-oxide semiconductor, or photomultiplier tube). MIRO improves current imaging capabilities, enabling fast, low-light optical microscopy, accurate image analysis, and robust machine intelligence when integrated with deep neural networks. This expands the range of biological knowledge that can be obtained from fluorescence microscopy.We acknowledge the support of the National Institutes of Health grants R35GM124846 (to S.J.) and R01AA028527 (to C.X.), the National Science Foundation grants BIO2145235 and EFMA1830941 (to S.J.), and Marvin H. and Nita S. Floyd Research Fund (to S.J.). This research project was supported, in part, by the Emory University Integrated Cellular Imaging Microscopy Core and by PHS Grant UL1TR000454 from the Clinical and Translational Science Award Program, National Institutes of Health, and National Center for Advancing Translational Sciences.S
CMISR: Circular Medical Image Super-Resolution
Classical methods of medical image super-resolution (MISR) utilize open-loop
architecture with implicit under-resolution (UR) unit and explicit
super-resolution (SR) unit. The UR unit can always be given, assumed, or
estimated, while the SR unit is elaborately designed according to various SR
algorithms. The closed-loop feedback mechanism is widely employed in current
MISR approaches and can efficiently improve their performance. The feedback
mechanism may be divided into two categories: local and global feedback.
Therefore, this paper proposes a global feedback-based closed-cycle framework,
circular MISR (CMISR), with unambiguous UR and SR elements. Mathematical model
and closed-loop equation of CMISR are built. Mathematical proof with
Taylor-series approximation indicates that CMISR has zero recovery error in
steady-state. In addition, CMISR holds plug-and-play characteristic which can
be established on any existing MISR algorithms. Five CMISR algorithms are
respectively proposed based on the state-of-the-art open-loop MISR algorithms.
Experimental results with three scale factors and on three open medical image
datasets show that CMISR is superior to MISR in reconstruction performance and
is particularly suited to medical images with strong edges or intense contrast
Deep Physics-Guided Unrolling Generalization for Compressed Sensing
By absorbing the merits of both the model- and data-driven methods, deep
physics-engaged learning scheme achieves high-accuracy and interpretable image
reconstruction. It has attracted growing attention and become the mainstream
for inverse imaging tasks. Focusing on the image compressed sensing (CS)
problem, we find the intrinsic defect of this emerging paradigm, widely
implemented by deep algorithm-unrolled networks, in which more plain iterations
involving real physics will bring enormous computation cost and long inference
time, hindering their practical application. A novel deep
hysics-guided unolled recovery earning
() framework is proposed by generalizing the traditional
iterative recovery model from image domain (ID) to the high-dimensional feature
domain (FD). A compact multiscale unrolling architecture is then developed to
enhance the network capacity and keep real-time inference speeds. Taking two
different perspectives of optimization and range-nullspace decomposition,
instead of building an algorithm-specific unrolled network, we provide two
implementations: and . Experiments exhibit
the significant performance and efficiency leading of PRL networks over other
state-of-the-art methods with a large potential for further improvement and
real application to other inverse imaging problems or optimization models.Comment: Accepted by International Journal of Computer Vision (IJCV) 202
- …