132 research outputs found
Hybrid Pixel-Unshuffled Network for Lightweight Image Super-Resolution
Convolutional neural network (CNN) has achieved great success on image
super-resolution (SR). However, most deep CNN-based SR models take massive
computations to obtain high performance. Downsampling features for
multi-resolution fusion is an efficient and effective way to improve the
performance of visual recognition. Still, it is counter-intuitive in the SR
task, which needs to project a low-resolution input to high-resolution. In this
paper, we propose a novel Hybrid Pixel-Unshuffled Network (HPUN) by introducing
an efficient and effective downsampling module into the SR task. The network
contains pixel-unshuffled downsampling and Self-Residual Depthwise Separable
Convolutions. Specifically, we utilize pixel-unshuffle operation to downsample
the input features and use grouped convolution to reduce the channels. Besides,
we enhance the depthwise convolution's performance by adding the input feature
to its output. Experiments on benchmark datasets show that our HPUN achieves
and surpasses the state-of-the-art reconstruction performance with fewer
parameters and computation costs
Lightweight Modules for Efficient Deep Learning based Image Restoration
Low level image restoration is an integral component of modern artificial
intelligence (AI) driven camera pipelines. Most of these frameworks are based
on deep neural networks which present a massive computational overhead on
resource constrained platform like a mobile phone. In this paper, we propose
several lightweight low-level modules which can be used to create a
computationally low cost variant of a given baseline model. Recent works for
efficient neural networks design have mainly focused on classification.
However, low-level image processing falls under the image-to-image' translation
genre which requires some additional computational modules not present in
classification. This paper seeks to bridge this gap by designing generic
efficient modules which can replace essential components used in contemporary
deep learning based image restoration networks. We also present and analyse our
results highlighting the drawbacks of applying depthwise separable
convolutional kernel (a popular method for efficient classification network)
for sub-pixel convolution based upsampling (a popular upsampling strategy for
low-level vision applications). This shows that concepts from domain of
classification cannot always be seamlessly integrated into image-to-image
translation tasks. We extensively validate our findings on three popular tasks
of image inpainting, denoising and super-resolution. Our results show that
proposed networks consistently output visually similar reconstructions compared
to full capacity baselines with significant reduction of parameters, memory
footprint and execution speeds on contemporary mobile devices.Comment: Accepted at: IEEE Transactions on Circuits and Systems for Video
Technology (Early Access Print) | |Codes Available at:
https://github.com/avisekiit/TCSVT-LightWeight-CNNs | Supplementary Document
at:
https://drive.google.com/file/d/1BQhkh33Sen-d0qOrjq5h8ahw2VCUIVLg/view?usp=sharin
Neural Architecture Search for Compressed Sensing Magnetic Resonance Image Reconstruction
Recent works have demonstrated that deep learning (DL) based compressed
sensing (CS) implementation can accelerate Magnetic Resonance (MR) Imaging by
reconstructing MR images from sub-sampled k-space data. However, network
architectures adopted in previous methods are all designed by handcraft. Neural
Architecture Search (NAS) algorithms can automatically build neural network
architectures which have outperformed human designed ones in several vision
tasks. Inspired by this, here we proposed a novel and efficient network for the
MR image reconstruction problem via NAS instead of manual attempts.
Particularly, a specific cell structure, which was integrated into the
model-driven MR reconstruction pipeline, was automatically searched from a
flexible pre-defined operation search space in a differentiable manner.
Experimental results show that our searched network can produce better
reconstruction results compared to previous state-of-the-art methods in terms
of PSNR and SSIM with 4-6 times fewer computation resources. Extensive
experiments were conducted to analyze how hyper-parameters affect
reconstruction performance and the searched structures. The generalizability of
the searched architecture was also evaluated on different organ MR datasets.
Our proposed method can reach a better trade-off between computation cost and
reconstruction performance for MR reconstruction problem with good
generalizability and offer insights to design neural networks for other medical
image applications. The evaluation code will be available at
https://github.com/yjump/NAS-for-CSMRI.Comment: To be appear in Computerized Medical Imaging and Graphic
- …