7 research outputs found
Learning Raw Image Denoising with Bayer Pattern Unification and Bayer Preserving Augmentation
In this paper, we present new data pre-processing and augmentation techniques
for DNN-based raw image denoising. Compared with traditional RGB image
denoising, performing this task on direct camera sensor readings presents new
challenges such as how to effectively handle various Bayer patterns from
different data sources, and subsequently how to perform valid data augmentation
with raw images. To address the first problem, we propose a Bayer pattern
unification (BayerUnify) method to unify different Bayer patterns. This allows
us to fully utilize a heterogeneous dataset to train a single denoising model
instead of training one model for each pattern. Furthermore, while it is
essential to augment the dataset to improve model generalization and
performance, we discovered that it is error-prone to modify raw images by
adapting augmentation methods designed for RGB images. Towards this end, we
present a Bayer preserving augmentation (BayerAug) method as an effective
approach for raw image augmentation. Combining these data processing technqiues
with a modified U-Net, our method achieves a PSNR of 52.11 and a SSIM of 0.9969
in NTIRE 2019 Real Image Denoising Challenge, demonstrating the
state-of-the-art performance. Our code is available at
https://github.com/Jiaming-Liu/BayerUnifyAug.Comment: Accepted by CVPRW 201
Deploying Image Deblurring across Mobile Devices: A Perspective of Quality and Latency
Recently, image enhancement and restoration have become important
applications on mobile devices, such as super-resolution and image deblurring.
However, most state-of-the-art networks present extremely high computational
complexity. This makes them difficult to be deployed on mobile devices with
acceptable latency. Moreover, when deploying to different mobile devices, there
is a large latency variation due to the difference and limitation of deep
learning accelerators on mobile devices. In this paper, we conduct a search of
portable network architectures for better quality-latency trade-off across
mobile devices. We further present the effectiveness of widely used network
optimizations for image deblurring task. This paper provides comprehensive
experiments and comparisons to uncover the in-depth analysis for both latency
and image quality. Through all the above works, we demonstrate the successful
deployment of image deblurring application on mobile devices with the
acceleration of deep learning accelerators. To the best of our knowledge, this
is the first paper that addresses all the deployment issues of image deblurring
task across mobile devices. This paper provides practical
deployment-guidelines, and is adopted by the championship-winning team in NTIRE
2020 Image Deblurring Challenge on Smartphone Track.Comment: CVPR 2020 Workshop on New Trends in Image Restoration and Enhancement
(NTIRE