영상 잡음 제거와 수중 영상 복원을 위한 정규화 방법

학위논문(박사)--서울대학교 대학원 :자연과학대학 수리과학부,2020. 2. 강명주.In this thesis, we discuss regularization methods for denoising images corrupted by Gaussian or Cauchy noise and image dehazing in underwater. In image denoising, we introduce the second-order extension of structure tensor total variation and propose a hybrid method for additive Gaussian noise. Furthermore, we apply the weighted nuclear norm under nonlocal framework to remove additive Cauchy noise in images. We adopt the nonconvex alternating direction method of multiplier to solve the problem iteratively. Subsequently, based on the color ellipsoid prior which is effective for restoring hazy image in the atmosphere, we suggest novel dehazing method adapted for underwater condition. Because attenuation rate of light varies depending on wavelength of light in water, we apply the color ellipsoid prior only for green and blue channels and combine it with intensity map of red channel to refine the obtained depth map further. Numerical experiments show that our proposed methods show superior results compared with other methods both in quantitative and qualitative aspects.본 논문에서 우리는 가우시안 또는 코시 분포를 따르는 잡음으로 오염된 영상과 물 속에서 얻은 영상을 복원하기 위한 정규화 방법에 대해 논의한다. 영상 잡음 문제에서 우리는 덧셈 가우시안 잡음의 해결을 위해 구조 텐서 총변이의 이차 확장을 도입하고 이것을 이용한 혼합 방법을 제안한다. 나아가 덧셈 코시 잡음 문제를 해결하기 위해 우리는 가중 핵 노름을 비국소적인 틀에서 적용하고 비볼록 교차 승수법을 통해서 반복적으로 문제를 푼다. 이어서 대기 중의 안개 낀 영상을 복원하는데 효과적인 색 타원면 가정에 기초하여, 우리는 물 속의 상황에 알맞은 영상 복원 방법을 제시한다. 물 속에서 빛의 감쇠 정도는 빛의 파장에 따라 달라지기 때문에, 우리는 색 타원면 가정을 영상의 녹색과 청색 채널에 적용하고 그로부터 얻은 깊이 지도를 적색 채널의 강도 지도와 혼합하여 개선된 깊이 지도를 얻는다. 수치적 실험을 통해서 우리가 제시한 방법들을 다른 방법과 비교하고 질적인 측면과 평가 지표에 따른 양적인 측면 모두에서 우수함을 확인한다.1 Introduction 1 1.1 Image denoising for Gaussian and Cauchy noise 2 1.2 Underwater image dehazing 5 2 Preliminaries 9 2.1 Variational models for image denoising 9 2.1.1 Data-fidelity 9 2.1.2 Regularization 11 2.1.3 Optimization algorithm 14 2.2 Methods for image dehazing in the air 15 2.2.1 Dark channel prior 16 2.2.2 Color ellipsoid prior 19 3 Image denoising for Gaussian and Cauchy noise 23 3.1 Second-order structure tensor and hybrid STV 23 3.1.1 Structure tensor total variation 24 3.1.2 Proposed model 28 3.1.3 Discretization of the model 31 3.1.4 Numerical algorithm 35 3.1.5 Experimental results 37 3.2 Weighted nuclear norm minimization for Cauchy noise 46 3.2.1 Variational models for Cauchy noise 46 3.2.2 Low rank minimization by weighted nuclear norm 52 3.2.3 Proposed method 55 3.2.4 ADMM algorithm 56 3.2.5 Numerical method and experimental results 58 4 Image restoration in underwater 71 4.1 Scientific background 72 4.2 Proposed method 73 4.2.1 Color ellipsoid prior on underwater 74 4.2.2 Background light estimation 78 4.3 Experimental results 80 5 Conclusion 87 Appendices 89Docto

Visibility recovery on images acquired in attenuating media. Application to underwater, fog, and mammographic imaging

136 p.When acquired in attenuating media, digital images of ten suffer from a particularly complex degradation that reduces their visual quality, hindering their suitability for further computational applications, or simply decreasing the visual pleasan tness for the user. In these cases, mathematical image processing reveals it self as an ideal tool to recover some of the information lost during the degradation process. In this dissertation,we deal with three of such practical scenarios in which this problematic is specially relevant, namely, underwater image enhancement, fogremoval and mammographic image processing. In the case of digital mammograms,X-ray beams traverse human tissue, and electronic detectorscapture them as they reach the other side. However, the superposition on a bidimensional image of three-dimensional structures produces low contraste dimages in which structures of interest suffer from a diminished visibility, obstructing diagnosis tasks. Regarding fog removal, the loss of contrast is produced by the atmospheric conditions, and white colour takes over the scene uniformly as distance increases, also reducing visibility.For underwater images, there is an added difficulty, since colour is not lost uniformly; instead, red colours decay the fastest, and green and blue colours typically dominate the acquired images. To address all these challenges,in this dissertation we develop new methodologies that rely on: a)physical models of the observed degradation, and b) the calculus of variations.Equipped with this powerful machinery, we design novel theoreticaland computational tools, including image-dependent functional energies that capture the particularities of each degradation model. These energie sare composed of different integral terms that are simultaneous lyminimized by means of efficient numerical schemes, producing a clean,visually-pleasant and use ful output image, with better contrast and increased visibility. In every considered application, we provide comprehensive qualitative (visual) and quantitative experimental results to validateour methods, confirming that the developed techniques out perform other existing approaches in the literature

Visibility Recovery on Images Acquired in Attenuating Media. Application to Underwater, Fog, and Mammographic Imaging

When acquired in attenuating media, digital images often suffer from a particularly complex degradation that reduces their visual quality, hindering their suitability for further computational applications, or simply decreasing the visual pleasantness for the user. In these cases, mathematical image processing reveals itself as an ideal tool to recover some of the information lost during the degradation process. In this dissertation, we deal with three of such practical scenarios in which this problematic is specially relevant, namely, underwater image enhancement, fog removal and mammographic image processing. In the case of digital mammograms, X-ray beams traverse human tissue, and electronic detectors capture them as they reach the other side. However, the superposition on a bidimensional image of three-dimensional structures produces lowcontrasted images in which structures of interest suffer from a diminished visibility, obstructing diagnosis tasks. Regarding fog removal, the loss of contrast is produced by the atmospheric conditions, and white colour takes over the scene uniformly as distance increases, also reducing visibility. For underwater images, there is an added difficulty, since colour is not lost uniformly; instead, red colours decay the fastest, and green and blue colours typically dominate the acquired images. To address all these challenges, in this dissertation we develop new methodologies that rely on: a) physical models of the observed degradation, and b) the calculus of variations. Equipped with this powerful machinery, we design novel theoretical and computational tools, including image-dependent functional energies that capture the particularities of each degradation model. These energies are composed of different integral terms that are simultaneously minimized by means of efficient numerical schemes, producing a clean, visually-pleasant and useful output image, with better contrast and increased visibility. In every considered application, we provide comprehensive qualitative (visual) and quantitative experimental results to validate our methods, confirming that the developed techniques outperform other existing approaches in the literature

Image processing and synthesis: From hand-crafted to data-driven modeling

This work investigates image and video restoration problems using effective optimization algorithms. First, we study the problem of single image dehazing to suppress artifacts in compressed or noisy images and videos. Our method is based on the linear haze model and minimizes the gradient residual between the input and output images. This successfully suppresses any new artifacts that are not obvious in the input images. Second, we propose a new method for image inpainting using deep neural networks. Given a set of training data, deep generate models can generate high-quality natural images following the same distribution. We search the nearest neighbor in the latent space of the deep generate models using a weighted context loss and prior loss. This code is then converted to the clean and uncorrupted image of the input. Third, we study the problem of recovering high-quality images from very noisy raw data captured in low-light conditions with short exposures. We build deep neural networks to learn the camera processing pipeline specifically for low-light raw data with an extremely low signal-to-noise ratio (SNR). To train the networks, we capture a new dataset of more than five thousand images with short-exposed and long-exposed pairs. Promising results are obtained compared with the traditional image processing pipeline. Finally, we propose a new method for extreme-low light video processing. The raw video frames are pre-processed using spatial-temporal denoising. A neural network is trained to move the error in the pre-processed data, learning to perform the image processing pipeline and encourage temporal smoothness of the output. Both quantitative and qualitative results demonstrate the proposed method significantly outperform the existing methods. It also paves the way for future research on this area

A Non-Reference Evaluation of Underwater Image Enhancement Methods Using a New Underwater Image Dataset

The rise of vision-based environmental, marine, and oceanic exploration research highlights the need for supporting underwater image enhancement techniques to help mitigate water effects on images such as blurriness, low color contrast, and poor quality. This paper presents an evaluation of common underwater image enhancement techniques using a new underwater image dataset. The collected dataset is comprised of 100 images of aquatic plants taken at a shallow depth of up to three meters from three different locations in the Great Lake Superior, USA, via a Remotely Operated Vehicle (ROV) equipped with a high-definition RGB camera. In particular, we use our dataset to benchmark nine state-of-the-art image enhancement models at three different depths using a set of common non-reference image quality evaluation metrics. Then we provide a comparative analysis of the performance of the selected models at different depths and highlight the most prevalent ones. The obtained results show that the selected image enhancement models are capable of producing considerably better-quality images with some models performing better than others at certain depths