水中イメージングシステムのための画質改善に関する研究

Underwater survey systems have numerous scientific or industrial applications in the fields of geology, biology, mining, and archeology. These application fields involve various tasks such as ecological studies, environmental damage assessment, and ancient prospection. During two decades, underwater imaging systems are mainly equipped by Underwater Vehicles (UV) for surveying in water or ocean. Challenges associated with obtaining visibility of objects have been difficult to overcome due to the physical properties of the medium. In the last two decades, sonar is usually used for the detection and recognition of targets in the ocean or underwater environment. However, because of the low quality of images by sonar imaging, optical vision sensors are then used instead of it for short range identification. Optical imaging provides short-range, high-resolution visual information of the ocean floor. However, due to the light transmission’s physical properties in the water medium, the optical imaged underwater images are usually performance as poor visibility. Light is highly attenuated when it travels in the ocean. Consequence, the imaged scenes result as poorly contrasted and hazy-like obstructions. The underwater imaging processing techniques are important to improve the quality of underwater images. As mentioned before, underwater images have poor visibility because of the medium scattering and light distortion. In contrast to common photographs, underwater optical images suffer from poor visibility owing to the medium, which causes scattering, color distortion, and absorption. Large suspended particles cause scattering similar to the scattering of light in fog or turbid water that contain many suspended particles. Color distortion occurs because different wavelengths are attenuated to different degrees in water; consequently, images of ambient in the underwater environments are dominated by a bluish tone, because higher wavelengths are attenuated more quickly. Absorption of light in water substantially reduces its intensity. The random attenuation of light causes a hazy appearance as the light backscattered by water along the line of sight considerably degrades image contrast. Especially, objects at a distance of more than 10 meters from the observation point are almost unreadable because colors are faded as characteristic wavelengths, which are filtered according to the distance traveled by light in water. So, traditional image processing methods are not suitable for processing them well. This thesis proposes strategies and solutions to tackle the above mentioned problems of underwater survey systems. In this thesis, we contribute image pre-processing, denoising, dehazing, inhomogeneities correction, color correction and fusion technologies for underwater image quality improvement. The main content of this thesis is as follows. First, comprehensive reviews of the current and most prominent underwater imaging systems are provided in Chapter 1. A main features and performance based classification criterion for the existing systems is presented. After that, by analyzing the challenges of the underwater imaging systems, a hardware based approach and non-hardware based approach is introduced. In this thesis, we are concerned about the image processing based technologies, which are one of the non-hardware approaches, and take most recent methods to process the low quality underwater images. As the different sonar imaging systems applied in much equipment, such as side-scan sonar, multi-beam sonar. The different sonar acquires different images with different characteristics. Side-scan sonar acquires high quality imagery of the seafloor with very high spatial resolution but poor locational accuracy. On the contrast, multi-beam sonar obtains high precision position and underwater depth in seafloor points. In order to fully utilize all information of these two types of sonars, it is necessary to fuse the two kinds of sonar data in Chapter 2. Considering the sonar image forming principle, for the low frequency curvelet coefficients, we use the maximum local energy method to calculate the energy of two sonar images. For the high frequency curvelet coefficients, we take absolute maximum method as a measurement. The main attributes are: firstly, the multi-resolution analysis method is well adapted the cured-singularities and point-singularities. It is useful for sonar intensity image enhancement. Secondly, maximum local energy is well performing the intensity sonar images, which can achieve perfect fusion result [42]. In Chapter 3, as analyzed the underwater laser imaging system, a Bayesian Contourlet Estimator of Bessel K Form (BCE-BKF) based denoising algorithm is proposed. We take the BCE-BKF probability density function (PDF) to model neighborhood of contourlet coefficients. After that, according to the proposed PDF model, we design a maximum a posteriori (MAP) estimator, which relies on a Bayesian statistics representation of the contourlet coefficients of noisy images. The denoised laser images have better contrast than the others. There are three obvious virtues of the proposed method. Firstly, contourlet transform decomposition prior to curvelet transform and wavelet transform by using ellipse sampling grid. Secondly, BCE-BKF model is more effective in presentation of the noisy image contourlet coefficients. Thirdly, the BCE-BKF model takes full account of the correlation between coefficients [107]. In Chapter 4, we describe a novel method to enhance underwater images by dehazing. In underwater optical imaging, absorption, scattering, and color distortion are three major issues in underwater optical imaging. Light rays traveling through water are scattered and absorbed according to their wavelength. Scattering is caused by large suspended particles that degrade optical images captured underwater. Color distortion occurs because different wavelengths are attenuated to different degrees in water; consequently, images of ambient underwater environments are dominated by a bluish tone. Our key contribution is to propose a fast image and video dehazing algorithm, to compensate the attenuation discrepancy along the propagation path, and to take the influence of the possible presence of an artificial lighting source into consideration [108]. In Chapter 5, we describe a novel method of enhancing underwater optical images or videos using guided multilayer filter and wavelength compensation. In certain circumstances, we need to immediately monitor the underwater environment by disaster recovery support robots or other underwater survey systems. However, due to the inherent optical properties and underwater complex environment, the captured images or videos are distorted seriously. Our key contributions proposed include a novel depth and wavelength based underwater imaging model to compensate for the attenuation discrepancy along the propagation path and a fast guided multilayer filtering enhancing algorithm. The enhanced images are characterized by a reduced noised level, better exposure of the dark regions, and improved global contrast where the finest details and edges are enhanced significantly [109]. The performance of the proposed approaches and the benefits are concluded in Chapter 6. Comprehensive experiments and extensive comparison with the existing related techniques demonstrate the accuracy and effect of our proposed methods.九州工業大学博士学位論文 学位記番号:工博甲第367号　学位授与年月日:平成26年3月25日CHAPTER 1 INTRODUCTION|CHAPTER 2 MULTI-SOURCE IMAGES FUSION|CHAPTER 3 LASER IMAGES DENOISING|CHAPTER 4 OPTICAL IMAGE DEHAZING|CHAPTER 5 SHALLOW WATER DE-SCATTERING|CHAPTER 6 CONCLUSIONS九州工業大学平成25年

Contrast Enhancement for Images in Turbid Water

Absorption, scattering, and color distortion are three major degradation factors in underwater optical imaging. Light rays are absorbed while passing through water, and absorption rates depend on the wavelength of the light. Scattering is caused by large suspended particles, which are always observed in an underwater environment. Color distortion occurs because the attenuation ratio is inversely proportional to the wavelength of light when light passes through a unit length in water. Consequently, underwater images are dark, low contrast, and dominated by a bluish tone. In this paper, we propose a novel underwater imaging model that compensates for the attenuation discrepancy along the propagation path. In addition, we develop a robust color lines-based ambient light estimator and a locally adaptive filtering algorithm for enhancing underwater images in shallow oceans. Furthermore, we propose a spectral characteristic-based color correction algorithm to recover the distorted color. The enhanced images have a reasonable noise level after the illumination compensation in the dark regions, and demonstrate an improved global contrast by which the finest details and edges are enhanced significantly

Mapping and Deep Analysis of Image Dehazing: Coherent Taxonomy, Datasets, Open Challenges, Motivations, and Recommendations

Our study aims to review and analyze the most relevant studies in the image dehazing field. Many aspects have been deemed necessary to provide a broad understanding of various studies that have been examined through surveying the existing literature. These aspects are as follows: datasets that have been used in the literature, challenges that other researchers have faced, motivations, and recommendations for diminishing the obstacles in the reported literature. A systematic protocol is employed to search all relevant articles on image dehazing, with variations in keywords, in addition to searching for evaluation and benchmark studies. The search process is established on three online databases, namely, IEEE Xplore, Web of Science (WOS), and ScienceDirect (SD), from 2008 to 2021. These indices are selected because they are sufficient in terms of coverage. Along with definition of the inclusion and exclusion criteria, we include 152 articles to the final set. A total of 55 out of 152 articles focused on various studies that conducted image dehazing, and 13 out 152 studies covered most of the review papers based on scenarios and general overviews. Finally, most of the included articles centered on the development of image dehazing algorithms based on real-time scenario (84/152) articles. Image dehazing removes unwanted visual effects and is often considered an image enhancement technique, which requires a fully automated algorithm to work under real-time outdoor applications, a reliable evaluation method, and datasets based on different weather conditions. Many relevant studies have been conducted to meet these critical requirements. We conducted objective image quality assessment experimental comparison of various image dehazing algorithms. In conclusions unlike other review papers, our study distinctly reflects different observations on image dehazing areas. We believe that the result of this study can serve as a useful guideline for practitioners who are looking for a comprehensive view on image dehazing

Optical Imaging and Image Restoration Techniques for Deep Ocean Mapping: A Comprehensive Survey

Visual systems are receiving increasing attention in underwater applications. While the photogrammetric and computer vision literature so far has largely targeted shallow water applications, recently also deep sea mapping research has come into focus. The majority of the seafloor, and of Earth’s surface, is located in the deep ocean below 200 m depth, and is still largely uncharted. Here, on top of general image quality degradation caused by water absorption and scattering, additional artificial illumination of the survey areas is mandatory that otherwise reside in permanent darkness as no sunlight reaches so deep. This creates unintended non-uniform lighting patterns in the images and non-isotropic scattering effects close to the camera. If not compensated properly, such effects dominate seafloor mosaics and can obscure the actual seafloor structures. Moreover, cameras must be protected from the high water pressure, e.g. by housings with thick glass ports, which can lead to refractive distortions in images. Additionally, no satellite navigation is available to support localization. All these issues render deep sea visual mapping a challenging task and most of the developed methods and strategies cannot be directly transferred to the seafloor in several kilometers depth. In this survey we provide a state of the art review of deep ocean mapping, starting from existing systems and challenges, discussing shallow and deep water models and corresponding solutions. Finally, we identify open issues for future lines of research

水中環境における光学画像の画質改善に関する研究

Since the 1960s, autonomous underwater vehicles (AUVs) and unmanned underwater vehicles (UUVs) have been used for deep-sea exploration. Sonar sensors also have been extensively used to detect and recognize objects in oceans. Although sonar sensors are suitable for long-range distance imaging, due to the principles of acoustic imaging, sonar images are low signal to noise ratio, low resolution and no colors. In order to acquire more detail information of underwater object, a short-range imaging system is required. In this situation, a photo vision sensor is used reasonably.However, the low contrast and color distortion of underwater images are still the major issues for practical applications. Therefore, this thesis will concentrate on the underwater optical images quality improvement.Although the underwater optical imaging technology has made a great progress, the recognition of underwater objects is still a challenging subject nowadays. Different from the normal images, underwater images suffer from poor visibility due to the medium scattering and light distortion. First of all, capturing good quality images in underwater circumstance is difficult, mostly due to attenuation caused by light that is reflected from a surface and is deflected and scattered by particles. Secondly, absorption substantially reduces the light energy. The random attenuation of the light mainly causes the haze appearance along with the part of the light scattered back from the water. In particular, an underwater object which 10 meters away from camera lens is almost indistinguishable because of light absorption. Furthermore, when the artificial light is employed, it can cause a distinctive footprint on the seafloor.In order to obtain high quality underwater images that can be adapted to the traditional image identification algorithms, this work aimed to construct an underwater image processing framework. Due to the special characteristic of underwater images,segment the image to several parts before directly perform a subject identification is thought an efficient way. And for obtaining a good underwater image segment result, the work to improve the quality of the image is necessary. Such work contains image enhancement, color correction and noise reduction, etc. The experiments demonstrate that the proposed methods produced visually pleasing results, and the numerical image quality assessment also proved the effectiveness of this proposal. The organization of this thesis is as follows.Chapter 1 briefly reviews the characteristics and types of acoustic imaging and optical imaging technologies in ocean. The traditional underwater imaging models and the issues of recent underwater imaging systems are also introduced.Chapter 2 describes a novel underwater image enhancement method. The transmission is estimated by the proposed dual-channel prior. Then a robust locally adaptive filter algorithm for enhancing underwater images is used. In addition, theartificial light removal method is also proposed. Compared with the traditional methods, the proposed method obtains better images.Chapter 3 presents a color correction method to recover the distorted image colors. In the experiments, the proposed method recovers the distorted colors in real-time. The color corrected images have a reasonable noise level in their dark regions, and the global contrast is also well improved.Chapter 4 describes two methods for image segmentation. The first one is the automatic clustering Weighted Fuzzy C Means (WFCM) based segmentation method. It automatically obtains a reasonable clustering result for the underwater images with simple texture. The second method is fast Active Contour Model (ACM) based image segmentation method, which dramatically improves the calculation speed. Compare with the traditional methods, the processing speed is improved by over 10 times.Chapter 5 presents the conclusions of this work, and points out some future researchdirections.九州工業大学博士学位論文 学位記番号：工博甲第398号 学位授与年月日：平成27年9月25日1 INTRODUCTION|2 IMAGE ENHANCEMENT|3 COLOR CORRECTION|4 IMAGE SEGMENTATION|5 CONCLUSIONS九州工業大学平成27年

Underwater image restoration: super-resolution and deblurring via sparse representation and denoising by means of marine snow removal

Underwater imaging has been widely used as a tool in many fields, however, a major issue is the quality of the resulting images/videos. Due to the light's interaction with water and its constituents, the acquired underwater images/videos often suffer from a significant amount of scatter (blur, haze) and noise. In the light of these issues, this thesis considers problems of low-resolution, blurred and noisy underwater images and proposes several approaches to improve the quality of such images/video frames. Quantitative and qualitative experiments validate the success of proposed algorithms

Automatic Underwater Image Enhancement using Improved Dark Channel Prior

Images taken under water are often of a monochromatic appearance, due to the physical interaction (absorption and reflection) between particles and light sources. Enhanced images with improved saturation, for which the monochromatic character has been corrected, are more suitable for generating 3D models and for identifying structures and materials by human experts. In this paper, we present an automatic method to identify the mean water color from a set of images. This mean color represents an average gray and is used to describe a new axis in CIELab color space. An extended color variance and a histogram equalization are simultaneously applied to the image. The main advantage of this method is the fully automatic enhancement process. An UUV (Unmanned Underwater Vehicle) can operate without providing a color reference scheme. The presented method was implemented in the software JEnhancer, which is freely available. JEnhancer was successfully tested in several documentation campaigns, and was integrated into the videogrammetric software pipeline Archaeo3D to produce 3D models from videos

Advances in Image Processing, Analysis and Recognition Technology

For many decades, researchers have been trying to make computers’ analysis of images as effective as the system of human vision is. For this purpose, many algorithms and systems have previously been created. The whole process covers various stages, including image processing, representation and recognition. The results of this work can be applied to many computer-assisted areas of everyday life. They improve particular activities and provide handy tools, which are sometimes only for entertainment, but quite often, they significantly increase our safety. In fact, the practical implementation of image processing algorithms is particularly wide. Moreover, the rapid growth of computational complexity and computer efficiency has allowed for the development of more sophisticated and effective algorithms and tools. Although significant progress has been made so far, many issues still remain, resulting in the need for the development of novel approaches