水中環境における光学画像の画質改善に関する研究

Since the 1960s, autonomous underwater vehicles (AUVs) and unmanned underwater vehicles (UUVs) have been used for deep-sea exploration. Sonar sensors also have been extensively used to detect and recognize objects in oceans. Although sonar sensors are suitable for long-range distance imaging, due to the principles of acoustic imaging, sonar images are low signal to noise ratio, low resolution and no colors. In order to acquire more detail information of underwater object, a short-range imaging system is required. In this situation, a photo vision sensor is used reasonably.However, the low contrast and color distortion of underwater images are still the major issues for practical applications. Therefore, this thesis will concentrate on the underwater optical images quality improvement.Although the underwater optical imaging technology has made a great progress, the recognition of underwater objects is still a challenging subject nowadays. Different from the normal images, underwater images suffer from poor visibility due to the medium scattering and light distortion. First of all, capturing good quality images in underwater circumstance is difficult, mostly due to attenuation caused by light that is reflected from a surface and is deflected and scattered by particles. Secondly, absorption substantially reduces the light energy. The random attenuation of the light mainly causes the haze appearance along with the part of the light scattered back from the water. In particular, an underwater object which 10 meters away from camera lens is almost indistinguishable because of light absorption. Furthermore, when the artificial light is employed, it can cause a distinctive footprint on the seafloor.In order to obtain high quality underwater images that can be adapted to the traditional image identification algorithms, this work aimed to construct an underwater image processing framework. Due to the special characteristic of underwater images,segment the image to several parts before directly perform a subject identification is thought an efficient way. And for obtaining a good underwater image segment result, the work to improve the quality of the image is necessary. Such work contains image enhancement, color correction and noise reduction, etc. The experiments demonstrate that the proposed methods produced visually pleasing results, and the numerical image quality assessment also proved the effectiveness of this proposal. The organization of this thesis is as follows.Chapter 1 briefly reviews the characteristics and types of acoustic imaging and optical imaging technologies in ocean. The traditional underwater imaging models and the issues of recent underwater imaging systems are also introduced.Chapter 2 describes a novel underwater image enhancement method. The transmission is estimated by the proposed dual-channel prior. Then a robust locally adaptive filter algorithm for enhancing underwater images is used. In addition, theartificial light removal method is also proposed. Compared with the traditional methods, the proposed method obtains better images.Chapter 3 presents a color correction method to recover the distorted image colors. In the experiments, the proposed method recovers the distorted colors in real-time. The color corrected images have a reasonable noise level in their dark regions, and the global contrast is also well improved.Chapter 4 describes two methods for image segmentation. The first one is the automatic clustering Weighted Fuzzy C Means (WFCM) based segmentation method. It automatically obtains a reasonable clustering result for the underwater images with simple texture. The second method is fast Active Contour Model (ACM) based image segmentation method, which dramatically improves the calculation speed. Compare with the traditional methods, the processing speed is improved by over 10 times.Chapter 5 presents the conclusions of this work, and points out some future researchdirections.九州工業大学博士学位論文 学位記番号：工博甲第398号 学位授与年月日：平成27年9月25日1 INTRODUCTION|2 IMAGE ENHANCEMENT|3 COLOR CORRECTION|4 IMAGE SEGMENTATION|5 CONCLUSIONS九州工業大学平成27年

Deep learning-based change detection in remote sensing images:a review

Images gathered from different satellites are vastly available these days due to the fast development of remote sensing (RS) technology. These images significantly enhance the data sources of change detection (CD). CD is a technique of recognizing the dissimilarities in the images acquired at distinct intervals and are used for numerous applications, such as urban area development, disaster management, land cover object identification, etc. In recent years, deep learning (DL) techniques have been used tremendously in change detection processes, where it has achieved great success because of their practical applications. Some researchers have even claimed that DL approaches outperform traditional approaches and enhance change detection accuracy. Therefore, this review focuses on deep learning techniques, such as supervised, unsupervised, and semi-supervised for different change detection datasets, such as SAR, multispectral, hyperspectral, VHR, and heterogeneous images, and their advantages and disadvantages will be highlighted. In the end, some significant challenges are discussed to understand the context of improvements in change detection datasets and deep learning models. Overall, this review will be beneficial for the future development of CD methods

水中イメージングシステムのための画質改善に関する研究

Underwater survey systems have numerous scientific or industrial applications in the fields of geology, biology, mining, and archeology. These application fields involve various tasks such as ecological studies, environmental damage assessment, and ancient prospection. During two decades, underwater imaging systems are mainly equipped by Underwater Vehicles (UV) for surveying in water or ocean. Challenges associated with obtaining visibility of objects have been difficult to overcome due to the physical properties of the medium. In the last two decades, sonar is usually used for the detection and recognition of targets in the ocean or underwater environment. However, because of the low quality of images by sonar imaging, optical vision sensors are then used instead of it for short range identification. Optical imaging provides short-range, high-resolution visual information of the ocean floor. However, due to the light transmission’s physical properties in the water medium, the optical imaged underwater images are usually performance as poor visibility. Light is highly attenuated when it travels in the ocean. Consequence, the imaged scenes result as poorly contrasted and hazy-like obstructions. The underwater imaging processing techniques are important to improve the quality of underwater images. As mentioned before, underwater images have poor visibility because of the medium scattering and light distortion. In contrast to common photographs, underwater optical images suffer from poor visibility owing to the medium, which causes scattering, color distortion, and absorption. Large suspended particles cause scattering similar to the scattering of light in fog or turbid water that contain many suspended particles. Color distortion occurs because different wavelengths are attenuated to different degrees in water; consequently, images of ambient in the underwater environments are dominated by a bluish tone, because higher wavelengths are attenuated more quickly. Absorption of light in water substantially reduces its intensity. The random attenuation of light causes a hazy appearance as the light backscattered by water along the line of sight considerably degrades image contrast. Especially, objects at a distance of more than 10 meters from the observation point are almost unreadable because colors are faded as characteristic wavelengths, which are filtered according to the distance traveled by light in water. So, traditional image processing methods are not suitable for processing them well. This thesis proposes strategies and solutions to tackle the above mentioned problems of underwater survey systems. In this thesis, we contribute image pre-processing, denoising, dehazing, inhomogeneities correction, color correction and fusion technologies for underwater image quality improvement. The main content of this thesis is as follows. First, comprehensive reviews of the current and most prominent underwater imaging systems are provided in Chapter 1. A main features and performance based classification criterion for the existing systems is presented. After that, by analyzing the challenges of the underwater imaging systems, a hardware based approach and non-hardware based approach is introduced. In this thesis, we are concerned about the image processing based technologies, which are one of the non-hardware approaches, and take most recent methods to process the low quality underwater images. As the different sonar imaging systems applied in much equipment, such as side-scan sonar, multi-beam sonar. The different sonar acquires different images with different characteristics. Side-scan sonar acquires high quality imagery of the seafloor with very high spatial resolution but poor locational accuracy. On the contrast, multi-beam sonar obtains high precision position and underwater depth in seafloor points. In order to fully utilize all information of these two types of sonars, it is necessary to fuse the two kinds of sonar data in Chapter 2. Considering the sonar image forming principle, for the low frequency curvelet coefficients, we use the maximum local energy method to calculate the energy of two sonar images. For the high frequency curvelet coefficients, we take absolute maximum method as a measurement. The main attributes are: firstly, the multi-resolution analysis method is well adapted the cured-singularities and point-singularities. It is useful for sonar intensity image enhancement. Secondly, maximum local energy is well performing the intensity sonar images, which can achieve perfect fusion result [42]. In Chapter 3, as analyzed the underwater laser imaging system, a Bayesian Contourlet Estimator of Bessel K Form (BCE-BKF) based denoising algorithm is proposed. We take the BCE-BKF probability density function (PDF) to model neighborhood of contourlet coefficients. After that, according to the proposed PDF model, we design a maximum a posteriori (MAP) estimator, which relies on a Bayesian statistics representation of the contourlet coefficients of noisy images. The denoised laser images have better contrast than the others. There are three obvious virtues of the proposed method. Firstly, contourlet transform decomposition prior to curvelet transform and wavelet transform by using ellipse sampling grid. Secondly, BCE-BKF model is more effective in presentation of the noisy image contourlet coefficients. Thirdly, the BCE-BKF model takes full account of the correlation between coefficients [107]. In Chapter 4, we describe a novel method to enhance underwater images by dehazing. In underwater optical imaging, absorption, scattering, and color distortion are three major issues in underwater optical imaging. Light rays traveling through water are scattered and absorbed according to their wavelength. Scattering is caused by large suspended particles that degrade optical images captured underwater. Color distortion occurs because different wavelengths are attenuated to different degrees in water; consequently, images of ambient underwater environments are dominated by a bluish tone. Our key contribution is to propose a fast image and video dehazing algorithm, to compensate the attenuation discrepancy along the propagation path, and to take the influence of the possible presence of an artificial lighting source into consideration [108]. In Chapter 5, we describe a novel method of enhancing underwater optical images or videos using guided multilayer filter and wavelength compensation. In certain circumstances, we need to immediately monitor the underwater environment by disaster recovery support robots or other underwater survey systems. However, due to the inherent optical properties and underwater complex environment, the captured images or videos are distorted seriously. Our key contributions proposed include a novel depth and wavelength based underwater imaging model to compensate for the attenuation discrepancy along the propagation path and a fast guided multilayer filtering enhancing algorithm. The enhanced images are characterized by a reduced noised level, better exposure of the dark regions, and improved global contrast where the finest details and edges are enhanced significantly [109]. The performance of the proposed approaches and the benefits are concluded in Chapter 6. Comprehensive experiments and extensive comparison with the existing related techniques demonstrate the accuracy and effect of our proposed methods.九州工業大学博士学位論文 学位記番号:工博甲第367号　学位授与年月日:平成26年3月25日CHAPTER 1 INTRODUCTION|CHAPTER 2 MULTI-SOURCE IMAGES FUSION|CHAPTER 3 LASER IMAGES DENOISING|CHAPTER 4 OPTICAL IMAGE DEHAZING|CHAPTER 5 SHALLOW WATER DE-SCATTERING|CHAPTER 6 CONCLUSIONS九州工業大学平成25年

Advancements and Breakthroughs in Ultrasound Imaging

Ultrasonic imaging is a powerful diagnostic tool available to medical practitioners, engineers and researchers today. Due to the relative safety, and the non-invasive nature, ultrasonic imaging has become one of the most rapidly advancing technologies. These rapid advances are directly related to the parallel advancements in electronics, computing, and transducer technology together with sophisticated signal processing techniques. This book focuses on state of the art developments in ultrasonic imaging applications and underlying technologies presented by leading practitioners and researchers from many parts of the world

Image processing techniques for plant phenotyping using RGB and thermal imagery = Técnicas de procesamiento de imágenes RGB y térmicas como herramienta para fenotipado de cultivos

[eng] World cereal stocks need to increase in order to meet growing demands. Currently, maize, rice, wheat, are the main crops worldwide, while other cereals such as barley, sorghum, oat or different millets are also well placed in the top list. Crop productivity is affected directly by climate change factors such as heat, drought, floods or storms. Researchers agree that global climate change is having a major impact on crop productivity. In that way, several studies have been focused on climate change scenarios and more specifically abiotic stresses in cereals. For instance, in the case of heat stress, high temperatures between anthesis to grain filling can decrease grain yield. In order to deal with the climate change and future environmental scenarios, plant breeding is one of the main alternatives breeding is even considered to contribute to the larger component of yield growth compared to management. Plant breeding programs are focused on identifying genotypes with high yields and quality to act as a parentals and further the best individuals among the segregating population thus develop new varieties of plants. Breeders use the phenotypic data, plant and crop performance, and genetic information to improve the yield by selection (GxE, with G and E indicating genetic and environmental factors). More factors must be taken into account to increase the yield, such as, for instance, the education of farmers, economic incentives and the use of new technologies (GxExM, with M indicating management). Plant phenotyping is related with the observable (or measurable) characteristics of the plant while the crop growing as well as the association between the plant genetic background and its response to the environment (GxE). In traditional phenotyping the measurements are collated manually, which is tedious, time consuming and prone to subjective errors. Nowadays the technology is involved in many applications. From the point of view of plan phenotyping, technology has been incorporated as a tool. The use of image processing techniques integrating sensors and algorithm processes, is therefore, an alternative to asses automatically (or semi-automatically) these traits. Images have become a useful tool for plant phenotyping because most frequently data from the sensors are processed and analyzed as an image in two (2D) or three (3D) dimensions. An image is the arrangement of pixels in a regular Cartesian coordinates as a matrix, each pixel has a numerical value into the matrix which represents the number of photons captured by the sensor within the exposition time. Therefore, an image is the optical representation of the object illuminated by a radiating source. The main characteristics of images can be defined by the sensor spectral and spatial properties, with the spatial properties of the resulting image also heavily dependent on the sensor platform (which determines the distance from the target object).[spa] Las existencias mundiales de cereales deben aumentar para satisfacer la creciente demanda. Actualmente, el maíz, el arroz y el trigo son los principales cultivos a nivel mundial, otros cereales como la cebada, el sorgo y la avena están también bien ubicados en la lista. La productividad de los cultivos se ve afectada directamente por factores del cambio climático como el calor, la sequía, las inundaciones o las tormentas. Los investigadores coinciden en que el cambio climático global está teniendo un gran impacto en la productividad de los cultivos. Es por esto que muchos estudios se han centrado en escenarios de cambio climático y más específicamente en estrés abiótico. Por ejemplo, en el caso de estrés por calor, las altas temperaturas entre antesis y llenado de grano pueden disminuir el rendimiento del grano. Para hacer frente al cambio climático y escenarios ambientales futuros, el mejoramiento de plantas es una de las principales alternativas; incluso se considera que las técnicas de mejoramiento contribuyen en mayor medida al aumento del rendimiento que el manejo del cultivo. Los programas de mejora se centran en identificar genotipos con altos rendimientos y calidad para actuar como progenitores y promover los mejores individuos para desarrollar nuevas variedades de plantas. Los mejoradores utilizan los datos fenotípicos, el desempeño de las plantas y los cultivos, y la información genética para mejorar el rendimiento mediante selección (GxE, donde G y E indican factores genéticos y ambientales). El fenotipado plantas está relacionado con las características observables (o medibles) de la planta mientras crece el cultivo, así como con la asociación entre el fondo genético de la planta y su respuesta al medio ambiente (GxE). En el fenotipado tradicional, las mediciones se clasifican manualmente, lo cual es tedioso, consume mucho tiempo y es propenso a errores subjetivos. Sin embargo, hoy en día la tecnología está involucrada en muchas aplicaciones. Desde el punto de vista del fenotipado de plantas, la tecnología se ha incorporado como una herramienta. El uso de técnicas de procesamiento de imágenes que integran sensores y algoritmos son por lo tanto una alternativa para evaluar automáticamente (o semiautomáticamente) estas características

Deep Learning Meets Hyperspectral Image Analysis: A Multidisciplinary Review

Modern hyperspectral imaging systems produce huge datasets potentially conveying a great abundance of information; such a resource, however, poses many challenges in the analysis and interpretation of these data. Deep learning approaches certainly offer a great variety of opportunities for solving classical imaging tasks and also for approaching new stimulating problems in the spatial–spectral domain. This is fundamental in the driving sector of Remote Sensing where hyperspectral technology was born and has mostly developed, but it is perhaps even more true in the multitude of current and evolving application sectors that involve these imaging technologies. The present review develops on two fronts: on the one hand, it is aimed at domain professionals who want to have an updated overview on how hyperspectral acquisition techniques can combine with deep learning architectures to solve specific tasks in different application fields. On the other hand, we want to target the machine learning and computer vision experts by giving them a picture of how deep learning technologies are applied to hyperspectral data from a multidisciplinary perspective. The presence of these two viewpoints and the inclusion of application fields other than Remote Sensing are the original contributions of this review, which also highlights some potentialities and critical issues related to the observed development trends