Real-time Model-based Image Color Correction for Underwater Robots

Recently, a new underwater imaging formation model presented that the coefficients related to the direct and backscatter transmission signals are dependent on the type of water, camera specifications, water depth, and imaging range. This paper proposes an underwater color correction method that integrates this new model on an underwater robot, using information from a pressure depth sensor for water depth and a visual odometry system for estimating scene distance. Experiments were performed with and without a color chart over coral reefs and a shipwreck in the Caribbean. We demonstrate the performance of our proposed method by comparing it with other statistic-, physic-, and learning-based color correction methods. Applications for our proposed method include improved 3D reconstruction and more robust underwater robot navigation.Comment: Accepted at the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS

A Novel Framework for Highlight Reflectance Transformation Imaging

We propose a novel pipeline and related software tools for processing the multi-light image collections (MLICs) acquired in different application contexts to obtain shape and appearance information of captured surfaces, as well as to derive compact relightable representations of them. Our pipeline extends the popular Highlight Reflectance Transformation Imaging (H-RTI) framework, which is widely used in the Cultural Heritage domain. We support, in particular, perspective camera modeling, per-pixel interpolated light direction estimation, as well as light normalization correcting vignetting and uneven non-directional illumination. Furthermore, we propose two novel easy-to-use software tools to simplify all processing steps. The tools, in addition to support easy processing and encoding of pixel data, implement a variety of visualizations, as well as multiple reflectance-model-fitting options. Experimental tests on synthetic and real-world MLICs demonstrate the usefulness of the novel algorithmic framework and the potential benefits of the proposed tools for end-user applications.Terms: "European Union (EU)" & "Horizon 2020" / Action: H2020-EU.3.6.3. - Reflective societies - cultural heritage and European identity / Acronym: Scan4Reco / Grant number: 665091DSURF project (PRIN 2015) funded by the Italian Ministry of University and ResearchSardinian Regional Authorities under projects VIGEC and Vis&VideoLa

The value of remote sensing techniques in supporting effective extrapolation across multiple marine spatial scales

The reporting of ecological phenomena and environmental status routinely required point observations, collected with traditional sampling approaches to be extrapolated to larger reporting scales. This process encompasses difficulties that can quickly entrain significant errors. Remote sensing techniques offer insights and exceptional spatial coverage for observing the marine environment. This review provides guidance on (i) the structures and discontinuities inherent within the extrapolative process, (ii) how to extrapolate effectively across multiple spatial scales, and (iii) remote sensing techniques and data sets that can facilitate this process. This evaluation illustrates that remote sensing techniques are a critical component in extrapolation and likely to underpin the production of high-quality assessments of ecological phenomena and the regional reporting of environmental status. Ultimately, is it hoped that this guidance will aid the production of robust and consistent extrapolations that also make full use of the techniques and data sets that expedite this process

Beyond NeRF Underwater: Learning Neural Reflectance Fields for True Color Correction of Marine Imagery

Underwater imagery often exhibits distorted coloration as a result of light-water interactions, which complicates the study of benthic environments in marine biology and geography. In this research, we propose an algorithm to restore the true color (albedo) in underwater imagery by jointly learning the effects of the medium and neural scene representations. Our approach models water effects as a combination of light attenuation with distance and backscattered light. The proposed neural scene representation is based on a neural reflectance field model, which learns albedos, normals, and volume densities of the underwater environment. We introduce a logistic regression model to separate water from the scene and apply distinct light physics during training. Our method avoids the need to estimate complex backscatter effects in water by employing several approximations, enhancing sampling efficiency and numerical stability during training. The proposed technique integrates underwater light effects into a volume rendering framework with end-to-end differentiability. Experimental results on both synthetic and real-world data demonstrate that our method effectively restores true color from underwater imagery, outperforming existing approaches in terms of color consistency.Comment: Robotics and Automation Letters (RA-L) VOL. 8, NO. 10, OCTOBER 202

Estimation of CDOM in Inland Waters via Water Bio-Optical Properties Using a Remote Sensing Approach

Monitoring of Colored dissolved organic matter (CDOM) in inland waters provides important information for tracing carbon cycle at the land-water interface and studying aquatic ecosystem. Remote sensing estimation of CDOM in the inland waters offers an alternative approach to field samplings in examining CDOM spatial-temporal dynamics. However, CDOM retrieval is a challenge due to the lack of algorithm for resolving bottom effect in shallow inland waters. Moreover, an effective approach based on multi-spectral, high spatial resolution and global coverage satellite images is in urgent need. To resolve these challenges, shallow water bio-optical properties (SBOP) algorithm was developed to overcome bottom reflectance effect on the total water leaving reflectance in shallow inland water. SBOP algorithm included the bottom reflectance in building underwater light transfer model. It was designed based on the field spectral data from four cruises in Lake Huron. SBOP algorithm had an obviously advantage over previous deep water CDOM algorithm (e.g. QAA-CDOM). In this study, Landsat-8 multi-spectral satellite imagery was selected to derive CDOM spatial-temporal dynamics in lake and river waters. The coastal blue band (443 nm), global coverage and high spatial resolution (30 m) of Landsat-8 images offered suitable data for inland water CDOM mapping. The SBOP algorithm was applied on Landsat-8 images in broad ranges of inland waters with high accuracy (Lake Huron (R2 = 0.87), 14 northeastern freshwater lakes (R2 = 0.80), and 6 large Arctic Rivers (R2 = 0.87)). Both the spatial patterns and seasonal dynamics were derived to study the multiple factors’ impact on terrestrially derived CDOM input to the rivers and lakes, including river discharge, watershed landcover, and temperature. This new satellite approach of CDOM estimation in inland waters provided high accuracy spatial-temporal information for studying land-water carbon cycle and aquatic environment

Modeling Atmosphere-Ocean Radiative Transfer: A PACE Mission Perspective

The research frontiers of radiative transfer (RT) in coupled atmosphere-ocean systems are explored to enable new science and specifically to support the upcoming Plankton, Aerosol, Cloud ocean Ecosystem (PACE) satellite mission. Given (i) the multitude of atmospheric and oceanic constituents at any given moment that each exhibits a large variety of physical and chemical properties and (ii) the diversity of light-matter interactions (scattering, absorption, and emission), tackling all outstanding RT aspects related to interpreting and/or simulating light reflected by atmosphere-ocean systems becomes impossible. Instead, we focus on both theoretical and experimental studies of RT topics important to the science threshold and goal questions of the PACE mission and the measurement capabilities of its instruments. We differentiate between (a) forward (FWD) RT studies that focus mainly on sensitivity to influencing variables and/or simulating data sets, and (b) inverse (INV) RT studies that also involve the retrieval of atmosphere and ocean parameters. Our topics cover (1) the ocean (i.e., water body): absorption and elastic/inelastic scattering by pure water (FWD RT) and models for scattering and absorption by particulates (FWD RT and INV RT); (2) the air-water interface: variations in ocean surface refractive index (INV RT) and in whitecap reflectance (INV RT); (3) the atmosphere: polarimetric and/or hyperspectral remote sensing of aerosols (INV RT) and of gases (FWD RT); and (4) atmosphere-ocean systems: benchmark comparisons, impact of the Earth's sphericity and adjacency effects on space-borne observations, and scattering in the ultraviolet regime (FWD RT). We provide for each topic a summary of past relevant (heritage) work, followed by a discussion (for unresolved questions) and RT updates