41,690 research outputs found
Real-time Model-based Image Color Correction for Underwater Robots
Recently, a new underwater imaging formation model presented that the
coefficients related to the direct and backscatter transmission signals are
dependent on the type of water, camera specifications, water depth, and imaging
range. This paper proposes an underwater color correction method that
integrates this new model on an underwater robot, using information from a
pressure depth sensor for water depth and a visual odometry system for
estimating scene distance. Experiments were performed with and without a color
chart over coral reefs and a shipwreck in the Caribbean. We demonstrate the
performance of our proposed method by comparing it with other statistic-,
physic-, and learning-based color correction methods. Applications for our
proposed method include improved 3D reconstruction and more robust underwater
robot navigation.Comment: Accepted at the 2019 IEEE/RSJ International Conference on Intelligent
Robots and Systems (IROS
Map-Guided Curriculum Domain Adaptation and Uncertainty-Aware Evaluation for Semantic Nighttime Image Segmentation
We address the problem of semantic nighttime image segmentation and improve
the state-of-the-art, by adapting daytime models to nighttime without using
nighttime annotations. Moreover, we design a new evaluation framework to
address the substantial uncertainty of semantics in nighttime images. Our
central contributions are: 1) a curriculum framework to gradually adapt
semantic segmentation models from day to night through progressively darker
times of day, exploiting cross-time-of-day correspondences between daytime
images from a reference map and dark images to guide the label inference in the
dark domains; 2) a novel uncertainty-aware annotation and evaluation framework
and metric for semantic segmentation, including image regions beyond human
recognition capability in the evaluation in a principled fashion; 3) the Dark
Zurich dataset, comprising 2416 unlabeled nighttime and 2920 unlabeled twilight
images with correspondences to their daytime counterparts plus a set of 201
nighttime images with fine pixel-level annotations created with our protocol,
which serves as a first benchmark for our novel evaluation. Experiments show
that our map-guided curriculum adaptation significantly outperforms
state-of-the-art methods on nighttime sets both for standard metrics and our
uncertainty-aware metric. Furthermore, our uncertainty-aware evaluation reveals
that selective invalidation of predictions can improve results on data with
ambiguous content such as our benchmark and profit safety-oriented applications
involving invalid inputs.Comment: IEEE T-PAMI 202
- …