Visual recognition of bridges by using stereo cameras on trains

Recognition of either patterns or objects in mobile systems continues to be in the focus of intensive research, with many applications being enhanced by integrating environment related information. This paper presents a practical technique for detecting and recognizing bridges from a train using a stereo camera which provides depth and grayscale images. The algorithm has been applied to a train system, where object detection combined with a given map of an area is used to improve localization. The approach is based on the detection of primitive features including edges and corners in the depth image. The pairwise spatial relations between the features are then modeled by a graph, so the classification and detection can be performed by a probabilistic Markov Random Field framework. The algorithm has been tested on the real-life datasets of the Rail Collision Avoidance System (RCAS) project. The presented results prove the applicability of the framework for detection of objects by exploiting geometrical appearance constraints

A Unified Framework for Mutual Improvement of SLAM and Semantic Segmentation

This paper presents a novel framework for simultaneously implementing localization and segmentation, which are two of the most important vision-based tasks for robotics. While the goals and techniques used for them were considered to be different previously, we show that by making use of the intermediate results of the two modules, their performance can be enhanced at the same time. Our framework is able to handle both the instantaneous motion and long-term changes of instances in localization with the help of the segmentation result, which also benefits from the refined 3D pose information. We conduct experiments on various datasets, and prove that our framework works effectively on improving the precision and robustness of the two tasks and outperforms existing localization and segmentation algorithms.Comment: 7 pages, 5 figures.This work has been accepted by ICRA 2019. The demo video can be found at https://youtu.be/Bkt53dAehj

Ultrasound localization microscopy to image and assess microvasculature in a rat kidney.

The recent development of ultrasound localization microscopy, where individual microbubbles (contrast agents) are detected and tracked within the vasculature, provides new opportunities for imaging the vasculature of entire organs with a spatial resolution below the diffraction limit. In stationary tissue, recent studies have demonstrated a theoretical resolution on the order of microns. In this work, single microbubbles were localized in vivo in a rat kidney using a dedicated high frame rate imaging sequence. Organ motion was tracked by assuming rigid motion (translation and rotation) and appropriate correction was applied. In contrast to previous work, coherence-based non-linear phase inversion processing was used to reject tissue echoes while maintaining echoes from very slowly moving microbubbles. Blood velocity in the small vessels was estimated by tracking microbubbles, demonstrating the potential of this technique to improve vascular characterization. Previous optical studies of microbubbles in vessels of approximately 20 microns have shown that expansion is constrained, suggesting that microbubble echoes would be difficult to detect in such regions. We therefore utilized the echoes from individual MBs as microscopic sensors of slow flow associated with such vessels and demonstrate that highly correlated, wideband echoes are detected from individual microbubbles in vessels with flow rates below 2 mm/s

Pop-up SLAM: Semantic Monocular Plane SLAM for Low-texture Environments

Existing simultaneous localization and mapping (SLAM) algorithms are not robust in challenging low-texture environments because there are only few salient features. The resulting sparse or semi-dense map also conveys little information for motion planning. Though some work utilize plane or scene layout for dense map regularization, they require decent state estimation from other sources. In this paper, we propose real-time monocular plane SLAM to demonstrate that scene understanding could improve both state estimation and dense mapping especially in low-texture environments. The plane measurements come from a pop-up 3D plane model applied to each single image. We also combine planes with point based SLAM to improve robustness. On a public TUM dataset, our algorithm generates a dense semantic 3D model with pixel depth error of 6.2 cm while existing SLAM algorithms fail. On a 60 m long dataset with loops, our method creates a much better 3D model with state estimation error of 0.67%.Comment: International Conference on Intelligent Robots and Systems (IROS) 201