Failure Detection for Semantic Segmentation on Road Scenes Using Deep Learning

Detecting failure cases is an essential element for ensuring the safety self-driving system. Any fault in the system directly leads to an accident. In this paper, we analyze the failure of semantic segmentation, which is crucial for autonomous driving system, and detect the failure cases of the predicted segmentation map by predicting mean intersection of union (mIoU). Furthermore, we design a deep neural network for predicting mIoU of segmentation map without the ground truth and introduce a new loss function for training imbalance data. The proposed method not only predicts the mIoU, but also detects failure cases using the predicted mIoU value. The experimental results on Cityscapes data show our network gives prediction accuracy of 93.21% and failure detection accuracy of 84.8%. It also performs well on a challenging dataset generated from the vertical vehicle camera of the Hyundai Motor Group with 90.51% mIoU prediction accuracy and 83.33% failure detection accuracy

Neural Network-Based Joint Velocity Estimation Method for Improving Robot Control Performance

Joint velocity estimation is one of the essential properties that implement for accurate robot motion control. Although conventional approaches such as numerical differentiation of position measurements and model-based observers exhibit feasible performance for velocity estimation, instability can be occurred because of phase lag or model inaccuracy. This study proposes a model-free approach that can estimate the velocity with less phase lag by batch training of a neural network with pre-collected encoder measurements. By learning a weighted moving average, the proposed method successfully estimates the velocity with less latency imposed by the noise attenuation compared to the conventional methods. Practical experiments with two robot platforms with high degrees of freedom are conducted to validate the effectiveness of the proposed method