A framework for evaluating stereo-based pedestrian detection techniques

Automated pedestrian detection, counting, and tracking have received significant attention in the computer vision community of late. As such, a variety of techniques have been investigated using both traditional 2-D computer vision techniques and, more recently, 3-D stereo information. However, to date, a quantitative assessment of the performance of stereo-based pedestrian detection has been problematic, mainly due to the lack of standard stereo-based test data and an agreed methodology for carrying out the evaluation. This has forced researchers into making subjective comparisons between competing approaches. In this paper, we propose a framework for the quantitative evaluation of a short-baseline stereo-based pedestrian detection system. We provide freely available synthetic and real-world test data and recommend a set of evaluation metrics. This allows researchers to benchmark systems, not only with respect to other stereo-based approaches, but also with more traditional 2-D approaches. In order to illustrate its usefulness, we demonstrate the application of this framework to evaluate our own recently proposed technique for pedestrian detection and tracking

Benchmarking and quality analysis of DEM generated from high and very high resolution optical stereo satellite data

The Working Group 4 of Commission I on ¿Geometric and Radiometric Modelling of Optical Spaceborne Sensors¿ provides on its website several stereo data sets from high and very high resolution spaceborne sensors. Among these are data from the 2.5 meter class like ALOS-PRISM and Cartosat-1 as well as, in near future, data from the highest resolution sensors (0.5 m class) like GeoEye-1 and Worldview-1 and -2. The region selected is an area in Catalonia, Spain, including city areas (Barcelona), rural areas and forests in flat and medium undulated terrain as well as steeper mountains. In addition to these data sets, ground truth data: orthoimages from airborne campaigns and Digital Elevation Models (DEM) produced by laser scanning, all data generated by the Institut Cartogràfic de Catalunya (ICC), are provided as reference for comparison. The goal is to give interested scientists of the ISPRS community the opportunity to test their algorithms on DEM generation, to see how they match with the reference data and to compare their results within the scientific community. A second goal is to develop further methodology for a common DEM quality analysis with qualitative and quantitative measures. Several proposals exist already and the working group is going to publish them on their website. But still there is a need for more standardized methodologies to quantify the quality even in cases where no better reference is available. The data sets, the goal of the benchmarking and first evaluation results are presented within the paper. Algorithms using area-based least squares matching are compared to those using additionally feature-based matching or newly developed algorithms from the Computer Vision community. The main goal though is to motivate further researchers to join the benchmarking and to discuss pros and cons of the methods as well as to trigger the process of establishing standardized DEM quality figures and procedures.JRC.DG.G.2-Global security and crisis managemen

Using Self-Contradiction to Learn Confidence Measures in Stereo Vision

Learned confidence measures gain increasing importance for outlier removal and quality improvement in stereo vision. However, acquiring the necessary training data is typically a tedious and time consuming task that involves manual interaction, active sensing devices and/or synthetic scenes. To overcome this problem, we propose a new, flexible, and scalable way for generating training data that only requires a set of stereo images as input. The key idea of our approach is to use different view points for reasoning about contradictions and consistencies between multiple depth maps generated with the same stereo algorithm. This enables us to generate a huge amount of training data in a fully automated manner. Among other experiments, we demonstrate the potential of our approach by boosting the performance of three learned confidence measures on the KITTI2012 dataset by simply training them on a vast amount of automatically generated training data rather than a limited amount of laser ground truth data.Comment: This paper was accepted to the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016. The copyright was transfered to IEEE (https://www.ieee.org). The official version of the paper will be made available on IEEE Xplore (R) (http://ieeexplore.ieee.org). This version of the paper also contains the supplementary material, which will not appear IEEE Xplore (R