Lane Marking Detection and Reconstruction with Line-Scan Imaging Data

Lane marking detection and localization are crucial for autonomous driving and lane-based pavement surveys. Numerous studies have been done to detect and locate lane markings with the purpose of advanced driver assistance systems, in which image data are usually captured by vision-based cameras. However, a limited number of studies have been done to identify lane markings using high-resolution laser images for road condition evaluation. In this study, the laser images are acquired with a digital highway data vehicle (DHDV). Subsequently, a novel methodology is presented for the automated lane marking identification and reconstruction, and is implemented in four phases: (1) binarization of the laser images with a new threshold method (multi-box segmentation based threshold method); (2) determination of candidate lane markings with closing operations and a marching square algorithm; (3) identification of true lane marking by eliminating false positives (FPs) using a linear support vector machine method; and (4) reconstruction of the damaged and dash lane marking segments to form a continuous lane marking based on the geometry features such as adjacent lane marking location and lane width. Finally, a case study is given to validate effects of the novel methodology. The findings indicate the new strategy is robust in image binarization and lane marking localization. This study would be beneficial in road lane-based pavement condition evaluation such as lane-based rutting measurement and crack classification. Document type: Articl

Automatic segmentation and reconstruction of traffic accident scenarios from mobile laser scanning data

Virtual reconstruction of historic sites, planning of restorations and attachments of new building parts, as well as forest inventory are few examples of fields that benefit from the application of 3D surveying data. Originally using 2D photo based documentation and manual distance measurements, the 3D information obtained from multi camera and laser scanning systems realizes a noticeable improvement regarding the surveying times and the amount of generated 3D information. The 3D data allows a detailed post processing and better visualization of all relevant spatial information. Yet, for the extraction of the required information from the raw scan data and for the generation of useable visual output, time-consuming, complex user-based data processing is still required, using the commercially available 3D software tools. In this context, the automatic object recognition from 3D point cloud and depth data has been discussed in many different works. The developed tools and methods however, usually only focus on a certain kind of object or the detection of learned invariant surface shapes. Although the resulting methods are applicable for certain practices of data segmentation, they are not necessarily suitable for arbitrary tasks due to the varying requirements of the different fields of research. This thesis presents a more widespread solution for automatic scene reconstruction from 3D point clouds, targeting street scenarios, specifically for the task of traffic accident scene analysis and documentation. The data, obtained by sampling the scene using a mobile scanning system is evaluated, segmented, and finally used to generate detailed 3D information of the scanned environment. To realize this aim, this work adapts and validates various existing approaches on laser scan segmentation regarding the application on accident relevant scene information, including road surfaces and markings, vehicles, walls, trees and other salient objects. The approaches are therefore evaluated regarding their suitability and limitations for the given tasks, as well as for possibilities concerning the combined application together with other procedures. The obtained knowledge is used for the development of new algorithms and procedures to allow a satisfying segmentation and reconstruction of the scene, corresponding to the available sampling densities and precisions. Besides the segmentation of the point cloud data, this thesis presents different visualization and reconstruction methods to achieve a wider range of possible applications of the developed system for data export and utilization in different third party software tools

A high speed Tri-Vision system for automotive applications

Purpose: Cameras are excellent ways of non-invasively monitoring the interior and exterior of vehicles. In particular, high speed stereovision and multivision systems are important for transport applications such as driver eye tracking or collision avoidance. This paper addresses the synchronisation problem which arises when multivision camera systems are used to capture the high speed motion common in such applications. Methods: An experimental, high-speed tri-vision camera system intended for real-time driver eye-blink and saccade measurement was designed, developed, implemented and tested using prototype, ultra-high dynamic range, automotive-grade image sensors specifically developed by E2V (formerly Atmel) Grenoble SA as part of the European FP6 project – sensation (advanced sensor development for attention stress, vigilance and sleep/wakefulness monitoring). Results : The developed system can sustain frame rates of 59.8 Hz at the full stereovision resolution of 1280 × 480 but this can reach 750 Hz when a 10 k pixel Region of Interest (ROI) is used, with a maximum global shutter speed of 1/48000 s and a shutter efficiency of 99.7%. The data can be reliably transmitted uncompressed over standard copper Camera-Link® cables over 5 metres. The synchronisation error between the left and right stereo images is less than 100 ps and this has been verified both electrically and optically. Synchronisation is automatically established at boot-up and maintained during resolution changes. A third camera in the set can be configured independently. The dynamic range of the 10bit sensors exceeds 123 dB with a spectral sensitivity extending well into the infra-red range. Conclusion: The system was subjected to a comprehensive testing protocol, which confirms that the salient requirements for the driver monitoring application are adequately met and in some respects, exceeded. The synchronisation technique presented may also benefit several other automotive stereovision applications including near and far-field obstacle detection and collision avoidance, road condition monitoring and others.Partially funded by the EU FP6 through the IST-507231 SENSATION project.peer-reviewe

Lane Detection System based on Hough Transform with Retinex Algorithm

Nowadays, automotive system becomes a great innovation in the world and lane detection system is important to control automobile vehicles. This paper has developed an efficient lane detection system to deal with different types of lighting conditions. Six types of edge detection techniques: canny, sobel, prewitt, Roberts, Laplacian of Gaussian (LOG) and zero-cross methods are analyzed. Line detection based on canny operator is developed. Moreover, Retinex algorithm is employed to normalize input images for all types of illumination. And Hough Transform with Retinex algorithm is developed to solve lighting problem. The proposed method is compared to Hough Transform with Otsu’s threshold method. The experimental results show that the proposed method can reduce computation time and improve accuracy for lane detection system

Focal Spot, Spring 1993

https://digitalcommons.wustl.edu/focal_spot_archives/1063/thumbnail.jp

Truck height determination using digital video

Over-height trucks are not only a hazard to the over-height trucks themselves, but they pose a threat to the bridges they come into contact with, and most importantly the other drivers on the road way when a collision takes place with a low clearance structure. Therefore, there is a need for an over-height detection system that is affordable yet also reliable. At this time there exist over-height detection systems using laser and infrared beam devices however, they are expensive. This high cost makes it impossible for Department of Transportations across the nation to implement these systems at all low-clearance headroom roadways. In this research a machine vision based system is proposed to detect the height of trucks and provide a warning for over-height vehicles. The height determination will be completed using line detection and blob tracking; these two methods will be overlapped where an upper point of the truck can be compared to a lower point on the ground. These 2D coordinates will then be translated into 3D world coordinates that will provide an approximation of the truck height. If the truck is over the set height then a warning will sound. The accuracy of the test proves that the method is a reliable method of height determination, achieving a 96.59% accuracy rate for measured trucks. The method does have an error rate of 3.3%. The merit of this work is the creation of an automatic image based method which can provide height determination of trucks and is a low cost alternative to the current expensive laser and infrared detection systems.MSCommittee Chair: Brilakis, Ioannis ; Committee Member: Hunter, Michael; Committee Member: Laval, Jorg

Motorcycles that see: Multifocal stereo vision sensor for advanced safety systems in tilting vehicles

Advanced driver assistance systems, ADAS, have shown the possibility to anticipate crash accidents and effectively assist road users in critical traffic situations. This is not the case for motorcyclists, in fact ADAS for motorcycles are still barely developed. Our aim was to study a camera-based sensor for the application of preventive safety in tilting vehicles. We identified two road conflict situations for which automotive remote sensors installed in a tilting vehicle are likely to fail in the identification of critical obstacles. Accordingly, we set two experiments conducted in real traffic conditions to test our stereo vision sensor. Our promising results support the application of this type of sensors for advanced motorcycle safety applications

Improving road asset condition monitoring

Road networks often carry more than 80% of a country’s total passenger-km and over 50% of its freight ton-km according to the World Bank. Efficient maintenance of road networks is highly important. Road asset management, which is essential for maintenance programs, consist of monitoring, assessing and decision making necessary for maintenance, repair and/or replacement. This process is highly dependent on adequate and timely pavement condition data. Current practice for collecting and analysing such data is 99% manual. To optimize this process, research has been performed towards automation. Several methods to automatically detect road assets and pavement conditions are proposed. In this paper, we present an analysis of the current state of practice of road asset monitoring, a discussion of the limitations, and a qualitative evaluation of the proposed automation methods found in the literature. The objective of this paper is to understand the issues associated with current processes, and assess the available tools to address these problems. The current state of practice is categorized into: 1) type of data collected; 2) type of asset covered and 3) amount of information provided. The categories are evaluated in terms of a) accuracy; b) applicability (efficiency); c) cost; and d) overall improvement to current practice. Despite the methods available, the outcome of the study indicates that current condition monitoring lacks efficiency, and none provide a holistic solution to the problem of road asset condition monitorin