Automatic Pavement Crack Recognition Based on BP Neural Network

A feasible pavement crack detection system plays an important role in evaluating the road condition and providing the necessary road maintenance. In this paper, a back propagation neural network (BPNN) is used to recognize pavement cracks from images. To improve the recognition accuracy of the BPNN, a complete framework of image processing is proposed including image preprocessing and crack information extraction. In this framework, the redundant image information is reduced as much as possible and two sets of feature parameters are constructed to classify the crack images. Then a BPNN is adopted to distinguish pavement images between linear and alligator cracks to acquire high recognition accuracy. Besides, the linear cracks can be further classified into transversal and longitudinal cracks according to the direction angle. Finally, the proposed method is evaluated on the data of 400 pavement images obtained by the Automatic Road Analyzer (ARAN) in Northern China and the results show that the proposed method seems to be a powerful tool for pavement crack recognition. The rates of correct classification for alligator, transversal and longitudinal cracks are 97.5%, 100% and 88.0%, respectively. Compared to some previous studies, the method proposed in this paper is effective for all three kinds of cracks and the results are also acceptable for engineering application

Integration of Field and Laboratory Spectral Data with Multi-Resolution Remote Sensed Imagery for Asphalt Surface Differentiation

The ability to classify asphalt surfaces is an important goal for the selection of suitable non-variant targets as pseudo-invariant targets during the calibration/validation of remotely-sensed images. In addition, the possibility to recognize different types of asphalt surfaces on the images can help optimize road network management. This paper presents a multi-resolution study to improve asphalt surface differentiation using field spectroradiometric data, laboratory analysis and remote sensing imagery. Multispectral Infrared and Visible Imaging Spectrometer (MIVIS) airborne data and multispectral images, such as Quickbird and Ikonos, were used. From scatter plots obtained by field data using λ = 460 and 740 nm, referring to MIVIS Bands 2 and 16 and Quickbird and Ikonos Bands 1 and 4, pixels corresponding to asphalt covering were identified, and the slope of their interpolation lines, assumed as asphalt lines, was calculated. These slopes, used as threshold values in the Spectral Angle Mapper (SAM) classifier, obtained an overall accuracy of 95% for Ikonos, 98% for Quickbird and 93% for MIVIS. Laboratory investigations confirm the existence of the asphalt line also for new asphalts, too

Pavement Surface Distress Detection, Assessment, and Modeling Using Geospatial Techniques

Roadway pavement surface distress information is essential for effective pavement asset management, and subsequently, transportation agencies at all levels dedicate a large amount of time and money to routinely collect data on pavement surface distress conditions as the core of their asset management programs. These data are used by these agencies to make maintenance and repair decisions. Current methods for pavement surface distress evaluation are time-consuming and expensive. Geospatial technologies provide new methods for evaluating pavement surface distress condition that can supplement or substitute for currently-adopted evaluation methods. However, few previous studies have explored the utility of geospatial technologies for pavement surface distress evaluation. The primary scope of this research is to evaluate the potential of three geospatial techniques to improve the efficiency of pavement surface distress evaluation, including empirical analysis of high-spatial resolution natural color digital aerial photography (HiSR-DAP), empirical analysis of hyper-spatial resolution natural color digital aerial photography (HySR-DAP), and inferential geospatial modeling based on traffic volume, environmental conditions, and topographic factors. Pavement surface distress rates estimated from the aforementioned geospatial technologies are validated against distress data manually collected using standard protocols. Research results reveal that straightforward analysis of the spectral response extracted from HiSR-DAP can permit assessment of overall pavement surface conditions. In addition, HySR-DAP acquired from S-UAS can provide accurate and reliable information to characterize detailed pavement surface distress conditions. Research results also show that overall pavement surface distress condition can be effectively estimated based on the extent of geospatial data and inferential modeling techniques. In the near term, these proposed methods could be used to rapidly and cost-effectively evaluate pavement surface distress condition for roadway sections where field inspectors or survey vehicles cannot gain access. In the long term, these proposed methods are capable of being automated to routinely evaluate pavement surface distress condition and, ultimately, to provide a cost-effective, rapid, and safer alternative to currently-adopted evaluation methods with substantially reduced sampling density

Intelligent Computational Transportation

Transportation is commonplace around our world. Numerous researchers dedicate great efforts to vast transportation research topics. The purpose of this dissertation is to investigate and address a couple of transportation problems with respect to geographic discretization, pavement surface automatic examination, and traffic ow simulation, using advanced computational technologies. Many applications require a discretized 2D geographic map such that local information can be accessed efficiently. For example, map matching, which aligns a sequence of observed positions to a real-world road network, needs to find all the nearby road segments to the individual positions. To this end, the map is discretized by cells and each cell retains a list of road segments coincident with this cell. An efficient method is proposed to form such lists for the cells without costly overlapping tests. Furthermore, the method can be easily extended to 3D scenarios for fast triangle mesh voxelization. Pavement surface distress conditions are critical inputs for quantifying roadway infrastructure serviceability. Existing computer-aided automatic examination techniques are mainly based on 2D image analysis or 3D georeferenced data set. The disadvantage of information losses or extremely high costs impedes their effectiveness iv and applicability. In this study, a cost-effective Kinect-based approach is proposed for 3D pavement surface reconstruction and cracking recognition. Various cracking measurements such as alligator cracking, traverse cracking, longitudinal cracking, etc., are identified and recognized for their severity examinations based on associated geometrical features. Smart transportation is one of the core components in modern urbanization processes. Under this context, the Connected Autonomous Vehicle (CAV) system presents a promising solution towards the enhanced traffic safety and mobility through state-of-the-art wireless communications and autonomous driving techniques. Due to the different nature between the CAVs and the conventional Human- Driven-Vehicles (HDVs), it is believed that CAV-enabled transportation systems will revolutionize the existing understanding of network-wide traffic operations and re-establish traffic ow theory. This study presents a new continuum dynamics model for the future CAV-enabled traffic system, realized by encapsulating mutually-coupled vehicle interactions using virtual internal and external forces. A Smoothed Particle Hydrodynamics (SPH)-based numerical simulation and an interactive traffic visualization framework are also developed

Automated Extraction of Road Information from Mobile Laser Scanning Data

Effective planning and management of transportation infrastructure requires adequate geospatial data. Existing geospatial data acquisition techniques based on conventional route surveys are very time consuming, labor intensive, and costly. Mobile laser scanning (MLS) technology enables a rapid collection of enormous volumes of highly dense, irregularly distributed, accurate geo-referenced point cloud data in the format of three-dimensional (3D) point clouds. Today, more and more commercial MLS systems are available for transportation applications. However, many transportation engineers have neither interest in the 3D point cloud data nor know how to transform such data into their computer-aided model (CAD) formatted geometric road information. Therefore, automated methods and software tools for rapid and accurate extraction of 2D/3D road information from the MLS data are urgently needed. This doctoral dissertation deals with the development and implementation aspects of a novel strategy for the automated extraction of road information from the MLS data. The main features of this strategy include: (1) the extraction of road surfaces from large volumes of MLS point clouds, (2) the generation of 2D geo-referenced feature (GRF) images from the road-surface data, (3) the exploration of point density and intensity of MLS data for road-marking extraction, and (4) the extension of tensor voting (TV) for curvilinear pavement crack extraction. In accordance with this strategy, a RoadModeler prototype with three computerized algorithms was developed. They are: (1) road-surface extraction, (2) road-marking extraction, and (3) pavement-crack extraction. Four main contributions of this development can be summarized as follows. Firstly, a curb-based approach to road surface extraction with assistance of the vehicle’s trajectory is proposed and implemented. The vehicle’s trajectory and the function of curbs that separate road surfaces from sidewalks are used to efficiently separate road-surface points from large volume of MLS data. The accuracy of extracted road surfaces is validated with manually selected reference points. Secondly, the extracted road enables accurate detection of road markings and cracks for transportation-related applications in road traffic safety. To further improve computational efficiency, the extracted 3D road data are converted into 2D image data, termed as a GRF image. The GRF image of the extracted road enables an automated road-marking extraction algorithm and an automated crack detection algorithm, respectively. Thirdly, the automated road-marking extraction algorithm applies a point-density-dependent, multi-thresholding segmentation to the GRF image to overcome unevenly distributed intensity caused by the scanning range, the incidence angle, and the surface characteristics of an illuminated object. The morphological operation is then implemented to deal with the presence of noise and incompleteness of the extracted road markings. Fourthly, the automated crack extraction algorithm applies an iterative tensor voting (ITV) algorithm to the GRF image for crack enhancement. The tensor voting, a perceptual organization method that is capable of extracting curvilinear structures from the noisy and corrupted background, is explored and extended into the field of crack detection. The successful development of three algorithms suggests that the RoadModeler strategy offers a solution to the automated extraction of road information from the MLS data. Recommendations are given for future research and development to be conducted to ensure that this progress goes beyond the prototype stage and towards everyday use

Analytical study of computer vision-based pavement crack quantification using machine learning techniques

Image-based techniques are a promising non-destructive approach for road pavement condition evaluation. The main objective of this study is to extract, quantify and evaluate important surface defects, such as cracks, using an automated computer vision-based system to provide a better understanding of the pavement deterioration process. To achieve this objective, an automated crack-recognition software was developed, employing a series of image processing algorithms of crack extraction, crack grouping, and crack detection. Bottom-hat morphological technique was used to remove the random background of pavement images and extract cracks, selectively based on their shapes, sizes, and intensities using a relatively small number of user-defined parameters. A technical challenge with crack extraction algorithms, including the Bottom-hat transform, is that extracted crack pixels are usually fragmented along crack paths. For de-fragmenting those crack pixels, a novel crack-grouping algorithm is proposed as an image segmentation method, so called MorphLink-C. Statistical validation of this method using flexible pavement images indicated that MorphLink-C not only improves crack-detection accuracy but also reduces crack detection time. Crack characterization was performed by analysing imagerial features of the extracted crack image components. A comprehensive statistical analysis was conducted using filter feature subset selection (FSS) methods, including Fischer score, Gini index, information gain, ReliefF, mRmR, and FCBF to understand the statistical characteristics of cracks in different deterioration stages. Statistical significance of crack features was ranked based on their relevancy and redundancy. The statistical method used in this study can be employed to avoid subjective crack rating based on human visual inspection. Moreover, the statistical information can be used as fundamental data to justify rehabilitation policies in pavement maintenance. Finally, the application of four classification algorithms, including Artificial Neural Network (ANN), Decision Tree (DT), k-Nearest Neighbours (kNN) and Adaptive Neuro-Fuzzy Inference System (ANFIS) is investigated for the crack detection framework. The classifiers were evaluated in the following five criteria: 1) prediction performance, 2) computation time, 3) stability of results for highly imbalanced datasets in which, the number of crack objects are significantly smaller than the number of non-crack objects, 4) stability of the classifiers performance for pavements in different deterioration stages, and 5) interpretability of results and clarity of the procedure. Comparison results indicate the advantages of white-box classification methods for computer vision based pavement evaluation. Although black-box methods, such as ANN provide superior classification performance, white-box methods, such as ANFIS, provide useful information about the logic of classification and the effect of feature values on detection results. Such information can provide further insight for the image-based pavement crack detection application

Asphalt Pavement Evaluation to Support the Calibration of the AASHTO MEPDG for South Carolina Conditions

The South Carolina Department of Transportation recognizes the need for a local calibration of the Mechanistic-Empirical Pavement Design Guide to provide a more accurate and efficient pavement design process for the state. A large part of this calibration revolves around determining actual pavement performance throughout South Carolina. Surface evaluations involving performance indicators such as bottom-up fatigue cracking, top-down fatigue cracking, transverse cracking, and surface rut depths were completed at four locations across the state. Asphalt cores were retrieved from each location as well. Retrieving asphalt cores allowed further detail such as pavement structure and cracking origin to be determined. Collecting and compiling the results in a format for direct comparison to the MEPDG software output was an important endeavor within this research as well. After evaluating the four locations, general findings support that thicker pavement structures result in lower distress values. However, a direct linear relationship between thickness and amount of surface distresses cannot be determined at this time. This research also determined that differing pavement structures may be located within a relatively small length of roadway. Numerous samples that have experienced uniform loading with varying asphalt thicknesses will result in corresponding differing surface distress values. The data collected from these locations stand as a significant start for MEPDG output comparison in the local calibration process, but an abundance of data from many more evaluations will be required to accurately represent the pavement performance within South Carolina

Vehicle classification in intelligent transport systems: an overview, methods and software perspective

Vehicle Classification (VC) is a key element of Intelligent Transportation Systems (ITS). Diverse ranges of ITS applications like security systems, surveillance frameworks, fleet monitoring, traffic safety, and automated parking are using VC. Basically, in the current VC methods, vehicles are classified locally as a vehicle passes through a monitoring area, by fixed sensors or using a compound method. This paper presents a pervasive study on the state of the art of VC methods. We introduce a detailed VC taxonomy and explore the different kinds of traffic information that can be extracted via each method. Subsequently, traditional and cutting edge VC systems are investigated from different aspects. Specifically, strengths and shortcomings of the existing VC methods are discussed and real-time alternatives like Vehicular Ad-hoc Networks (VANETs) are investigated to convey physical as well as kinematic characteristics of the vehicles. Finally, we review a broad range of soft computing solutions involved in VC in the context of machine learning, neural networks, miscellaneous features, models and other methods