Deep Learning Framework For Intelligent Pavement Condition Rating: A direct classification approach for regional and local roads

Transport authorities rely on pavement characteristics to determine a pavement condition rating index. However, manually computing ratings can be a tedious, subjective, time-consuming, and training-intensive process. This paper presents a deep-learning framework for automatically rating the condition of rural road pavements using digital images captured from a dashboard-mounted camera. The framework includes pavement segmentation, data cleaning, image cropping and resizing, and pavement condition rating classification. A dataset of images, captured from diverse roads in Ireland and rated by two expert raters using the pavement surface condition index (PSCI) scale, was created. Deep-learning models were developed to perform pavement segmentation and condition rating classification. The automated PSCI rating achieved an average Cohen Kappa score and F1-score of 0.9 and 0.85, respectively, across 1–10 rating classes on an independent test set. The incorporation of unique image augmentation during training enabled the models to exhibit increased robustness against variations in background and clutter

Pixel level pavement crack detection using deep convolutional neural network with residual blocks

Road condition monitoring, such as surface defects and pavement cracks detection, is an important task in road management. Automated road surface defect detection is also a challenging problem in computer vision and machine learning research due to the large variety of pavement crack structures, variable lighting conditions, interfering objects on the road surface such as trashes, fallen tree leaves and branches. In this work, we develop a deep learning-based method for automated road surface defect and pavement crack detection. We design a deep convolutional neural network based on using residual blocks to predict the heatmaps which indicate the location and intensity of defects and cracks. To reduce false detection rates, we couple this heatmap prediction network with a binary classification network which is able to determine if the input image patch is normal or has defects. We test our method on the CFD benchmark dataset. Experiment results show that the proposed network is very effective for pavement crack detection and has more advanced performance than other methods.by Yu HouIncludes bibliographical reference

Machine Learning Approaches to Road Surface Anomaly Assessment Using Smartphone Sensors

Road surface quality is an essential component of roadway infrastructure that leads to better driving standards and reduces risk of traffic accident. Traditional road condition monitoring systems fall short of current need for quick responses to maintain road quality. Several alternative systems have been proposed that utilize sensors mounted on vehicles and with the ubiquitous use of smartphone for personal use and navigation, smartphone based road condition assessment has gained prominence. We propose to analyze different multiclass supervised machine learning techniques to effectively classify road surface conditions using accelerometer, gyroscope and GPS data collected from smartphones. Our work focusses on classification of three main class labels- smooth road, pothole and deep transverse cracks. We investigate our conjecture that using features from all three axes of the sensors provide more accurate results as compared to using features from only one axis. We also investigate the performance of deep neural networks to classify road conditions with and without explicit manual feature extraction. Our results consistently show that models trained with features from all axes of the smartphone sensors perform better than models that use only one axis. This shows that there is information in the vibration signals along all three axis for road anomalies. We also observe that the use of neural networks provide significantly accurate data classification. The approaches discussed here can be implemented on a larger scale to monitor road for defects that present a safety risk to commuters as well as provide maintenance information to relevant authorities

Analytical Study of Deep Learning Methods for Road Condition Assessment

Automated pavement distress recognition is a key step in smart infrastructure assessment. Advances in deep learning and computer vision have improved the automated recognition of pavement distresses in road surface images. This task, however, remains challenging due to the high variations in road objects and pavement types, variety of lighting condition, low contrast, and background noises in pavement images. In this dissertation, we propose novel deep learning algorithms for image-based road condition assessment to tackle current challenges in detection, classification and segmentation of pavement images. Motivated by the need for classifying a wide range of objects in road monitoring, this dissertation introduces a Multi-Scale Convolution Neural Network (MCNN) for multi-class classification of pavement images. MCNN improves the classification performance by encoding contextual information through multi-scale input tiles. Then, an Attention-Based Multi-Scale CNN (A+MCNN) is proposed to further improve the classification results through a novel mid-fusion strategy for combining multi-scale features extracted from multi-scale input tiles. An attention module is designed as an adaptive fusion strategy to generate importance scores and integrate multi-scale features based on how informative they are to the classification task. Finally, Dual Attention CNN (DACNN) is introduced to improve the performance of multi-class classification using both intensity and range images collected with 3D laser imaging devices. DACNN integrates information in intensity and range images to enhance distinct features improving the objects classification in noisy images under various illumination conditions. The standard road condition assessment includes determining not only the type of defects but also the severity of detects. In this regard, a pavement crack segmentation algorithm, CrackSegmenter, is proposed to detect crack at pixel level. The CrackSegmenter leverages residual blocks, attention blocks, Atrous Spatial Pyramid Pooling (ASSP), and squeeze and excitation blocks to improve segmentation performance in pavement crack images

An Exploration of Recent Intelligent Image Analysis Techniques for Visual Pavement Surface Condition Assessment.

Road pavement condition assessment is essential for maintenance, asset management, and budgeting for pavement infrastructure. Countries allocate a substantial annual budget to maintain and improve local, regional, and national highways. Pavement condition is assessed by measuring several pavement characteristics such as roughness, surface skid resistance, pavement strength, deflection, and visual surface distresses. Visual inspection identifies and quantifies surface distresses, and the condition is assessed using standard rating scales. This paper critically analyzes the research trends in the academic literature, professional practices and current commercial solutions for surface condition ratings by civil authorities. We observe that various surface condition rating systems exist, and each uses its own defined subset of pavement characteristics to evaluate pavement conditions. It is noted that automated visual sensing systems using intelligent algorithms can help reduce the cost and time required for assessing the condition of pavement infrastructure, especially for local and regional road networks. However, environmental factors, pavement types, and image collection devices are significant in this domain and lead to challenging variations. Commercial solutions for automatic pavement assessment with certain limitations exist. The topic is also a focus of academic research. More recently, academic research has pivoted toward deep learning, given that image data is now available in some form. However, research to automate pavement distress assessment often focuses on the regional pavement condition assessment standard that a country or state follows. We observe that the criteria a region adopts to make the evaluation depends on factors such as pavement construction type, type of road network in the area, flow and traffic, environmental conditions, and region\u27s economic situation. We summarized a list of publicly available datasets for distress detection and pavement condition assessment. We listed approaches focusing on crack segmentation and methods concentrating on distress detection and identification using object detection and classification. We segregated the recent academic literature in terms of the camera\u27s view and the dataset used, the year and country in which the work was published, the F1 score, and the architecture type. It is observed that the literature tends to focus more on distress identification ( presence/absence detection) but less on distress quantification, which is essential for developing approaches for automated pavement rating

Road Crack Detection Using Deep Convolutional Neural Network and Adaptive Thresholding

Crack is one of the most common road distresses which may pose road safety hazards. Generally, crack detection is performed by either certified inspectors or structural engineers. This task is, however, time-consuming, subjective and labor-intensive. In this paper, we propose a novel road crack detection algorithm based on deep learning and adaptive image segmentation. Firstly, a deep convolutional neural network is trained to determine whether an image contains cracks or not. The images containing cracks are then smoothed using bilateral filtering, which greatly minimizes the number of noisy pixels. Finally, we utilize an adaptive thresholding method to extract the cracks from road surface. The experimental results illustrate that our network can classify images with an accuracy of 99.92%, and the cracks can be successfully extracted from the images using our proposed thresholding algorithm.Comment: 6 pages, 8 figures, 2019 IEEE Intelligent Vehicles Symposiu