Iteratively Optimized Patch Label Inference Network for Automatic Pavement Disease Detection

We present a novel deep learning framework named the Iteratively Optimized Patch Label Inference Network (IOPLIN) for automatically detecting various pavement diseases that are not solely limited to specific ones, such as cracks and potholes. IOPLIN can be iteratively trained with only the image label via the Expectation-Maximization Inspired Patch Label Distillation (EMIPLD) strategy, and accomplish this task well by inferring the labels of patches from the pavement images. IOPLIN enjoys many desirable properties over the state-of-the-art single branch CNN models such as GoogLeNet and EfficientNet. It is able to handle images in different resolutions, and sufficiently utilize image information particularly for the high-resolution ones, since IOPLIN extracts the visual features from unrevised image patches instead of the resized entire image. Moreover, it can roughly localize the pavement distress without using any prior localization information in the training phase. In order to better evaluate the effectiveness of our method in practice, we construct a large-scale Bituminous Pavement Disease Detection dataset named CQU-BPDD consisting of 60,059 high-resolution pavement images, which are acquired from different areas at different times. Extensive results on this dataset demonstrate the superiority of IOPLIN over the state-of-the-art image classification approaches in automatic pavement disease detection. The source codes of IOPLIN are released on \url{https://github.com/DearCaat/ioplin}.Comment: Revision on IEEE Trans on IT

An Exploration of Recent Intelligent Image Analysis Techniques for Visual Pavement Surface Condition Assessment.

Road pavement condition assessment is essential for maintenance, asset management, and budgeting for pavement infrastructure. Countries allocate a substantial annual budget to maintain and improve local, regional, and national highways. Pavement condition is assessed by measuring several pavement characteristics such as roughness, surface skid resistance, pavement strength, deflection, and visual surface distresses. Visual inspection identifies and quantifies surface distresses, and the condition is assessed using standard rating scales. This paper critically analyzes the research trends in the academic literature, professional practices and current commercial solutions for surface condition ratings by civil authorities. We observe that various surface condition rating systems exist, and each uses its own defined subset of pavement characteristics to evaluate pavement conditions. It is noted that automated visual sensing systems using intelligent algorithms can help reduce the cost and time required for assessing the condition of pavement infrastructure, especially for local and regional road networks. However, environmental factors, pavement types, and image collection devices are significant in this domain and lead to challenging variations. Commercial solutions for automatic pavement assessment with certain limitations exist. The topic is also a focus of academic research. More recently, academic research has pivoted toward deep learning, given that image data is now available in some form. However, research to automate pavement distress assessment often focuses on the regional pavement condition assessment standard that a country or state follows. We observe that the criteria a region adopts to make the evaluation depends on factors such as pavement construction type, type of road network in the area, flow and traffic, environmental conditions, and region\u27s economic situation. We summarized a list of publicly available datasets for distress detection and pavement condition assessment. We listed approaches focusing on crack segmentation and methods concentrating on distress detection and identification using object detection and classification. We segregated the recent academic literature in terms of the camera\u27s view and the dataset used, the year and country in which the work was published, the F1 score, and the architecture type. It is observed that the literature tends to focus more on distress identification ( presence/absence detection) but less on distress quantification, which is essential for developing approaches for automated pavement rating

Utilising Convolutional Neural Networks for Pavement Distress Classification and Detection

This paper examines deep learning models for accurate and efficient identification and classification of pavement distresses. In it, a variety of related studies conducted on the topic as well as the various identification and classification methods proposed, such as edge detection, machine learning classification informed by statistical feature extraction, artificial neural networks, and real-time object detection systems, are discussed. The study investigates the effect of image processing techniques such as grayscaling, background subtraction, and image resizing on the performance and generalizability of the models. Using convolutional neural networks (CNN) architectures, this paper proposes a model that correctly classifies images into five pavement distress categories, namely fatigue (or alligator), longitudinal, transverse, patches, and craters, with an accuracy rate of 90.4% and a recall rate of 90.1%. The model is contrasted to a current state-of-the-art model based on the You Only Look Once framework as well as a baseline CNN model to demonstrate the impact of the image processing and architecture building techniques discussed on performance. The findings of this paper contribute to the fields of computer vision and infrastructure monitoring by demonstrating the efficacy of convolutional neural networks (CNNs) in image classification and the viability of using CNNbased models to automate pavement condition monitoring

Implementing textural features on GPUs for improved real-time pavement distress detection

The condition of municipal roads has deteriorated considerably in recent years, leading to large scale pavement distress such as cracks or potholes. In order to enable road maintenance, pavement distress should be timely detected. However, manual investigation, which is still the most widely applied approach toward pavement assessment, puts maintenance personnel at risk and is time-consuming. During the last decade, several efforts have been made to automatically assess the condition of the municipal roads without any human intervention. Vehicles are equipped with sensors and cameras in order to collect data related to pavement distress and record videos of the pavement surface. Yet, this data are usually not processed while driving, but instead it is recorded and later analyzed off-line. As a result, a vast amount of memory is required to store the data and the available memory may not be sufficient. To reduce the amount of saved data, the authors have previously proposed a graphics processing units (GPU)-enabled pavement distress detection approach based on the wavelet transform of pavement images. The GPU implementation enables pavement distress detection in real time. Although the method used in the approach provides very good results, the method can still be improved by incorporating pavement surface texture characteristics. This paper presents an implementation of textural features on GPUs for pavement distress detection. Textural features are based on gray-tone spatial dependencies in an image and characterize the image texture. To evaluate the computational efficiency of the GPU implementation, performance tests are carried out. The results show that the speedup achieved by implementing the textural features on the GPU is sufficient to enable real-time detection of pavement distress. In addition, classification results obtained by applying the approach on 16,601 pavement images are compared to the results without integrating textural features. There results demonstrate that an improvement of 27% is achieved by incorporating pavement surface texture characteristics

Deep Learning Framework For Intelligent Pavement Condition Rating: A direct classification approach for regional and local roads

Transport authorities rely on pavement characteristics to determine a pavement condition rating index. However, manually computing ratings can be a tedious, subjective, time-consuming, and training-intensive process. This paper presents a deep-learning framework for automatically rating the condition of rural road pavements using digital images captured from a dashboard-mounted camera. The framework includes pavement segmentation, data cleaning, image cropping and resizing, and pavement condition rating classification. A dataset of images, captured from diverse roads in Ireland and rated by two expert raters using the pavement surface condition index (PSCI) scale, was created. Deep-learning models were developed to perform pavement segmentation and condition rating classification. The automated PSCI rating achieved an average Cohen Kappa score and F1-score of 0.9 and 0.85, respectively, across 1–10 rating classes on an independent test set. The incorporation of unique image augmentation during training enabled the models to exhibit increased robustness against variations in background and clutter