Deep Learning Approaches in Pavement Distress Identification: A Review

This paper presents a comprehensive review of recent advancements in image processing and deep learning techniques for pavement distress detection and classification, a critical aspect in modern pavement management systems. The conventional manual inspection process conducted by human experts is gradually being superseded by automated solutions, leveraging machine learning and deep learning algorithms to enhance efficiency and accuracy. The ability of these algorithms to discern patterns and make predictions based on extensive datasets has revolutionized the domain of pavement distress identification. The paper investigates the integration of unmanned aerial vehicles (UAVs) for data collection, offering unique advantages such as aerial perspectives and efficient coverage of large areas. By capturing high-resolution images, UAVs provide valuable data that can be processed using deep learning algorithms to detect and classify various pavement distresses effectively. While the primary focus is on 2D image processing, the paper also acknowledges the challenges associated with 3D images, such as sensor limitations and computational requirements. Understanding these challenges is crucial for further advancements in the field. The findings of this review significantly contribute to the evolution of pavement distress detection, fostering the development of efficient pavement management systems. As automated approaches continue to mature, the implementation of deep learning techniques holds great promise in ensuring safer and more durable road infrastructure for the benefit of society

Pixel level pavement crack detection using deep convolutional neural network with residual blocks

Road condition monitoring, such as surface defects and pavement cracks detection, is an important task in road management. Automated road surface defect detection is also a challenging problem in computer vision and machine learning research due to the large variety of pavement crack structures, variable lighting conditions, interfering objects on the road surface such as trashes, fallen tree leaves and branches. In this work, we develop a deep learning-based method for automated road surface defect and pavement crack detection. We design a deep convolutional neural network based on using residual blocks to predict the heatmaps which indicate the location and intensity of defects and cracks. To reduce false detection rates, we couple this heatmap prediction network with a binary classification network which is able to determine if the input image patch is normal or has defects. We test our method on the CFD benchmark dataset. Experiment results show that the proposed network is very effective for pavement crack detection and has more advanced performance than other methods.by Yu HouIncludes bibliographical reference

Adaptive Road Crack Detection System by Pavement Classification

This paper presents a road distress detection system involving the phases needed to properly deal with fully automatic road distress assessment. A vehicle equipped with line scan cameras, laser illumination and acquisition HW-SW is used to storage the digital images that will be further processed to identify road cracks. Pre-processing is firstly carried out to both smooth the texture and enhance the linear features. Non-crack features detection is then applied to mask areas of the images with joints, sealed cracks and white painting, that usually generate false positive cracking. A seed-based approach is proposed to deal with road crack detection, combining Multiple Directional Non-Minimum Suppression (MDNMS) with a symmetry check. Seeds are linked by computing the paths with the lowest cost that meet the symmetry restrictions. The whole detection process involves the use of several parameters. A correct setting becomes essential to get optimal results without manual intervention. A fully automatic approach by means of a linear SVM-based classifier ensemble able to distinguish between up to 10 different types of pavement that appear in the Spanish roads is proposed. The optimal feature vector includes different texture-based features. The parameters are then tuned depending on the output provided by the classifier. Regarding non-crack features detection, results show that the introduction of such module reduces the impact of false positives due to non-crack features up to a factor of 2. In addition, the observed performance of the crack detection system is significantly boosted by adapting the parameters to the type of pavement

Road Deterioration detection A Machine Learning-Based System for Automated Pavement Crack Identification and Analysis

Road surfaces may deteriorate over time because of a number of external factors such as heavy traffic, unfavourable weather, and poor design. These flaws, which may include potholes, fissures, and uneven surfaces, can pose significant safety threats to both vehicles and pedestrians. This research aims to develop and evaluate an automated system for detecting and analyzing cracks in pavements based on machine learning. The research explores the utilisation of object detection techniques to identify and categorize different types of pavement cracks. Additionally, the proposed work investigates several approaches to integrate the outcome system with existing pavement management systems to enhance road maintenance and sustainability. The research focuses on identifying reliable data sources, creating accurate and effective object detection algorithms for pavement crack detection, classifying various types of cracks, and assessing their severity and extent. The research objectives include gathering reliable datasets, developing a precise and effective object detection algorithm, classifying different types of pavement cracks, and determining the severity and extent of the cracks. The study collected pavement crack images from various sources, including publicly available databases and images captured using mobile devices. Multiple object detection models, such as YOLOv5, YOLOv8, and CenterNet were trained and tested using the collected dataset. The proposed approaches were evaluated using different performance metrics, The achieved results indicated that the YOLOv5 model outperformed CenterNet by a significant margin

Feature detection algorithms in computed images

The problem of sensing a medium by several sensors and retrieving interesting features is a very general one. The basic framework of the problem is generally the same for applications from MRI, tomography, Radar SAR imaging to subsurface imaging, even though the data acquisition processes, sensing geometries and sensed properties are different. In this thesis we introduced a new perspective to the problem of remote sensing and information retrieval by studying the problem of subsurface imaging using GPR and seismic sensors. We have shown that if the sensed medium is sparse in some domain then it can be imaged using many fewer measurements than required by the standard methods. This leads to much lower data acquisition times and better images representing the medium. We have used the ideas from Compressive Sensing, which show that a small number of random measurements about a signal is sufficient to completely characterize it, if the signal is sparse or compressible in some domain. Although we have applied our ideas to the subsurface imaging problem, our results are general and can be extended to other remote sensing applications. A second objective in remote sensing is information retrieval which involves searching for important features in the computed image of the medium. In this thesis we focus on detecting buried structures like pipes, and tunnels in computed GPR or seismic images. The problem of finding these structures in high clutter and noise conditions, and finding them faster than the standard shape detecting methods like the Hough transform is analyzed. One of the most important contributions of this thesis is, where the sensing and the information retrieval stages are unified in a single framework using compressive sensing. Instead of taking lots of standard measurements to compute the image of the medium and search the necessary information in the computed image, a much smaller number of measurements as random projections are taken. The data acquisition and information retrieval stages are unified by using a data model dictionary that connects the information to the sensor data.Ph.D.Committee Chair: McClellan, James H.; Committee Member: Romberg, Justin K.; Committee Member: Scott, Waymond R. Jr.; Committee Member: Vela, Patricio A.; Committee Member: Vidakovic, Bran

Evaluación de daños en pavimento flexible usando fotogrametría terrestre y redes neuronales

In Colombia, road deterioration is assessed by means of road inventories and visual inspections. For this assessment, the Instituto Nacional de Vías (Colombia's National Road Institute) (abbreviated INVIAS in Spanish) uses the Vision Inspection de Zones et Itinéraires Á Risque (VIZIR) and Pavement Index Condition (PCI) methods. These two methods serve to determine the severity of damages in flexible and rigid pavements. However, they can be tedious and subjective and require an experienced evaluator, hence the need to develop new methods for road condition assessment. In this paper, we present a methodology to evaluate flexible pavement deterioration using terrestrial photogrammetry techniques and neural networks. The proposed methodology consists of six stages: (i) image capture, (ii) image preprocessing, (iii) segmentation via edge detection techniques, (iv) characteristic extraction, (v) classification using neural networks, and (vi) assessment of deteriorated areas. It is verified using real images of three different pavement distresses: longitudinal cracking, crocodile cracking, and pothole. As classifier, we use a multilayer neural network with a (12 12 3) configuration and trained using the Levenberg–Marquardt algorithm for backpropagation. The results show a classifier’s accuracy of 96 %, a sensitivity of 93.33 %, and a Cohen's Kappa coefficient of 93.67 %. Thus, our proposed methodology could pave the way for the development of an automated system to assess road deterioration, which may, in turn, reduce time and costs when designing road infrastructure maintenance plans.La evaluación del deterioro de las vías en Colombia se realiza por medio de inventarios manuales e inspecciones visuales. Los métodos de evaluación del estado de las vías adoptados por el INVIAS (Instituto Nacional de Vías) son VIZIR (Visión Inspection de Zones et Itinéraires Á Risque) y PCI (Paviment Condition Index). Estos determinan la gravedad de daño en pavimento flexible y rígido; sin embargo, pueden ser tediosos, subjetivos y requieren de la experiencia de un evaluador, lo que evidencia la necesidad de desarrollar metodologías de evaluación del estado de las vías. Este documento presenta una metodología para la evaluación de los deterioros presentes en pavimento flexible usando técnicas de fotogrametría terrestre y redes neuronales que está compuesta por seis etapas: i. Captura de las imágenes, ii. Preprocesamiento de las imágenes, iii. Segmentación mediante técnicas de detección de bordes, iv. Extracción de las características, v. Clasificación utilizando redes neuronales, y vi. Evaluación del área de afectación del deterioro. La metodología se evaluó con imágenes reales de pavimento con tres tipos de deterioro: grieta longitudinal, piel de cocodrilo y bache. Como clasificador se utilizó una red neuronal multicapa con configuración (12 12 3), entrenada utilizando el algoritmo Levenberg Marquardt de retropropagación. Se obtuvo una exactitud del 96 % en el clasificador, una sensibilidad de 93.33 % y una índice kappa de 0.936. Esta metodología es la base para la creación de un sistema automatizado de evaluación del deterioro presente en las vías, el cual puede contribuir en la reducción en tiempo y costo en los planes de gestión de mantenimiento de la infraestructura vial

A parallel windowing approach to the Hough transform for line segment detection

In the wide range of image processing and computer vision problems, line segment detection has always been among the most critical headlines. Detection of primitives such as linear features and straight edges has diverse applications in many image understanding and perception tasks. The research presented in this dissertation is a contribution to the detection of straight-line segments by identifying the location of their endpoints within a two-dimensional digital image. The proposed method is based on a unique domain-crossing approach that takes both image and parameter domain information into consideration. First, the straight-line parameters, i.e. location and orientation, have been identified using an advanced Fourier-based Hough transform. As well as producing more accurate and robust detection of straight-lines, this method has been proven to have better efficiency in terms of computational time in comparison with the standard Hough transform. Second, for each straight-line a window-of-interest is designed in the image domain and the disturbance caused by the other neighbouring segments is removed to capture the Hough transform buttery of the target segment. In this way, for each straight-line a separate buttery is constructed. The boundary of the buttery wings are further smoothed and approximated by a curve fitting approach. Finally, segments endpoints were identified using buttery boundary points and the Hough transform peak. Experimental results on synthetic and real images have shown that the proposed method enjoys a superior performance compared with the existing similar representative works

An index based road feature extraction from LANDSAT-8 OLI images

Road feature extraction from the remote sensing images is an arduous task and has a significant role in various applications of urban planning, updating the maps, traffic management, etc. In this paper, a new band combination (B652) to form a road index (RI) from OLI multispectral bands based on the spectral reflectance of asphalt, is presented for road feature extraction. The B652 is converted to road index by normalization. The morphological operators (top-hat or bottom-hat) uses on RI to enhance the roads. To sharpen the edges and for better discrimination of features, shock square filter (SSF), is proposed. Then, an iterative adaptive threshold (IAT) based online search with variational min-max and Markov random fields (MRF) model are used on the SSF image to segment the roads and non-roads. The roads are extracting by using the rules based on the connected component analysis. IAT and MRF model segmentation methods prove the proposed index (RI) able to extract road features productively. The proposed methodology is a combination of saturation based adaptive thresholding and morphology (SATM), and saturation based MRF (SMRF), applied to OLI images of several urban cities of India, producing the satisfactory results. The experimental results with the quantitative analysis presented in the paper

Detection and Localization of Linear Features Based on Image Processing Methods

In this work, the general problem of the detection of features in images is considered. One of the methods, the orientation detection of lines, utilized the Radon transform (sinogram) of an image to detect lines at different angles in an image. The line thickness algorithm was generated by finding a pattern formed by particular lines in an image. The filtering of reconstructed images dealt with the removal of blur and other artifacts that arose in the course of inverting the Radon transform of an image to attempt to obtain the original image