29 research outputs found
Deep Learning Approaches in Pavement Distress Identification: A Review
This paper presents a comprehensive review of recent advancements in image
processing and deep learning techniques for pavement distress detection and
classification, a critical aspect in modern pavement management systems. The
conventional manual inspection process conducted by human experts is gradually
being superseded by automated solutions, leveraging machine learning and deep
learning algorithms to enhance efficiency and accuracy. The ability of these
algorithms to discern patterns and make predictions based on extensive datasets
has revolutionized the domain of pavement distress identification. The paper
investigates the integration of unmanned aerial vehicles (UAVs) for data
collection, offering unique advantages such as aerial perspectives and
efficient coverage of large areas. By capturing high-resolution images, UAVs
provide valuable data that can be processed using deep learning algorithms to
detect and classify various pavement distresses effectively. While the primary
focus is on 2D image processing, the paper also acknowledges the challenges
associated with 3D images, such as sensor limitations and computational
requirements. Understanding these challenges is crucial for further
advancements in the field. The findings of this review significantly contribute
to the evolution of pavement distress detection, fostering the development of
efficient pavement management systems. As automated approaches continue to
mature, the implementation of deep learning techniques holds great promise in
ensuring safer and more durable road infrastructure for the benefit of society
Deep Domain Adaptation for Pavement Crack Detection
Deep learning-based pavement cracks detection methods often require
large-scale labels with detailed crack location information to learn accurate
predictions. In practice, however, crack locations are very difficult to be
manually annotated due to various visual patterns of pavement crack. In this
paper, we propose a Deep Domain Adaptation-based Crack Detection Network
(DDACDN), which learns to take advantage of the source domain knowledge to
predict the multi-category crack location information in the target domain,
where only image-level labels are available. Specifically, DDACDN first
extracts crack features from both the source and target domain by a two-branch
weights-shared backbone network. And in an effort to achieve the cross-domain
adaptation, an intermediate domain is constructed by aggregating the
three-scale features from the feature space of each domain to adapt the crack
features from the source domain to the target domain. Finally, the network
involves the knowledge of both domains and is trained to recognize and localize
pavement cracks. To facilitate accurate training and validation for domain
adaptation, we use two challenging pavement crack datasets CQU-BPDD and
RDD2020. Furthermore, we construct a new large-scale Bituminous Pavement
Multi-label Disease Dataset named CQU-BPMDD, which contains 38994
high-resolution pavement disease images to further evaluate the robustness of
our model. Extensive experiments demonstrate that DDACDN outperforms
state-of-the-art pavement crack detection methods in predicting the crack
location on the target domain.Comment: 12 pages, 10 figure
Automatic crack detection on road pavements using encoder-decoder architecture
Automatic crack detection from images is an important task that is adopted to ensure road safety and durability for Portland cement concrete (PCC) and asphalt concrete (AC) pavement. Pavement failure depends on a number of causes including water intrusion, stress from heavy loads, and all the climate effects. Generally, cracks are the first distress that arises on road surfaces and proper monitoring and maintenance to prevent cracks from spreading or forming is important. Conventional algorithms to identify cracks on road pavements are extremely time-consuming and high cost. Many cracks show complicated topological structures, oil stains, poor continuity, and low contrast, which are difficult for defining crack features. Therefore, the automated crack detection algorithm is a key tool to improve the results. Inspired by the development of deep learning in computer vision and object detection, the proposed algorithm considers an encoder-decoder architecture with hierarchical feature learning and dilated convolution, named U-Hierarchical Dilated Network (U-HDN), to perform crack detection in an end-to-end method. Crack characteristics with multiple context information are automatically able to learn and perform end-to-end crack detection. Then, a multi-dilation module embedded in an encoder-decoder architecture is proposed. The crack features of multiple context sizes can be integrated into the multi-dilation module by dilation convolution with different dilatation rates, which can obtain much more cracks information. Finally, the hierarchical feature learning module is designed to obtain a multi-scale features from the high to low-level convolutional layers, which are integrated to predict pixel-wise crack detection. Some experiments on public crack databases using 118 images were performed and the results were compared with those obtained with other methods on the same images. The results show that the proposed U-HDN method achieves high performance because it can extract and fuse different context sizes and different levels of feature maps than other algorithms
Weakly Supervised Patch Label Inference Networks for Efficient Pavement Distress Detection and Recognition in the Wild
Automatic image-based pavement distress detection and recognition are vital
for pavement maintenance and management. However, existing deep learning-based
methods largely omit the specific characteristics of pavement images, such as
high image resolution and low distress area ratio, and are not end-to-end
trainable. In this paper, we present a series of simple yet effective
end-to-end deep learning approaches named Weakly Supervised Patch Label
Inference Networks (WSPLIN) for efficiently addressing these tasks under
various application settings. To fully exploit the resolution and scale
information, WSPLIN first divides the pavement image under different scales
into patches with different collection strategies and then employs a Patch
Label Inference Network (PLIN) to infer the labels of these patches. Notably,
we design a patch label sparsity constraint based on the prior knowledge of
distress distribution, and leverage the Comprehensive Decision Network (CDN) to
guide the training of PLIN in a weakly supervised way. Therefore, the patch
labels produced by PLIN provide interpretable intermediate information, such as
the rough location and the type of distress. We evaluate our method on a
large-scale bituminous pavement distress dataset named CQU-BPDD. Extensive
results demonstrate the superiority of our method over baselines in both
performance and efficiency.Comment: Extension of ICASSP 2021 Paper entitled "Weakly Supervised Patch
Label Inference Network with Image Pyramid for Pavement Diseases Recognition
in the Wild", Submitted to IEEE T-IT
Deep learning for automatic detection and classification of road damage from mobile LiDAR data
Im Kontext automatisierter Datenauswertung sind künstliche neuronale Faltungsnetzwerke und der Einsatz von Deep-Learning-Ansätzen mittlerweile Stand der Technik. Im Bereich der Zustandserfassung und -bewertung von Straßen wurde die Leistungsfähigkeit tiefer neuronaler Netze zur Analyse von Kamerabilddaten bereits demonstriert. Im vorliegenden Beitrag soll diese Methodik nun erstmals auf hochgenaue mobile LiDAR-Daten des Fraunhofer Pavement Profile Scanners in Form von 2.5D-Oberflächenmodellen übertragen werden, um eine automatische Schadensdetektion und -klassifikation auf Basis von radiometrischen und geometrischen Merkmalen zu realisieren. Damit ist eine automatisierte Erfassung von Fahrbahnschäden in Form von präzise verorteten Geoobjekten möglich.In the context of automated data analysis, convolutional neural networks and the use of deep learning approaches have become state of the art. In the field of road condition assessment and evaluation, the performance of deep neural networks for the analysis of camera image data has already been
demonstrated. For the first time, this methodology is to be applied to high-precision mobile LiDAR data of the Fraunhofer Pavement Profile Scanner in the form of 2.5D surface models in order to realize automatic road damage detection and classification on the basis of radiometric and geometric features. Thus, an automated detection of road damage in the form of precisely located geo objects is possible