Detecting and Evaluating Cracks on Aging Concrete Members with Deep Convolutional Neural Networks

Cracks in concrete structures are evaluated through a timely and subjective manual inspection. The location of cracks is often recorded in an inspection report where some cracks are measured. Although measurements or locations may not be necessary for all cracks observed in concrete members, if quantitative data can be gathered in an autonomous way, allowing measurement data to be used in tracking changes in spatial and temporal scales, this quantitative data can provide useful information not yet captured in the manual inspection process. This thesis aims to construct an image-based crack detection and evaluation pipeline that can assist health monitoring of aging concrete structures, by providing crack locations and measured crack properties for the entire structural member. Over 16,000 images of aging concrete bridge deck were collected from cameras attached on an unmanned aerial vehicle, machine vision cameras attached on a ground vehicle, and other literature. Mask and Region based Convolutional Neural Network (Mask R-CNN) was utilized to train 256 by 256-pixel patches of collected images using three distinct training strategies to detect and segment concrete cracks on bridge decks. Resulting crack masks were translated into binary data (crack or non-crack pixels) and skeletons of the mask were created where the Euclidean distance from the center of the skeleton to the edge of the mask were measured. This allowed to calculate the relative crack width, length, and orientation of each detected crack. Relative crack properties were transformed into real-world unites using the ground sampling distance of the host image. Image patches were then compiled to construct a crack map of the entire structural member. A case study was conducted on the deck and pier of an aging concrete bridge to test the robustness of the proposed data pipeline. The study yielded that the model was able to successfully detect cracks with an average width of 0.020 inches and were able to make accurate measurements of crack widths that are larger than 0.080 inches. In order to improve the measurements for smaller crack widths, the ground sampling distance needs to be to the scale of the crack width in interest. The image-based data pipeline developed in this study demonstrates potential for the application in autonomous inspections of concrete members. In addition, the data pipeline can be used as a reference framework to provide an example on how computer-vision based data analytics can provide useful information for structural inspections of aging concrete members. Advisor: Chungwook Si

INSPIRE Newsletter Fall 2020

https://scholarsmine.mst.edu/inspire-newsletters/1007/thumbnail.jp

Development of Bridge Information Model (BrIM) for digital twinning and management using TLS technology

In the current modern era of information and technology, the concept of Building Information Model (BIM), has made revolutionary changes in different aspects of engineering design, construction, and management of infrastructure assets, especially bridges. In the field of bridge engineering, Bridge Information Model (BrIM), as a specific form of BIM, includes digital twining of the physical asset associated with geometrical inspections and non-geometrical data, which has eliminated the use of traditional paper-based documentation and hand-written reports, enabling professionals and managers to operate more efficiently and effectively. However, concerns remain about the quality of the acquired inspection data and utilizing BrIM information for remedial decisions in a reliable Bridge Management System (BMS) which are still reliant on the knowledge and experience of the involved inspectors, or asset manager, and are susceptible to a certain degree of subjectivity. Therefore, this research study aims not only to introduce the valuable benefits of Terrestrial Laser Scanning (TLS) as a precise, rapid, and qualitative inspection method, but also to serve a novel sliced-based approach for bridge geometric Computer-Aided Design (CAD) model extraction using TLS-based point cloud, and to contribute to BrIM development. Moreover, this study presents a comprehensive methodology for incorporating generated BrIM in a redeveloped element-based condition assessment model while integrating a Decision Support System (DSS) to propose an innovative BMS. This methodology was further implemented in a designed software plugin and validated by a real case study on the Werrington Bridge, a cable-stayed bridge in New South Wales, Australia. The finding of this research confirms the reliability of the TLS-derived 3D model in terms of quality of acquired data and accuracy of the proposed novel slice-based method, as well as BrIM implementation, and integration of the proposed BMS into the developed BrIM. Furthermore, the results of this study showed that the proposed integrated model addresses the subjective nature of decision-making by conducting a risk assessment and utilising structured decision-making tools for priority ranking of remedial actions. The findings demonstrated acceptable agreement in utilizing the proposed BMS for priority ranking of structural elements that require more attention, as well as efficient optimisation of remedial actions to preserve bridge health and safety

A digital information model framework for uas-enabled bridge inspection

Unmanned aerial systems (UAS) provide two main functions with regards to bridge inspections: (1) high-quality digital imaging to detect element defects; (2) spatial point cloud data for the reconstruction of 3D asset models. With UAS being a relatively new inspection method, there is little in the way of existing framework for storing, processing and managing the resulting inspection data. This study has proposed a novel methodology for a digital information model covering data acquisition through to a 3D GIS visualisation environment, also capable of integrating within a bridge management system (BMS). Previous efforts focusing on visualisation functionality have focused on BIM and GIS as separate entities, which has a number of problems associated with it. This methodology has a core focus on the integration of BIM and GIS, providing an effective and efficient information model, which provides vital visual context to inspectors and users of the BMS. Three-dimensional GIS visualisation allows the user to navigate through a fully interactive environment, where element level inspection information can be obtained through point-and-click operations on the 3D structural model. Two visualisation environments were created: a web-based GIS application and a desktop solution. Both environments develop a fully interactive, user-friendly model which have fulfilled the aims of coordinating and streamlining the BMS process.publishedVersio

Digitalni prikaz oštećenih armiranobetonskih mostova

Inspekcija je već decenijama standardni postupak u ocenjivanju stanja mosta...Inspection of bridges has been a standard assessment procedure for decades..

Digital representation of as-damaged reinforced concrete bridges

Inspection of bridges has been a standard assessment procedure for decades. Its purpose is to identify and record all defects of the bridge structure. Normally used inspection techniques are rather simple, mainly relying on visual assessment. This dissertation proposes an improvement of concrete bridge inspection in terms of visual data acquisition, damage identification and digital representation of the bridge with identified damages. Instead of depending strictly on the human eye, photogrammetrically obtained 3D point clouds are used to identify and extract concrete damage features. As the most comprehensive substitute for the old-fashioned inspection report, Bridge Information Model (BrIM) is used as an inventory and inspection data repository. An Industry Foundation Classes (IFC) semantic enrichment framework is proposed to inject the extracted and reconstructed damage features into the as-is IFC model. After the general data model for damage description and its IFC representation are established, the method for generating the as-is IFC model of the bridge is proposed. Damage is identified as a deviation of the as-is geometry, represented by the 3D point cloud, from the as-built geometry, represented by BrIM. Geometric and semantic enrichment of the IFC model is achieved by injecting the reconstructed 3D meshes representing damaged regions and corresponding BMS catalogbased damage information. The proposed method uses Constructive Solid Geometry (CSG) Boolean operations to geometrically enrich the IFC geometry elements, which align with corresponding damage regions from the as-is point cloud. Damage information (e.g., type, extent, and severity) is structured so that it complies to the BMS data structure. Finally, the proposed data model, damage identification, feature extraction, and semantic enrichment method are validated in the presented case study

Bridge Inspection: Human Performance, Unmanned Aerial Systems and Automation

Unmanned aerial systems (UASs) have become of considerable private and commercial interest for a variety of jobs and entertainment in the past 10 years. This paper is a literature review of the state of practice for the United States bridge inspection programs and outlines how automated and unmanned bridge inspections can be made suitable for present and future needs. At its best, current technology limits UAS use to an assistive tool for the inspector to perform a bridge inspection faster, safer, and without traffic closure. The major challenges for UASs are satisfying restrictive Federal Aviation Administration regulations, control issues in a GPS-denied environment, pilot expenses and availability, time and cost allocated to tuning, maintenance, post-processing time, and acceptance of the collected data by bridge owners. Using UASs with self-navigation abilities and improving image-processing algorithms to provide results near real-time could revolutionize the bridge inspection industry by providing accurate, multi-use, autonomous three-dimensional models and damage identification

Review of Methodologies to Assess Bridge Safety During and After Floods

This report summarizes a review of technologies used to monitor bridge scour with an emphasis on techniques appropriate for testing during and immediately after design flood conditions. The goal of this study is to identify potential technologies and strategies for Illinois Department of Transportation that may be used to enhance the reliability of bridge safety monitoring during floods from local to state levels. The research team conducted a literature review of technologies that have been explored by state departments of transportation (DOTs) and national agencies as well as state-of-the-art technologies that have not been extensively employed by DOTs. This review included informational interviews with representatives from DOTs and relevant industry organizations. Recommendations include considering (1) acquisition of tethered kneeboard or surf ski-mounted single-beam sonars for rapid deployment by local agencies, (2) acquisition of remote-controlled vessels mounted with single-beam and side-scan sonars for statewide deployment, (3) development of large-scale particle image velocimetry systems using remote-controlled drones for stream velocity and direction measurement during floods, (4) physical modeling to develop Illinois-specific hydrodynamic loading coefficients for Illinois bridges during flood conditions, and (5) development of holistic risk-based bridge assessment tools that incorporate structural, geotechnical, hydraulic, and scour measurements to provide rapid feedback for bridge closure decisions.IDOT-R27-SP50Ope

Condition Assessment of Concrete Bridge Decks Using Ground and Airborne Infrared Thermography

Applications of nondestructive testing (NDT) technologies have shown promise in assessing the condition of existing concrete bridges. Infrared thermography (IRT) has gradually gained wider acceptance as a NDT and evaluation tool in the civil engineering field. The high capability of IRT in detecting subsurface delamination, commercial availability of infrared cameras, lower cost compared with other technologies, speed of data collection, and remote sensing are some of the expected benefits of applying this technique in bridge deck inspection practices. The research conducted in this thesis aims at developing a rational condition assessment system for concrete bridge decks based on IRT technology, and automating its analysis process in order to add this invaluable technique to the bridge inspector’s tool box. Ground penetrating radar (GPR) has also been vastly recognized as a NDT technique capable of evaluating the potential of active corrosion. Therefore, integrating IRT and GPR results in this research provides more precise assessments of bridge deck conditions. In addition, the research aims to establish a unique link between NDT technologies and inspector findings by developing a novel bridge deck condition rating index (BDCI). The proposed procedure captures the integrated results of IRT and GPR techniques, along with visual inspection judgements, thus overcoming the inherent scientific uncertainties of this process. Finally, the research aims to explore the potential application of unmanned aerial vehicle (UAV) infrared thermography for detecting hidden defects in concrete bridge decks. The NDT work in this thesis was conducted on full-scale deteriorated reinforced concrete bridge decks located in Montreal, Quebec and London, Ontario. The proposed models have been validated through various case studies. IRT, either from the ground or by utilizing a UAV with high-resolution thermal infrared imagery, was found to be an appropriate technology for inspecting and precisely detecting subsurface anomalies in concrete bridge decks. The proposed analysis produced thermal mosaic maps from the individual IR images. The k-means clustering classification technique was utilized to segment the mosaics and identify objective thresholds and, hence, to delineate different categories of delamination severity in the entire bridge decks. The proposed integration methodology of NDT technologies and visual inspection results provided more reliable BDCI. The information that was sought to identify the parameters affecting the integration process was gathered from bridge engineers with extensive experience and intuition. The analysis process utilized the fuzzy set theory to account for uncertainties and imprecision in the measurements of bridge deck defects detected by IRT and GPR testing along with bridge inspector observations. The developed system and models should stimulate wider acceptance of IRT as a rapid, systematic and cost-effective evaluation technique for detecting bridge deck delaminations. The proposed combination of IRT and GPR results should expand their correlative use in bridge deck inspection. Integrating the proposed BDCI procedure with existing bridge management systems can provide a detailed and timely picture of bridge health, thus helping transportation agencies in identifying critical deficiencies at various service life stages. Consequently, this can yield sizeable reductions in bridge inspection costs, effective allocation of limited maintenance and repair funds, and promote the safety, mobility, longevity, and reliability of our highway transportation assets

Development of an autonomous system for assessment and prediction of structural integrity

Kako bi se osiguralo racionalnije, plansko održavanje prometne infrastrukture uz smanjenje troškova te u konačnici minimalizirao rizik od katastrofalnih posljedica, nužan je razvoj inovativnih rješenja u području održavanja građevina prometne infrastrukture. Kroz projekt ASAP razvija se sustav za autonomni pregled građevina, koji se zasniva na naprednim mjernim metodama integriranim na robota penjača i bespilotnu letjelicu. Cilj ovog rada je dati osvrt i upozoriti na nedostatke konvencionalnog načina ispitivanja materijala i konstrukcija za potrebu ocjene stanja, koji su bili osnovna motivacija okupljanja multidisciplinarnog tima kroz projekt ASAP. U radu su također prikazane mogućnosti i izazovi razvoja autonomnog sustava za pregled građevina, a sve u svrhu povećanja pouzdanosti i efikasnosti sustavnog pregleda građevina.Development of innovative solutions for the maintenance of transport infrastructure facilities is needed in order to ensure a more rational, planned and lower-cost maintenance of transport infrastructure, and to ultimately minimise the risk of catastrophic consequences. A system for an autonomous inspection of structures, based on advanced measuring methods integrated on a wall-climbing robot and an unmanned aerial vehicle, is currently developed in the scope of the ASAP project. The objective of this paper is to provide an overview and draw attention to disadvantages of conventional methods for testing materials and structures in order to assess their condition. This objective was the main motivation for forming a multidisciplinary team through the ASAP project. Possibilities and challenges in the development of an autonomous structural-assessment system are also presented in the paper, with the purpose of increasing the reliability and efficiency of systemic assessment of structures