A Survey on Audio-Video based Defect Detection through Deep Learning in Railway Maintenance

Within Artificial Intelligence, Deep Learning (DL) represents a paradigm that has been showing unprecedented performance in image and audio processing by supporting or even replacing humans in defect and anomaly detection. The Railway sector is expected to benefit from DL applications, especially in predictive maintenance applications, where smart audio and video sensors can be leveraged yet kept distinct from safety-critical functions. Such separation is crucial, as it allows for improving system dependability with no impact on its safety certification. This is further supported by the development of DL in other transportation domains, such as automotive and avionics, opening for knowledge transfer opportunities and highlighting the potential of such a paradigm in railways. In order to summarize the recent state-of-the-art while inquiring about future opportunities, this paper reviews DL approaches for the analysis of data generated by acoustic and visual sensors in railway maintenance applications that have been published until August 31st, 2021. In this paper, the current state of the research is investigated and evaluated using a structured and systematic method, in order to highlight promising approaches and successful applications, as well as to identify available datasets, current limitations, open issues, challenges, and recommendations about future research directions

A Novel Approach to Railway Track Faults Detection Using Acoustic Analysis.

Regular inspection of railway track health is crucial for maintaining safe and reliable train operations. Factors, such as cracks, ballast issues, rail discontinuity, loose nuts and bolts, burnt wheels, superelevation, and misalignment developed on the rails due to non-maintenance, pre-emptive investigations and delayed detection, pose a grave danger and threats to the safe operation of rail transport. The traditional procedure of manually inspecting the rail track using a railway cart is both inefficient and prone to human error and biases. In a country like Pakistan where train accidents have taken many lives, it is not unusual to automate such approaches to avoid such accidents and save countless lives. This study aims at enhancing the traditional railway cart system to address these issues by introducing an automatic railway track fault detection system using acoustic analysis. In this regard, this study makes two important contributions: data collection on Pakistan railway tracks using acoustic signals and the application of various classification techniques to the collected data. Initially, three types of tracks are considered, including normal track, wheel burnt and superelevation, due to their common occurrence. Several well-known machine learning algorithms are applied such as support vector machines, logistic regression, random forest and decision tree classifier, in addition to deep learning models like multilayer perceptron and convolutional neural networks. Results suggest that acoustic data can help determine the track faults successfully. Results indicate that the best results are obtained by RF and DT with an accuracy of 97%

30th International Conference on Condition Monitoring and Diagnostic Engineering Management (COMADEM 2017)

Proceedings of COMADEM 201

D5.1 SHM digital twin requirements for residential, industrial buildings and bridges

This deliverable presents a report of the needs for structural control on buildings (initial imperfections, deflections at service, stability, rheology) and on bridges (vibrations, modal shapes, deflections, stresses) based on state-of-the-art image-based and sensor-based techniques. To this end, the deliverable identifies and describes strategies that encompass state-of-the-art instrumentation and control for infrastructures (SHM technologies).Objectius de Desenvolupament Sostenible::8 - Treball Decent i Creixement EconòmicObjectius de Desenvolupament Sostenible::9 - Indústria, Innovació i InfraestructuraPreprin

Vibration-based Fault Diagnostics in Wind Turbine Gearboxes Using Machine Learning

A significantly increased production of wind energy offers a path to achieve the goals of green energy policies in the United States and other countries. However, failures in wind turbines and specifically their gearboxes are higher due to their operation in unpredictable wind conditions that result in downtime and losses. Early detection of faults in wind turbines will greatly increase their reliability and commercial feasibility. Recently, data-driven fault diagnosis techniques based on deep learning have gained significant attention due to their powerful feature learning capabilities. Nonetheless, diagnosing faults in wind turbines operating under varying conditions poses a major challenge. Signal components unrelated to faults and high levels of noise obscure the signature generated by early-stage damage. To address this issue, we propose an innovative fault diagnosis framework that utilizes deep learning and leverages cyclostationary analysis of sensor data. By generating cyclic spectral coherence maps from the sensor data, we can emphasize fault-related signatures. These 2D color map representations are then used to train convolutional neural networks capable of detecting even minor faults and early-stage damages. The proposed method is evaluated using test data obtained from multibody dynamic simulations conducted under various operating conditions. The benchmark test cases, inspired by an NREL study, are successfully detected using our approach. To further enhance the accuracy of the model, subsequent studies employ Convolutional Neural Networks with Local Interpretable Model-Agnostic Explanations (LIME). This approach aids in interpreting classifier predictions and developing an interpretable classifier by focusing on a subset range of cyclic spectral coherence maps that carry the unique fault signatures. This improvement contributes to better accuracy, especially in scenarios involving multiple faults in the gearbox that need to be identified. Moreover, to address the challenge of applying this framework in practical settings, where standard deep learning techniques tend to provide inaccurate predictions for unseen faults or unusual operating conditions, we investigate fault diagnostics using a Bayesian convolutional neural network. This approach incorporates uncertainty bounds into prediction results, reducing overconfident misclassifications. The results demonstrate the effectiveness of the Bayesian approach in fault diagnosis, offering valuable implications for condition monitoring in other rotating machinery applications