Railway Detection: From Filtering to Segmentation Networks

International audienceThis paper deals with classification of remote sensing data to extract objects for industrial mapping. While land-cover or urban mapping have been extensively studied, industrial cartography remains a field yet to explore, in spite of tremendous needs. We present and compare here four approaches for railway detection in very high resolution images. They use various kind of filtering approaches, including the trained filters of fully convolutional networks. Moreover, they benefit from different a-priori and post-processing techniques to make them more robust. We evaluate all approaches on a challenging dataset captured on an operating station site with complex objects

Automating condition monitoring of vegetation on railway trackbeds and embankments

Vegetation growing on railway trackbeds and embankments present potential problems. The presence of vegetation threatens the safety of personnel inspecting the railway infrastructure. In addition vegetation growth clogs the ballast and results in inadequate track drainage which in turn could lead to the collapse of the railway embankment.Assessing vegetation within the realm of railway maintenance is mainly carried out manually by making visual inspections along the track. This is done either on-site or by watching videos recorded by maintenance vehicles mainly operated by the national railway administrative body.A need for the automated detection and characterisation of vegetation on railways (a subset of vegetation control/management) has been identified in collaboration with local railway maintenance subcontractors and Trafikverket, the Swedish Transport Administration (STA). The latter is responsible for long-term planning of the transport system for all types of traffic, as well as for the building, operation and maintenance of public roads and railways.The purpose of this research project was to investigate how vegetation can be measured and quantified by human raters and how machine vision can automate the same process.Data were acquired at railway trackbeds and embankments during field measurement experiments. All field data (such as images) in this thesis work was acquired on operational, lightly trafficked railway tracks, mostly trafficked by goods trains. Data were also generated by letting (human) raters conduct visual estimates of plant cover and/or count the number of plants, either on-site or in-house by making visual estimates of the images acquired from the field experiments. Later, the degree of reliability of (human) raters’ visual estimates were investigated and compared against machine vision algorithms. The overall results of the investigations involving human raters showed inconsistency in their estimates, and are therefore unreliable. As a result of the exploration of machine vision, computational methods and algorithms enabling automatic detection and characterisation of vegetation along railways were developed. The results achieved in the current work have shown that the use of image data for detecting vegetation is indeed possible and that such results could form the base for decisions regarding vegetation control. The performance of the machine vision algorithmwhich quantifies the vegetation cover was able to process 98% of the image data. Investigations of classifying plants from images were conducted in in order to recognise the specie. The classification rate accuracy was 95%.Objective measurements such as the ones proposed in thesis offers easy access to the measurements to all the involved parties and makes the subcontracting process easier i.e., both the subcontractors and the national railway administration are given the same reference framework concerning vegetation before signing a contract, which can then be crosschecked post maintenance.A very important issue which comes with an increasing ability to recognise species is the maintenance of biological diversity. Biological diversity along the trackbeds and embankments can be mapped, and maintained, through better and robust monitoring procedures. Continuously monitoring the state of vegetation along railways is highly recommended in order to identify a need for maintenance actions, and in addition to keep track of biodiversity. The computational methods or algorithms developed form the foundation of an automatic inspection system capable of objectively supporting manual inspections, or replacing manual inspections

2022 Vehicle Dynamics seminar

The seminar is held annually. The full title of this year\u27s seminar was "2021 Vehicle Dynamics seminar -- Connected and Electric"

A Systematic Literature Review of Drone Utility in Railway Condition Monitoring

Raj Bridgelall is the program director for the Upper Great Plains Transportation Institute (UGPTI) Center for Surface Mobility Applications & Real-time Simulation environments (SMARTSeSM).Drones have recently become a new tool in railway inspection and monitoring (RIM) worldwide, but there is still a lack of information about the specific benefits and costs. This study conducts a systematic literature review (SLR) of the applications, opportunities, and challenges of using drones for RIM. The SLR technique yielded 47 articles filtered from 7,900 publications from 2014 to 2022. The SLR found that key motivations for using drones in RIM are to reduce costs, improve safety, save time, improve mobility, increase flexibility, and enhance reliability. Nearly all the applications fit into the categories of defect identification, situation assessment, rail network mapping, infrastructure asset monitoring, track condition monitoring, and obstruction detection. The authors assessed the open technical, safety, and regulatory challenges. The authors also contributed a cost analysis framework, identified factors that affect drone performance in RIM, and offered implications for new theories, management, and impacts to society.The authors conducted this work with support from North Dakota State University and the Mountain-Plains Consortium, a University Transportation Center funded by the U.S. Department of Transportation.https://www.ugpti.org/about/staff/viewbio.php?id=7

An internet of things enabled system for real-time monitoring and predictive maintenance of railway infrastructure

The railway industry plays a pivotal role in the socioeconomic landscape of many countries. However, its operation poses considerable challenges in terms of safety, environmental impact, and the intricacies of intertwined technical and social structures. Addressing these challenges necessitates the adoption of innovative approaches and advanced technologies. This doctoral research delves into the potential of the Internet of Things (IoT) as an enabler for railway infrastructure monitoring and predictive maintenance, aiming to enhance reliability, efficiency, and safety within the industry. Rooted in a pragmatic modelist philosophical stance, this thesis employs an exploratory sequential mixed-method approach incorporating qualitative and quantitative methodologies. The research process involves engaging with key stakeholders to gain insights into the challenges faced in railway maintenance and the opportunities presented by IoT implementation. Following this, an IoT system is developed, and a comprehensive value-creation framework is proposed for its effective implementation within the railway sector. The findings of this investigation underscore the transformative potential of IoT integration in railway infrastructure monitoring, yielding significant improvements in maintenance processes, safety, and operational efficiency. Furthermore, this doctoral research provides a foundation for future innovation and adaptation in the railway industry, contributing to its ongoing evolution and resilience in an ever-changing technological landscape

A review of the technological developments for interlocking at level crossing

A Level Crossing remains as one of the highest risk assets within the railway system often depending on the unpredictable behaviour of road and footpath users. For this purpose, interlocking through automated safety systems remains a key area for investigation. Within Europe, 2015–2016, 469 accidents at crossings were recorded of which 288 lead to fatalities and 264 lead to injuries. The European Union’s Agency for Railways has reported that Level Crossing fatalities account for just under 28% of all railway fatalities. This paper identifies suitable obstacle detection technologies and their associated algorithms that can be used to support risk reduction and management of Level Crossings. Furthermore, assessment and decision methods are presented to support their application. Finally state of the art and synergistic opportunity of which a combination of obstacle detection sensors with intelligent decisions layers such as Deep Learning are discussed which can provide robust interlocking decisions for rail applications. The sensor fusion of video camera and RADAR is a promising solution for Level Crossings. By applying additional sensing techniques such as RADAR imaging, further capabilities are added to the system, which can lead to a more robust approach

A review on the prospects of mobile manipulators for smart maintenance of railway track

Inspection and repair interventions play vital roles in the asset management of railways. Autonomous mobile manipulators possess considerable potential to replace humans in many hazardous railway track maintenance tasks with high efficiency. This paper investigates the prospects of the use of mobile manipulators in track maintenance tasks. The current state of railway track inspection and repair technologies is initially reviewed, revealing that very few mobile manipulators are in the railways. Of note, the technologies are analytically scrutinized to ascertain advantages, unique capabilities, and potential use in the deployment of mobile manipulators for inspection and repair tasks across various industries. Most mobile manipulators in maintenance use ground robots, while other applications use aerial, underwater, or space robots. Power transmission lines, the nuclear industry, and space are the most extensive application areas. Clearly, the railways infrastructure managers can benefit from the adaptation of best practices from these diversified designs and their broad deployment, leading to enhanced human safety and optimized asset digitalization. A case study is presented to show the potential use of mobile manipulators in railway track maintenance tasks. Moreover, the benefits of the mobile manipulator are discussed based on previous research. Finally, challenges and requirements are reviewed to provide insights into future research

A literature review of Artificial Intelligence applications in railway systems

Nowadays it is widely accepted that Artificial Intelligence (AI) is significantly influencing a large number of domains, including railways. In this paper, we present a systematic literature review of the current state-of-the-art of AI in railway transport. In particular, we analysed and discussed papers from a holistic railway perspective, covering sub-domains such as maintenance and inspection, planning and management, safety and security, autonomous driving and control, revenue management, transport policy, and passenger mobility. This review makes an initial step towards shaping the role of AI in future railways and provides a summary of the current focuses of AI research connected to rail transport. We reviewed about 139 scientific papers covering the period from 2010 to December 2020. We found that the major research efforts have been put in AI for rail maintenance and inspection, while very limited or no research has been found on AI for rail transport policy and revenue management. The remaining sub-domains received mild to moderate attention. AI applications are promising and tend to act as a game-changer in tackling multiple railway challenges. However, at the moment, AI research in railways is still mostly at its early stages. Future research can be expected towards developing advanced combined AI applications (e.g. with optimization), using AI in decision making, dealing with uncertainty and tackling newly rising cybersecurity challenges