Infrastructure robotics: Research challenges and opportunities

Infrastructure robotics is about research on and development of methodologies that enable robotic systems to be used in civil infrastructure inspection, maintenance and rehabilitation. This paper briefly discusses the current research challenges and opportunities in infrastructure robotics, and presents a review of the research activities and projects in this field at the Centre for Autonomous Systems, University of Technology Sydney

A low cost way for assessing bird risk hazards in power lines: Fixed-wing small Unmanned Aircraft Systems

Accidents on power lines are one of the most important causes of man-induced mortality for raptors and soaring birds. The factors that condition the hazard have been extensively studied, and currently there are a variety of technical solutions available to miti- gate the risk. Most of the resources in conservation projects to reduce avian mortality now are invested in fieldwork to monitor the lines, which diverts the resources available to install actual corrective measures to mitigate bird hazard. Little progress has been achieved in the methodology to characterize line risk, which is an expensive, tedious, and time- consuming task. In this work we describe the use of low cost small unmanned aircraft systems (sUAS) equipped with on-board cameras for power line surveillance. As a case study, we characterized four power lines, geo-referenced every pylon in selected portions, and assessed their hazard for birds. We compare the effectiveness of two variants of the sUAS method for data acquisition and two methods of plane control. This work provides evidence of the usefulness of sUAS as a fast, inexpensive, and practical tool in conservation biology, adding to their already known applications in wildlife monitoring, the environmental impact assessment of infrastructures

Remote Sensing methods for power line corridor surveys

AbstractTo secure uninterrupted distribution of electricity, effective monitoring and maintenance of power lines are needed. This literature review article aims to give a wide overview of the possibilities provided by modern remote sensing sensors in power line corridor surveys and to discuss the potential and limitations of different approaches. Monitoring of both power line components and vegetation around them is included. Remotely sensed data sources discussed in the review include synthetic aperture radar (SAR) images, optical satellite and aerial images, thermal images, airborne laser scanner (ALS) data, land-based mobile mapping data, and unmanned aerial vehicle (UAV) data. The review shows that most previous studies have concentrated on the mapping and analysis of network components. In particular, automated extraction of power line conductors has achieved much attention, and promising results have been reported. For example, accuracy levels above 90% have been presented for the extraction of conductors from ALS data or aerial images. However, in many studies datasets have been small and numerical quality analyses have been omitted. Mapping of vegetation near power lines has been a less common research topic than mapping of the components, but several studies have also been carried out in this field, especially using optical aerial and satellite images. Based on the review we conclude that in future research more attention should be given to an integrated use of various data sources to benefit from the various techniques in an optimal way. Knowledge in related fields, such as vegetation monitoring from ALS, SAR and optical image data should be better exploited to develop useful monitoring approaches. Special attention should be given to rapidly developing remote sensing techniques such as UAVs and laser scanning from airborne and land-based platforms. To demonstrate and verify the capabilities of automated monitoring approaches, large tests in various environments and practical monitoring conditions are needed. These should include careful quality analyses and comparisons between different data sources, methods and individual algorithms

Visual localisation of electricity pylons for power line inspection

Inspection of power infrastructure is a regular maintenance event. To date the inspection process has mostly been done manually, but there is growing interest in automating the process. The automation of the inspection process will require an accurate means for the localisation of the power infrastructure components. In this research, we studied the visual localisation of a pylon. The pylon is the most prominent component of the power infrastructure and can provide a context for the inspection of the other components. Point-based descriptors tend to perform poorly on texture less objects such as pylons, therefore we explored the localisation using convolutional neural networks and geometric constraints. The crossings of the pylon, or vertices, are salient points on the pylon. These vertices aid with recognition and pose estimation of the pylon. We were successfully able to use a convolutional neural network for the detection of the vertices. A model-based technique, geometric hashing, was used to establish the correspondence between the stored pylon model and the scene object. We showed the effectiveness of the method as a voting technique to determine the pose estimation from a single image. In a localisation framework, the method serves as the initialization of the tracking process. We were able to incorporate an extended Kalman filter for subsequent incremental tracking of the camera relative to the pylon. Also, we demonstrated an alternative tracking using heatmap details from the vertex detection. We successfully demonstrated the proposed algorithms and evaluated their effectiveness using a model pylon we built in the laboratory. Furthermore, we revalidated the results on a real-world outdoor electricity pylon. Our experiments illustrate that model-based techniques can be deployed as part of the navigation aspect of a robot

An advanced unmanned aerial vehicle (UAV) approach via learning-based control for overhead power line monitoring: a comprehensive review

Detection and prevention of faults in overhead electric lines is critical for the reliability and availability of electricity supply. The disadvantages of conventional methods range from cumbersome installations to costly maintenance and from lack of adaptability to hazards for human operators. Thus, transmission inspections based on unmanned aerial vehicles (UAV) have been attracting the attention of researchers since their inception. This article provides a comprehensive review for the development of UAV technologies in the overhead electric power lines patrol process for monitoring and identifying faults, explores its advantages, and realizes the potential of the aforementioned method and how it can be exploited to avoid obstacles, especially when compared with the state-of-the-art mechanical methods. The review focuses on the development of advanced Learning Control strategies for higher manoeuvrability of the quadrotor. It also explores suitable recharging strategies and motor control for improved mission autonomy

Development of an autonomous system for assessment and prediction of structural integrity

Kako bi se osiguralo racionalnije, plansko održavanje prometne infrastrukture uz smanjenje troškova te u konačnici minimalizirao rizik od katastrofalnih posljedica, nužan je razvoj inovativnih rješenja u području održavanja građevina prometne infrastrukture. Kroz projekt ASAP razvija se sustav za autonomni pregled građevina, koji se zasniva na naprednim mjernim metodama integriranim na robota penjača i bespilotnu letjelicu. Cilj ovog rada je dati osvrt i upozoriti na nedostatke konvencionalnog načina ispitivanja materijala i konstrukcija za potrebu ocjene stanja, koji su bili osnovna motivacija okupljanja multidisciplinarnog tima kroz projekt ASAP. U radu su također prikazane mogućnosti i izazovi razvoja autonomnog sustava za pregled građevina, a sve u svrhu povećanja pouzdanosti i efikasnosti sustavnog pregleda građevina.Development of innovative solutions for the maintenance of transport infrastructure facilities is needed in order to ensure a more rational, planned and lower-cost maintenance of transport infrastructure, and to ultimately minimise the risk of catastrophic consequences. A system for an autonomous inspection of structures, based on advanced measuring methods integrated on a wall-climbing robot and an unmanned aerial vehicle, is currently developed in the scope of the ASAP project. The objective of this paper is to provide an overview and draw attention to disadvantages of conventional methods for testing materials and structures in order to assess their condition. This objective was the main motivation for forming a multidisciplinary team through the ASAP project. Possibilities and challenges in the development of an autonomous structural-assessment system are also presented in the paper, with the purpose of increasing the reliability and efficiency of systemic assessment of structures

Automatic vision based fault detection on electricity transmission components using very highresolution

Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial TechnologiesElectricity is indispensable to modern-day governments and citizenry’s day-to-day operations. Fault identification is one of the most significant bottlenecks faced by Electricity transmission and distribution utilities in developing countries to deliver credible services to customers and ensure proper asset audit and management for network optimization and load forecasting. This is due to data scarcity, asset inaccessibility and insecurity, ground-surveys complexity, untimeliness, and general human cost. In this context, we exploit the use of oblique drone imagery with a high spatial resolution to monitor four major Electric power transmission network (EPTN) components condition through a fine-tuned deep learning approach, i.e., Convolutional Neural Networks (CNNs). This study explored the capability of the Single Shot Multibox Detector (SSD), a onestage object detection model on the electric transmission power line imagery to localize, classify and inspect faults present. The components fault considered include the broken insulator plate, missing insulator plate, missing knob, and rusty clamp. The adopted network used a CNN based on a multiscale layer feature pyramid network (FPN) using aerial image patches and ground truth to localise and detect faults via a one-phase procedure. The SSD Rest50 architecture variation performed the best with a mean Average Precision of 89.61%. All the developed SSD based models achieve a high precision rate and low recall rate in detecting the faulty components, thus achieving acceptable balance levels F1-score and representation. Finally, comparable to other works of literature within this same domain, deep-learning will boost timeliness of EPTN inspection and their component fault mapping in the long - run if these deep learning architectures are widely understood, adequate training samples exist to represent multiple fault characteristics; and the effects of augmenting available datasets, balancing intra-class heterogeneity, and small-scale datasets are clearly understood

NASA Tech Briefs, October 2007

Topics covered include; Wirelessly Interrogated Position or Displacement Sensors; Ka-Band Radar Terminal Descent Sensor; Metal/Metal Oxide Differential Electrode pH Sensors; Improved Sensing Coils for SQUIDs; Inductive Linear-Position Sensor/Limit-Sensor Units; Hilbert-Curve Fractal Antenna With Radiation- Pattern Diversity; Single-Camera Panoramic-Imaging Systems; Interface Electronic Circuitry for an Electronic Tongue; Inexpensive Clock for Displaying Planetary or Sidereal Time; Efficient Switching Arrangement for (N + 1)/N Redundancy; Lightweight Reflectarray Antenna for 7.115 and 32 GHz; Opto-Electronic Oscillator Using Suppressed Phase Modulation; Alternative Controller for a Fiber-Optic Switch; Strong, Lightweight, Porous Materials; Nanowicks; Lightweight Thermal Protection System for Atmospheric Entry; Rapid and Quiet Drill; Hydrogen Peroxide Concentrator; MMIC Amplifiers for 90 to 130 GHz; Robot Would Climb Steep Terrain; Measuring Dynamic Transfer Functions of Cavitating Pumps; Advanced Resistive Exercise Device; Rapid Engineering of Three-Dimensional, Multicellular Tissues With Polymeric Scaffolds; Resonant Tunneling Spin Pump; Enhancing Spin Filters by Use of Bulk Inversion Asymmetry; Optical Magnetometer Incorporating Photonic Crystals; WGM-Resonator/Tapered-Waveguide White-Light Sensor Optics; Raman-Suppressing Coupling for Optical Parametric Oscillator; CO2-Reduction Primary Cell for Use on Venus; Cold Atom Source Containing Multiple Magneto- Optical Traps; POD Model Reconstruction for Gray-Box Fault Detection; System for Estimating Horizontal Velocity During Descent; Software Framework for Peer Data-Management Services; Autogen Version 2.0; Tracking-Data-Conversion Tool; NASA Enterprise Visual Analysis; Advanced Reference Counting Pointers for Better Performance; C Namelist Facility; and Efficient Mosaicking of Spitzer Space Telescope Images