Low-cost deep learning UAV and Raspberry Pi solution to real time pavement condition assessment

In this thesis, a real-time and low-cost solution to the autonomous condition assessment of pavement is proposed using deep learning, Unmanned Aerial Vehicle (UAV) and Raspberry Pi tiny computer technologies, which makes roads maintenance and renovation management more efficient and cost effective. A comparison study was conducted to compare the performance of seven different combinations of meta-architectures for pavement distress classification. It was observed that real-time object detection architecture SSD with MobileNet feature extractor is the best combination for real-time defect detection to be used by tiny computers. A low-cost Raspberry Pi smart defect detector camera was configured using the trained SSD MobileNet v1, which can be deployed with UAV for real-time and remote pavement condition assessment. The preliminary results show that the smart pavement detector camera achieves an accuracy of 60% at 1.2 frames per second in raspberry pi and 96% at 13.8 frames per second in CPU-based computer

Detecting Patches on Road Pavement Images acquired with 3D Laser Sensors using Object Detection and Deep Learning

Regular pavement inspections are key to good road maintenance and road defect corrections. Advanced pavement inspection systems such as LCMS (Laser Crack Measurement System) can automatically detect the presence of different defects using 3D lasers. However, such systems still require manual involvement to complete the detection of pavement defects. This paper proposes an automatic patch detection system using object detection technique. To our knowledge, this is the first time state-of-the-art object detection models Faster RCNN, and SSD MobileNet-V2 have been used to detect patches inside images acquired by LCMS. Results show that the object detection model can successfully detect patches inside LCMS images and suggest that the proposed approach could be integrated into the existing pavement inspection systems. The contribution of this paper are (1) an automatic pavement patch detection models for LCMS images and (2) comparative analysis of RCNN, and SSD MobileNet-V2 models for automatic patch detection

Real-Time Human Detection Using Deep Learning on Embedded Platforms: A Review

The detection of an object such as a human is very important for image understanding in the field of computer vision. Human detection in images can provide essential information for a wide variety of applications in intelligent systems. In this paper, human detection is carried out using deep learning that has developed rapidly and achieved extraordinary success in various object detection implementations. Recently, several embedded systems have emerged as powerful computing boards to provide high processing capabilities using the graphics processing unit (GPU). This paper aims to provide a comprehensive survey of the latest achievements in this field brought about by deep learning techniques in the embedded platforms. NVIDIA Jetson was chosen as a low power system designed to accelerate deep learning applications. This review highlights the performance of human detection models such as PedNet, multiped, SSD MobileNet V1, SSD MobileNet V2, and SSD inception V2 on edge computing. This survey aims to provide an overview of these methods and compare their performance in accuracy and computation time for real-time applications. The experimental results show that the SSD MobileNet V2 model provides the highest accuracy with the fastest computation time compared to other models in our video datasets with several scenarios

Automatic vision based fault detection on electricity transmission components using very highresolution

Dissertation submitted in partial fulfilment of the requirements for the Degree of Master of Science in Geospatial TechnologiesElectricity is indispensable to modern-day governments and citizenry’s day-to-day operations. Fault identification is one of the most significant bottlenecks faced by Electricity transmission and distribution utilities in developing countries to deliver credible services to customers and ensure proper asset audit and management for network optimization and load forecasting. This is due to data scarcity, asset inaccessibility and insecurity, ground-surveys complexity, untimeliness, and general human cost. In this context, we exploit the use of oblique drone imagery with a high spatial resolution to monitor four major Electric power transmission network (EPTN) components condition through a fine-tuned deep learning approach, i.e., Convolutional Neural Networks (CNNs). This study explored the capability of the Single Shot Multibox Detector (SSD), a onestage object detection model on the electric transmission power line imagery to localize, classify and inspect faults present. The components fault considered include the broken insulator plate, missing insulator plate, missing knob, and rusty clamp. The adopted network used a CNN based on a multiscale layer feature pyramid network (FPN) using aerial image patches and ground truth to localise and detect faults via a one-phase procedure. The SSD Rest50 architecture variation performed the best with a mean Average Precision of 89.61%. All the developed SSD based models achieve a high precision rate and low recall rate in detecting the faulty components, thus achieving acceptable balance levels F1-score and representation. Finally, comparable to other works of literature within this same domain, deep-learning will boost timeliness of EPTN inspection and their component fault mapping in the long - run if these deep learning architectures are widely understood, adequate training samples exist to represent multiple fault characteristics; and the effects of augmenting available datasets, balancing intra-class heterogeneity, and small-scale datasets are clearly understood

Deep Learning Approach for UAV Visual Electrical Assets Inspection

The growth in the electrical demand by most countries around the world requires bigger and more complex energy systems, which leads to the requirement of having even more monitoring, inspection and maintenance of those systems. To respond to this need, inspection methods based on Unmanned Aerial Vehicles (UAV) have emerged which, when equipped with the appropriate sensors, allow a greater reduction of costs and risks and an increase in efficiency and effectiveness compared to traditional methods, such as inspection with foot patrols or helicopter-assisted. To make the inspection process more autonomous and reliable, most of the methods apply visual detection methods that use highly complex Deep Learning based algorithms and that require a very large computational power. This dissertation intends to present a system for inspection of electrical assets, able to be integrated onboard the UAV, based on Deep Learning, which allows to collect visual samples grouped and aggregated for each electrical asset detected. To this end, a perception system capable of detecting electrical insulators or structures, such as poles or transmission towers, was developed, using the Movidius Neural Compute Stick portable platform that is capable of processing lightweight object detection Convolutional Neural Networks, allowing a modular, low-cost system that meets real-time processing requirements. In addition to this perception system, an electrical asset monitoring system has been implemented that allows tracking and mapping each asset throughout the inspection process, based on the previous system’s detections and a UAV navigation system. Finally, an autonomous inspection system is proposed, which consists of a set of trajectories that allow an efficient application of the monitoring system along a power line, through the mapping of structures and the gathering of insulator samples around that structure.O grande crescimento da exigência elétrica pela maioria dos países por todo o mundo, requer que os sistemas de energia sejam maiores e mais complexos, o que conduz a uma maior necessidade de monitorização, inspeção e manutenção desses sistemas. Para responder a esta necessidade, surgiram métodos de inspeção baseados em Veículos Aéreos Não Tripulados (VANT) que, quando equipados com os sensores apropriados, permitem uma maior redução de custos e riscos e um grande aumento de eficiência e eficácia em comparação com os métodos tradicionais, como a inspeção com patrulhas pedonais ou assistida por helicóptero. Para tornar processo de inspeção mais autónomo e confiável, a maioria dos métodos realiza método de deteção visuais que utilizam algoritmos baseados em Deep Learning de elevada complexidade e que requerem um poder computacional muito grande. Nesta dissertação pretende-se apresentar um sistema de inspeção de ativos elétricos, para integração em VANTs, baseado em Apredizagem Profunda, que permite recolher amostras visuais agrupadas e agregadas por cada ativo elétrico detetado. Para tal foi desenvolvido um sistema de perceção capaz de detetar isoladores elétricos ou estruturas, como postes ou torres de transmissão, com recurso `a plataforma portátil Movidius Neural Compute Stick que ´e capaz de processar Redes Neuronais Convolucionais leves de deteção de objetos, permitindo assim um sistema modular, de baixo custo e que cumpre requisitos de processamento em tempo real. Para além deste sistema de perceção, foi implementado um sistema de monitorização de ativos elétricos que permite seguir e mapear cada ativo ao longo do processo de inspeção, com base nas deteções do sistema anterior e no sistema de navegação do VANT. Por fim, ´e proposto um sistema de inspeção autónomo que consiste num conjunto de trajetórias que permitem aplicar o sistema de monitorização de ativos elétricos ao longo de uma linha elétrica, através do mapeamento de estruturas e na recolha de amostras de isoladores em torno dessa estrutura