Detection of Road Surface Damage Using Mobile Robot Equipped with 2D Laser Scanner

Abstract-This paper introduces a road surface damage detection using mobile robot. Our research is aimed autonomous sidewalk investigation with mobile robot, for reduce the burden of human workers engaged in road maintenance. A mobile robot moves along the route for investigation and obtain shape information of road surface using 2D laser scanner. From this road surface information, road damage section will be automatically detected. By showing the detection result instead of site investigation by human workers, it expects to reduce the burden of human workers. Road surface have gradual curves and some road damage is small and less than 2 cm. Hence, our method uses random sampling to detect irregularity as road damage. This paper explains the measurement of road surface using mobile robot equipped with 2D laser scanner and the road damage detection method. In this paper, some experimental results also is shown

Orchard mapping and mobile robot localisation using on-board camera and laser scanner data fusion

Agricultural mobile robots have great potential to effectively implement different agricultural tasks. They can save human labour costs, avoid the need for people having to perform risky operations and increase productivity. Automation and advanced sensing technologies can provide up-to-date information that helps farmers in orchard management. Data collected from on-board sensors on a mobile robot provide information that can help the farmer detect tree or fruit diseases or damage, measure tree canopy volume and monitor fruit development. In orchards, trees are natural landmarks providing suitable cues for mobile robot localisation and navigation as trees are nominally planted in straight and parallel rows. This thesis presents a novel tree trunk detection algorithm that detects trees and discriminates between trees and non-tree objects in the orchard using a camera and 2D laser scanner data fusion. A local orchard map of the individual trees was developed allowing the mobile robot to navigate to a specific tree in the orchard to perform a specific task such as tree inspection. Furthermore, this thesis presents a localisation algorithm that does not rely on GPS positions and depends only on the on-board sensors of the mobile robot without adding any artificial landmarks, respective tapes or tags to the trees. The novel tree trunk detection algorithm combined the features extracted from a low cost camera's images and 2D laser scanner data to increase the robustness of the detection. The developed algorithm used a new method to detect the edge points and determine the width of the tree trunks and non-tree objects from the laser scan data. Then a projection of the edge points from the laser scanner coordinates to the image plane was implemented to construct a region of interest with the required features for tree trunk colour and edge detection. The camera images were used to verify the colour and the parallel edges of the tree trunks and non-tree objects. The algorithm automatically adjusted the colour detection parameters after each test which was shown to increase the detection accuracy. The orchard map was constructed based on tree trunk detection and consisted of the 2D positions of the individual trees and non-tree objects. The map of the individual trees was used as an a priority map for mobile robot localisation. A data fusion algorithm based on an Extended Kalman filter was used for pose estimation of the mobile robot in different paths (midway between rows, close to the rows and moving around trees in the row) and different turns (semi-circle and right angle turns) required for tree inspection tasks. The 2D positions of the individual trees were used in the correction step of the Extended Kalman filter to enhance localisation accuracy. Experimental tests were conducted in a simulated environment and a real orchard to evaluate the performance of the developed algorithms. The tree trunk detection algorithm was evaluated under two broad illumination conditions (sunny and cloudy). The algorithm was able to detect the tree trunks (regular and thin tree trunks) and discriminate between trees and non-tree objects with a detection accuracy of 97% showing that the fusion of both vision and 2D laser scanner technologies produced robust tree trunk detection. The mapping method successfully localised all the trees and non-tree objects of the tested tree rows in the orchard environment. The mapping results indicated that the constructed map can be reliably used for mobile robot localisation and navigation. The localisation algorithm was evaluated against the logged RTK-GPS positions for different paths and headland turns. The average of the RMS of the position error in x, y coordinates and Euclidean distance were 0.08 m, 0.07 m and 0.103 m respectively, whilst the average of the RMS of the heading error was 3:32°. These results were considered acceptable while driving along the rows and when executing headland turns for the target application of autonomous mobile robot navigation and tree inspection tasks in orchards

Challenges of bridge maintenance inspection

Bridges are amongst the largest, most expensive and complex structures, which makes them crucial and valuable transportation asset for modern infrastructure. Bridge inspection is a crucial component of monitoring and maintaining these complex structures. It provides a safety assessment and condition documentation on a regular basis, noting maintenance actions needed to counteract defects like cracks, corrosion and spalling. This paper presents the challenges with existing bridge maintenance inspection as well as an overview on proposed methods to overcome these challenges by automating inspection using computer vision methods. As a conclusion, existing methods for automated bridge inspection are able to detect one class of damage type based on images. A multiclass approach that also considers the 3D geometry, as inspectors do, is missing

Development and evaluation of low cost 2-d lidar based traffic data collection methods

Traffic data collection is one of the essential components of a transportation planning exercise. Granular traffic data such as volume count, vehicle classification, speed measurement, and occupancy, allows managing transportation systems more effectively. For effective traffic operation and management, authorities require deploying many sensors across the network. Moreover, the ascending efforts to achieve smart transportation aspects put immense pressure on planning authorities to deploy more sensors to cover an extensive network. This research focuses on the development and evaluation of inexpensive data collection methodology by using two-dimensional (2-D) Light Detection and Ranging (LiDAR) technology. LiDAR is adopted since it is economical and easily accessible technology. Moreover, its 360-degree visibility and accurate distance information make it more reliable. To collect traffic count data, the proposed method integrates a Continuous Wavelet Transform (CWT), and Support Vector Machine (SVM) into a single framework. Proof-of-Concept (POC) test is conducted in three different places in Newark, New Jersey to examine the performance of the proposed method. The POC test results demonstrate that the proposed method achieves acceptable performances, resulting in 83% ~ 94% accuracy. It is discovered that the proposed method\u27s accuracy is affected by the color of the exterior surface of a vehicle since some colored surfaces do not produce enough reflective rays. It is noticed that the blue and black colors are less reflective, while white-colored surfaces produce high reflective rays. A methodology is proposed that comprises K-means clustering, inverse sensor model, and Kalman filter to obtain trajectories of the vehicles at the intersections. The primary purpose of vehicle detection and tracking is to obtain the turning movement counts at an intersection. A K-means clustering is an unsupervised machine learning technique that clusters the data into different groups by analyzing the smallest mean of a data point from the centroid. The ultimate objective of applying K-mean clustering is to identify the difference between pedestrians and vehicles. An inverse sensor model is a state model of occupancy grid mapping that localizes the detected vehicles on the grid map. A constant velocity model based Kalman filter is defined to track the trajectory of the vehicles. The data are collected from two intersections located in Newark, New Jersey, to study the accuracy of the proposed method. The results show that the proposed method has an average accuracy of 83.75%. Furthermore, the obtained R-squared value for localization of the vehicles on the grid map is ranging between 0.87 to 0.89. Furthermore, a primary cost comparison is made to study the cost efficiency of the developed methodology. The cost comparison shows that the proposed methodology based on 2-D LiDAR technology can achieve acceptable accuracy at a low price and be considered a smart city concept to conduct extensive scale data collection

A review of three-dimensional imaging technologies for pavement distress detection and measurements

With the ever-increasing emphasis on maintaining road assets to a high standard, the need for fast accurate inspection for road distresses is becoming extremely important. Surface distresses on roads are essentially three dimensional (3-D) in nature. Automated visual surveys are the best option available. However, the imaging conditions, in terms of lighting, etc., are very random. For example, the challenge of measuring the volume of the pothole requires a large field of view with a reasonable spatial resolution, whereas microtexture evaluation requires very accurate imaging. Within the two extremes, there is a range of situations that require 3-D imaging. Three-dimensional imaging consists of a number of techniques such as interferometry and depth from focus. Out of these, laser imagers are mainly used for road surface distress inspection. Many other techniques are relatively unknown among the transportation community, and industrial products are rare. The main impetus for this paper is derived from the rarity of 3-D industrial imagers that employ alternative techniques for use in transportation. In addition, the need for this work is also highlighted by a lack of literature that evaluates the relative merits/demerits of various imaging methods for different distress measurement situations in relation to pavements. This overview will create awareness of available 3-D imaging methods in order to help make a fast initial technology selection and deployment. The review is expected to be helpful for researchers, practicing engineers, and decision makers in transportation engineering