Measuring Oscillating Walking Paths with a LIDAR

This work describes the analysis of different walking paths registered using a Light Detection And Ranging (LIDAR) laser range sensor in order to measure oscillating trajectories during unsupervised walking. The estimate of the gait and trajectory parameters were obtained with a terrestrial LIDAR placed 100 mm above the ground with the scanning plane parallel to the floor to measure the trajectory of the legs without attaching any markers or modifying the floor. Three different large walking experiments were performed to test the proposed measurement system with straight and oscillating trajectories. The main advantages of the proposed system are the possibility to measure several steps and obtain average gait parameters and the minimum infrastructure required. This measurement system enables the development of new ambulatory applications based on the analysis of the gait and the trajectory during a walk

Map matching and heuristic elimination of gyro drift for personal navigation systems in GPS-denied conditions

This paper introduces a method for the substantial reduction of heading errors in inertial navigation systems used under GPS-denied conditions. Presumably, the method is applicable for both vehicle-based and personal navigation systems, but experiments were performed only with a personal navigation system called 'personal dead reckoning' (PDR). In order to work under GPS-denied conditions, the PDR system uses a foot-mounted inertial measurement unit (IMU). However, gyro drift in this IMU can cause large heading errors after just a few minutes of walking. To reduce these errors, the map-matched heuristic drift elimination (MAPHDE) method was developed, which estimates gyro drift errors by comparing IMU-derived heading to the direction of the nearest street segment in a database of street maps. A heuristic component in this method provides tolerance to short deviations from walking along the street, such as when crossing streets or intersections. MAPHDE keeps heading errors almost at zero, and, as a result, position errors are dramatically reduced. In this paper, MAPHDE was used in a variety of outdoor walks, without any use of GPS. This paper explains the MAPHDE method in detail and presents experimental results.Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/90785/1/0957-0233_22_2_025205.pd

Lidar-based Gait Analysis and Activity Recognition in a 4D Surveillance System

This paper presents new approaches for gait and activity analysis based on data streams of a Rotating Multi Beam (RMB) Lidar sensor. The proposed algorithms are embedded into an integrated 4D vision and visualization system, which is able to analyze and interactively display real scenarios in natural outdoor environments with walking pedestrians. The main focus of the investigations are gait based person re-identification during tracking, and recognition of specific activity patterns such as bending, waving, making phone calls and checking the time looking at wristwatches. The descriptors for training and recognition are observed and extracted from realistic outdoor surveillance scenarios, where multiple pedestrians are walking in the field of interest following possibly intersecting trajectories, thus the observations might often be affected by occlusions or background noise. Since there is no public database available for such scenarios, we created and published a new Lidar-based outdoors gait and activity dataset on our website, that contains point cloud sequences of 28 different persons extracted and aggregated from 35 minutes-long measurements. The presented results confirm that both efficient gait-based identification and activity recognition is achievable in the sparse point clouds of a single RMB Lidar sensor. After extracting the people trajectories, we synthesized a free-viewpoint video, where moving avatar models follow the trajectories of the observed pedestrians in real time, ensuring that the leg movements of the animated avatars are synchronized with the real gait cycles observed in the Lidar stream

Laserkeilausaineiston ja katunäkymäkuvien hyödyntäminen tieympäristön seurannassa

Utilization of laser scanning has increased during the past few years in many fields of applications, for example, in road environment monitoring. Mild winters, increasing rainfalls and frost are deteriorating the surface and structure of the road causing road damages. The road environment and its condition can be examined for example with laser scanning and street view images. Utilization of laser scanning data and street view images in road environment monitoring was studied in this thesis. The main focus was on the road damages and drainage. Also individual trees were detected nearby road scenes. TerraModeler and TerraScan software were used for investigations. Five different lidar datasets were used to detect road damages and drainage. Both mobile and helicopter-based lidar data were available from Jakomäki area. In Rauma case, there were two datasets collected from the helicopter but the point densities were different. In addition, to helicopter-based lidar data, there were also street view images available from BlomSTREET service in Hyvinkää case. The results between the datasets were compared. Aim was to investigate if same damages can be found from the several datasets that have different point densities. Lidar data for individual tree detection was collected by helicopter from Korppoo area. Tree locations were also measured with a tachymeter to get reference data for automatic detection. Heights of the trees were manually determined from the point cloud. Manually measured heights and locations were compared with automatically detected ones. Detection of rut depths, slopes and drainage is possible from the high point density datasets. From lower point density datasets it is not possible to detect for example rut depths. Point cloud is possible to color by slopes, which may give some information about rut locations even from lower point density datasets. Obtaining slopes and drainage accurately is also possible from lower point density data. With TerraModeler water gathering points can be obtained. Panorama pictures from BlomSTREET can be utilized for ensuring if there is a rainwater outlet or if water will gather as a puddle. Tree locations were detected in a meter accuracy with automatic method. Successful detection of tree heights and locations is dependent on many things. Successful classification of the data and creation of tree models are the most important parameters.Laserkeilaus on yleistynyt ja sitä hyödynnetään useissa eri sovelluksissa kuten esimerkiksi tiesovelluksissa. Leudot ja sateiset talvet sekä routa kuluttavat tien pintaa ja rakennetta aiheuttaen tievaurioita, jotka voivat olla vaaraksi liikenteelle. Tienkuntoa ja sen ympäristöä voidaan tarkastella esimerkiksi laserkeilausaineistojen sekä katunäkymäkuvien avulla. Työssä tutkittiin kuinka laserkeilausaineistoa ja katunäkymäkuvia voidaan hyödyntää tieympäristön seurannassa. Tutkimuksessa keskityttiin tarkastelemaan tievaurioita ja kuivatusta sekä tiealueiden läheisyydessä sijaitsevien puiden tunnistusta. Tutkimuksessa käytettiin TerraModeler ja TerraScan ohjelmistoja. Tievaurioita ja kuivatusta tutkittiin viidestä eri aineistosta kolmelta eri alueelta. Jakomäen alueelta tien ominaisuuksia tutkittiin sekä mobiili- että helikopterilaserkeilausaineistosta ja Rauman alueelta vaurioita kartoitettiin kahdesta eri helikopterilla kerätystä pistetiheyden aineistosta. Hyvinkäältä helikopterilla kerätyn laserkeilausaineiston lisäksi oli saatavilla katunäkymäkuvia BlomSTREET palvelusta. Aineistoista saatuja tuloksia vertailtiin keskenään ja tutkittiin, onko niistä mahdollista havaita samankaltaisia tuloksia. Yksittäisen puun tunnistukseen käytettiin helikopterilla kerättyä laserkeilausaineistoa Korppoon alueelta ja referenssinä aineistolle toimi maastossa mitatut puiden sijainnit. Automaattisesti määritettyjen puiden sijaintia verrattiin maastossa mitattuihin sijainteihin. Myös puiden korkeus määritettiin pistepilvestä manuaalisesti ja tätä verrattiin automaattiseen korkeuden määritykseen. Korkean pistetiheyden laserkeilausaineistoilla on mahdollista tutkia tien urautumista, tien kaltevuuksia ja kuivatusta. Matalamman pistetiheyden aineistoista ei pystytä määrittämään esimerkiksi urasyvyyksiä. Pistepilvi on mahdollista värjätä kaltevuuksien mukaan, minkä avulla urautumista voidaan havaita jossain määrin myös matalampien pistetiheyksien aineistoista. Tien kaltevuuksia ja kuivatusta pystytään havaitsemaan tarkasti jopa alhaisista pistetiheyden aineistoista. TerraModelerin avulla voidaan määrittää alueet, johon sadevesi kasautuu. BlomSTREET 360 panoraamakuvien avulla pystytään tarkastamaan onko kohdassa sadevesikaivo vai kerääntyykö vesi lammikoiksi. Yksittäisten puiden sijainnin määrittäminen onnistui noin metrin tarkkuudella, mutta sijainnin ja korkeuden määrittämisen onnistuminen on riippuvainen monesta tekijästä. Pistepilven luokittelun onnistumisen lisäksi yksi tärkeä tekijä on puiden muodoista tehdyt mallit, joiden avulla TerraScan ohjelmisto etsii yksittäisiä puita

Navigation Recommender:Real-Time iGNSS QoS Prediction for Navigation Services

Global Navigation Satellite Systems (GNSSs), especially Global Positioning System (GPS), have become commonplace in mobile devices and are the most preferred geo-positioning sensors for many location-based applications. Besides GPS, other GNSSs under development or deployment are GLONASS, Galileo, and Compass. These four GNSSs are planned to be integrated in the near future. It is anticipated that integrated GNSSs (iGNSSs) will improve the overall satellite-based geo-positioning performance. However, one major shortcoming of any GNSS and iGNSSs is Quality of Service (QoS) degradation due to signal blockage and attenuation by the surrounding environments, particularly in obstructed areas. GNSS QoS uncertainty is the root cause of positioning ambiguity, poor localization performance, application freeze, and incorrect guidance in navigation applications. In this research, a methodology, called iGNSS QoS prediction, that can provide GNSS QoS on desired and prospective routes is developed. Six iGNSS QoS parameters suitable for navigation are defined: visibility, availability, accuracy, continuity, reliability, and flexibility. The iGNSS QoS prediction methodology, which includes a set of algorithms, encompasses four modules: segment sampling, point-based iGNSS QoS prediction, tracking-based iGNSS QoS prediction, and iGNSS QoS segmentation. Given that iGNSS QoS prediction is data- and compute-intensive and navigation applications require real-time solutions, an efficient satellite selection algorithm is developed and distributed computing platforms, mainly grids and clouds, for achieving real-time performance are explored. The proposed methodology is unique in several respects: it specifically addresses the iGNSS positioning requirements of navigation systems/services; it provides a new means for route choices and routing in navigation systems/services; it is suitable for different modes of travel such as driving and walking; it takes high-resolution 3D data into account for GNSS positioning; and it is based on efficient algorithms and can utilize high-performance and scalable computing platforms such as grids and clouds to provide real-time solutions. A number of experiments were conducted to evaluate the developed methodology and the algorithms using real field test data (GPS coordinates). The experimental results show that the methodology can predict iGNSS QoS in various areas, especially in problematic areas

A novel low-cost autonomous 3D LIDAR system

Thesis (M.S.) University of Alaska Fairbanks, 2018To aid in humanity's efforts to colonize alien worlds, NASA's Robotic Mining Competition pits universities against one another to design autonomous mining robots that can extract the materials necessary for producing oxygen, water, fuel, and infrastructure. To mine autonomously on the uneven terrain, the robot must be able to produce a 3D map of its surroundings and navigate around obstacles. However, sensors that can be used for 3D mapping are typically expensive, have high computational requirements, and/or are designed primarily for indoor use. This thesis describes the creation of a novel low-cost 3D mapping system utilizing a pair of rotating LIDAR sensors, attached to a mobile testing platform. Also, the use of this system for 3D obstacle detection and navigation is shown. Finally, the use of deep learning to improve the scanning efficiency of the sensors is investigated.Chapter 1. Introduction -- 1.1. Purpose -- 1.2. 3D sensors -- 1.2.1. Cameras -- 1.2.2. RGB-D Cameras -- 1.2.3. LIDAR -- 1.3. Overview of Work and Contributions -- 1.4. Multi-LIDAR and Rotating LIDAR Systems -- 1.5. Thesis Organization. Chapter 2. Hardware -- 2.1. Overview -- 2.2. Components -- 2.2.1. Revo Laser Distance Sensor -- 2.2.2. Dynamixel AX-12A Smart Serial Servo -- 2.2.3. Bosch BNO055 Inertial Measurement Unit -- 2.2.4. STM32F767ZI Microcontroller and LIDAR Interface Boards -- 2.2.5. Create 2 Programmable Mobile Robotic Platform -- 2.2.6. Acer C720 Chromebook and Genius Webcam -- 2.3. System Assembly -- 2.3.1. 3D LIDAR Module -- 2.3.2. Full Assembly. Chapter 3. Software -- 3.1. Robot Operating System -- 3.2. Frames of Reference -- 3.3. System Overview -- 3.4. Microcontroller Firmware -- 3.5. PC-Side Point Cloud Fusion -- 3.6. Localization System -- 3.6.1. Fusion of Wheel Odometry and IMU Data -- 3.6.2. ArUco Marker Localization -- 3.6.3. ROS Navigation Stack: Overview & Configuration -- 3.6.3.1. Costmaps -- 3.6.3.2. Path Planners. Chapter 4. System Performance -- 4.1. VS-LIDAR Characteristics -- 4.2. Odometry Tests -- 4.3. Stochastic Scan Dithering -- 4.4. Obstacle Detection Test -- 4.5. Navigation Tests -- 4.6. Detection of Black Obstacles -- 4.7. Performance in Sunlit Environments -- 4.8. Distance Measurement Comparison. Chapter 5. Case Study: Adaptive Scan Dithering -- 5.1. Introduction -- 5.2. Adaptive Scan Dithering Process Overview -- 5.3. Coverage Metrics -- 5.4. Reward Function -- 5.5. Network Configuration -- 5.6. Performance and Remarks. Chapter 6. Conclusions and Future Work -- 6.1. Conclusions -- 6.2. Future Work -- 6.3. Lessons Learned -- References

Force sensing to reconstruct potential energy landscapes for cluttered large obstacle traversal

Visual sensing of environmental geometry allows robots to use artificial potential fields to avoid sparse obstacles. Yet robots must further traverse cluttered large obstacles for applications like search and rescue through rubble and planetary exploration across Martain rocks. Recent studies discovered that to traverse cluttered large obstacles, multi-legged insects and insect-inspired robots make strenuous transitions across locomotor modes with major changes in body orientation. When viewed on a potential energy landscape resulting from locomotor-obstacle physical interaction, these are barrier-crossing transitions across landscape basins. This potential energy landscape approach may provide a modeling framework for cluttered large obstacle traversal. Here, we take the next step toward this vision by testing whether force sensing allows the reconstruction of the potential energy landscape. We developed a cockroach-inspired, minimalistic robot capable of sensing obstacle contact forces and torques around its body as it propelled forward against a pair of cluttered grass-like beam obstacles. We performed measurements over many traverses with systematically varied body orientations. Despite the forces and torques not being fully conservative, they well-matched the potential energy landscape gradients and the landscape reconstructed from them well-matched ground truth. In addition, inspired by cockroach observations, we found that robot head oscillation during traversal further improved the accuracies of force sensing and landscape reconstruction. We still need to study how to reconstruct landscape during a single traverse, as in applications, robots have little chance to use multiple traverses to sample the environment systematically and how to find landscape saddles for least-effort transitions to traverse

Unconventional Trajectories for Mobile 3D Scanning and Mapping

State-of-the-art LiDAR-based 3D scanning and mapping systems focus on scenarios where good sensing coverage is ensured, such as drones, wheeled robots, cars, or backpack-mounted systems. However, in some scenarios more unconventional sensor trajectories come naturally, e.g., rolling, descending, or oscillating back and forth, but the literature on these is relatively sparse. As a result, most implementations developed in the past are not able to solve the SLAM problem in such conditions. In this chapter, we propose a robust offline-batch SLAM system that is able to address more challenging trajectories, which are characterized by weak angles of incidence and limited FOV while scanning. The proposed SLAM system is an upgraded version of our previous work and takes as input the raw points and prior pose estimates, yet the latter are subject to large amounts of drift. Our approach is a two-staged algorithm where in the first stage coarse alignment is fast achieved by matching planar polygons. In the second stage, we utilize a graph-based SLAM algorithm for further refinement. We evaluate the mapping accuracy of the algorithm on our own recorded datasets using high-resolution ground truth maps, which are available from a TLS