An Autonomous Robotic System for Mapping Abandoned Mines

We present the software architecture of a robotic system for mapping abandoned mines. The software is capable of acquiring consistent 2D maps of large mines with many cycles, represented as Markov random fields. 3D C-space maps are acquired from local 3D range scans, which are used to identify navigable paths using A* search. Our system has been deployed in three abandoned mines, two of which inaccessible to people, where it has acquired maps of unprecedented detail and accuracy

Percepção do ambiente urbano e navegação usando visão robótica : concepção e implementação aplicado à veículo autônomo

Orientadores: Janito Vaqueiro Ferreira, Alessandro Corrêa VictorinoTese (doutorado) - Universidade Estadual de Campinas, Faculdade de Engenharia MecânicaResumo: O desenvolvimento de veículos autônomos capazes de se locomover em ruas urbanas pode proporcionar importantes benefícios na redução de acidentes, no aumentando da qualidade de vida e também na redução de custos. Veículos inteligentes, por exemplo, frequentemente baseiam suas decisões em observações obtidas a partir de vários sensores tais como LIDAR, GPS e câmeras. Atualmente, sensores de câmera têm recebido grande atenção pelo motivo de que eles são de baixo custo, fáceis de utilizar e fornecem dados com rica informação. Ambientes urbanos representam um interessante mas também desafiador cenário neste contexto, onde o traçado das ruas podem ser muito complexos, a presença de objetos tais como árvores, bicicletas, veículos podem gerar observações parciais e também estas observações são muitas vezes ruidosas ou ainda perdidas devido a completas oclusões. Portanto, o processo de percepção por natureza precisa ser capaz de lidar com a incerteza no conhecimento do mundo em torno do veículo. Nesta tese, este problema de percepção é analisado para a condução nos ambientes urbanos associado com a capacidade de realizar um deslocamento seguro baseado no processo de tomada de decisão em navegação autônoma. Projeta-se um sistema de percepção que permita veículos robóticos a trafegar autonomamente nas ruas, sem a necessidade de adaptar a infraestrutura, sem o conhecimento prévio do ambiente e considerando a presença de objetos dinâmicos tais como veículos. Propõe-se um novo método baseado em aprendizado de máquina para extrair o contexto semântico usando um par de imagens estéreo, a qual é vinculada a uma grade de ocupação evidencial que modela as incertezas de um ambiente urbano desconhecido, aplicando a teoria de Dempster-Shafer. Para a tomada de decisão no planejamento do caminho, aplica-se a abordagem dos tentáculos virtuais para gerar possíveis caminhos a partir do centro de referencia do veículo e com base nisto, duas novas estratégias são propostas. Em primeiro, uma nova estratégia para escolher o caminho correto para melhor evitar obstáculos e seguir a tarefa local no contexto da navegação hibrida e, em segundo, um novo controle de malha fechada baseado na odometria visual e o tentáculo virtual é modelado para execução do seguimento de caminho. Finalmente, um completo sistema automotivo integrando os modelos de percepção, planejamento e controle são implementados e validados experimentalmente em condições reais usando um veículo autônomo experimental, onde os resultados mostram que a abordagem desenvolvida realiza com sucesso uma segura navegação local com base em sensores de câmeraAbstract: The development of autonomous vehicles capable of getting around on urban roads can provide important benefits in reducing accidents, in increasing life comfort and also in providing cost savings. Intelligent vehicles for example often base their decisions on observations obtained from various sensors such as LIDAR, GPS and Cameras. Actually, camera sensors have been receiving large attention due to they are cheap, easy to employ and provide rich data information. Inner-city environments represent an interesting but also very challenging scenario in this context, where the road layout may be very complex, the presence of objects such as trees, bicycles, cars might generate partial observations and also these observations are often noisy or even missing due to heavy occlusions. Thus, perception process by nature needs to be able to deal with uncertainties in the knowledge of the world around the car. While highway navigation and autonomous driving using a prior knowledge of the environment have been demonstrating successfully, understanding and navigating general inner-city scenarios with little prior knowledge remains an unsolved problem. In this thesis, this perception problem is analyzed for driving in the inner-city environments associated with the capacity to perform a safe displacement based on decision-making process in autonomous navigation. It is designed a perception system that allows robotic-cars to drive autonomously on roads, without the need to adapt the infrastructure, without requiring previous knowledge of the environment and considering the presence of dynamic objects such as cars. It is proposed a novel method based on machine learning to extract the semantic context using a pair of stereo images, which is merged in an evidential grid to model the uncertainties of an unknown urban environment, applying the Dempster-Shafer theory. To make decisions in path-planning, it is applied the virtual tentacle approach to generate possible paths starting from ego-referenced car and based on it, two news strategies are proposed. First one, a new strategy to select the correct path to better avoid obstacles and to follow the local task in the context of hybrid navigation, and second, a new closed loop control based on visual odometry and virtual tentacle is modeled to path-following execution. Finally, a complete automotive system integrating the perception, path-planning and control modules are implemented and experimentally validated in real situations using an experimental autonomous car, where the results show that the developed approach successfully performs a safe local navigation based on camera sensorsDoutoradoMecanica dos Sólidos e Projeto MecanicoDoutor em Engenharia Mecânic

Self-healing radio maps of wireless networks for indoor positioning

Programa Doutoral em Telecomunicações MAP-tele das Universidades do Minho, Aveiro e PortoA Indústria 4.0 está a impulsionar a mudança para novas formas de produção e otimização em tempo real nos espaços industriais que beneficiam das capacidades da Internet of Things (IoT) nomeadamente, a localização de veículos para monitorização e optimização de processos. Normalmente os espaços industriais possuem uma infraestrutura Wi-Fi que pode ser usada para localizar pessoas, bens ou veículos, sendo uma oportunidade para aumentar a produtividade. Os mapas de rádio são importantes para os sistemas de posicionamento baseados em Wi-Fi, porque representam o ambiente de rádio e são usados para estimar uma posição. Os mapas de rádio são constituídos por amostras Wi-Fi recolhidas em posições conhecidas e degradam-se ao longo do tempo devido a vários fatores, por exemplo, efeitos de propagação, adição/remoção de APs, entre outros. O processo de construção do mapa de rádio costuma ser exigente em termos de tempo e recursos humanos, constituindo um desafio considerável. Os veículos, que operam em ambientes industriais podem ser explorados para auxiliar na construção de mapas de rádio, desde que seja possível localizá-los e rastreá-los. O objetivo principal desta tese é desenvolver um sistema de posicionamento para veículos industriais com mapas de rádio auto-regenerativos (capaz de manter os mapas de rádio atualizados). Os veículos são localizados através da fusão sensorial de Wi-Fi com sensores de movimento, que permitem anotar novas amostras Wi-Fi para o mapa de rádio auto-regenerativo. São propostas duas abordagens de fusão sensorial, baseadas em Loose Coupling e Tight Coupling, para a localização dos veículos. A abordagem Tight Coupling inclui uma métrica de confiança para determinar quando é que as amostras de Wi-Fi devem ser anotadas. Deste modo, esta solução não requer calibração nem esforço humano para a construção e manutenção do mapa de rádio. Os resultados obtidos em experiências sugerem que esta solução tem potencial para a IoT e a Indústria 4.0, especialmente em serviços de localização, mas também na monitorização, suporte à navegação autónoma, e interconectividade.Industry 4.0 is driving change for new forms of production and real-time optimization in factories, which benefit from the Industrial Internet of Things (IoT) capabilities to locate industrial vehicles for monitoring, improving safety, and operations. Most industrial environments have a Wi-Fi infrastructure that can be exploited to locate people, assets, or vehicles, providing an opportunity for enhancing productivity and interconnectivity. Radio maps are important for Wi-Fi-based Indoor Position Systems (IPSs) since they represent the radio environment and are used to estimate a position. Radio maps comprise a set of Wi- Fi samples collected at known positions, and degrade over time due to several aspects, e.g., propagation effects, addition/removal of Access Points (APs), among others, hence they should be periodically updated to maintain the IPS performance. The process to build and maintain radio maps is usually time-consuming and demanding in terms of human resources, thus being challenging to perform. Vehicles, commonly present in industrial environments, can be explored to help build and maintain radio maps, as long as it is possible to locate and track them. The main objective of this thesis is to develop an IPS for industrial vehicles with self-healing radio maps (capable of keeping radio maps up to date). Vehicles are tracked using sensor fusion of Wi-Fi with motion sensors, which allows to annotate new Wi-Fi samples to build the self-healing radio maps. Two sensor fusion approaches based on Loose Coupling and Tight Coupling are proposed to track vehicles. The Tight Coupling approach includes a reliability metric to determine when Wi-Fi samples should be annotated. As a result, this solution does not depend on any calibration or human effort to build and maintain the radio map. Results obtained in real-world experiments suggest that this solution has potential for IoT and Industry 4.0, especially in location services, but also in monitoring and analytics, supporting autonomous navigation, and interconnectivity between devices.MAP-Tele Doctoral Programme scientific committee and the FCT (Fundação para a Ciência e Tecnologia) for the PhD grant (PD/BD/137401/2018

Bayesian Train Localization with Particle Filter, Loosely Coupled GNSS, IMU, and a Track Map

Train localization is safety-critical and therefore the approach requires a continuous availability and a track-selective accuracy. A probabilistic approach is followed up in order to cope with multiple sensors, measurement errors, imprecise information, and hidden variables as the topological position within the track network. The nonlinear estimation of the train localization posterior is addressed with a novel Rao-Blackwellized particle filter (RBPF) approach. There, embedded Kalman filters estimate certain linear state variables while the particle distribution can cope with the nonlinear cases of parallel tracks and switch scenarios. The train localization algorithmis further based on a trackmap andmeasurements froma GlobalNavigation Satellite System(GNSS) receiver and an inertial measurement unit (IMU). The GNSS integration is loosely coupled and the IMU integration is achieved without the common strapdown approach and suitable for low-cost IMUs.The implementation is evaluated with realmeasurements from a regional train at regular passenger service over 230 km of tracks with 107 split switches and parallel track scenarios of 58.5 km.The approach is analyzed with labeled data by means of ground truth of the traveled switch way. Track selectivity results reach 99.3% over parallel track scenarios and 97.2% of correctly resolved switch ways

Algorithms for map-aided autonomous indoor pedestrian positioning and navigation

The personal positioning and navigation became a very challenging topic in our dynamic time. The urban canyons and particularly indoors represent the most difficult areas for personal navigation problematic. Problems like disturbed satellite signals make the positioning impossible indoors. Recently developed systems for indoor positioning do not assure the necessary positioning accuracy or are very expensive. Our concept stands for a fully autonomous positioning and navigation process. That is, a method that does not rely on the reception of external information, like satellite or terrestrial signals. Therefore, this research is based on the use of inertial measurements of the human walk and the map database which contains the graphic representation of the elements of the building, created by applying the link-node model. Using this reduced set of information the task is to develop methodology, based on the interaction of the data from both sources, to assure reliable positioning and navigation process. This research is divided in three parts. The first part consists in the development of a methodology for initial localization of the person indoors. The problem to solve is to localize the person in the building. Consider a person equipped with a system which contains set of inertial sensors and map database of the building. Speed, turn rate and barometric altitude are measured and time-stamped on each step of the person. A pre-processing phase uses these raw measurements in order to construct a polyline, thus representing user's trajectory. In the localization approach central place takes the association of the user's trajectory with the graph representation of the building, process known as map-matching. The solution is based on statistical method where the determination of the user's position is entirely represented by its probability density function (PDF) in the frame of Bayesian inference. Initial localization determines the edge of the graph occupied by the person. The second part aims at continuous localization, where user's position is estimated on every step. Besides the application of the classical map-matching techniques, two new methods are developed. Both rely on the similarity of the geometry of the trajectory and the elements of the graph. The first is based on the Bayesian inference, where the estimation is computed considering the walked distance and azimuth. The second method represents a new application of the Fréchet distance as degree of similarity between two polylines. The third part is pointed at the pedestrian guidance. Once the user's position is known it is easy to compute the path to his destination and to give him directions. The problem is to assure continuance of the process of navigation in the case when the person has lost his path. In that case the solution consists in either giving instructions to the user to go back on the path or computation of a new path from the actual position of the user to his destination. Based on that methodology, algorithms for initial localization, continuous localization, and guidance were created. Numerous tests with the participation of several persons have been provided in order to validate the algorithms and to show their performance, robustness and limits