Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Age

Simultaneous Localization and Mapping (SLAM)consists in the concurrent construction of a model of the environment (the map), and the estimation of the state of the robot moving within it. The SLAM community has made astonishing progress over the last 30 years, enabling large-scale real-world applications, and witnessing a steady transition of this technology to industry. We survey the current state of SLAM. We start by presenting what is now the de-facto standard formulation for SLAM. We then review related work, covering a broad set of topics including robustness and scalability in long-term mapping, metric and semantic representations for mapping, theoretical performance guarantees, active SLAM and exploration, and other new frontiers. This paper simultaneously serves as a position paper and tutorial to those who are users of SLAM. By looking at the published research with a critical eye, we delineate open challenges and new research issues, that still deserve careful scientific investigation. The paper also contains the authors' take on two questions that often animate discussions during robotics conferences: Do robots need SLAM? and Is SLAM solved

Towards autonomous localization and mapping of AUVs: a survey

Purpose The main purpose of this paper is to investigate two key elements of localization and mapping of Autonomous Underwater Vehicle (AUV), i.e. to overview various sensors and algorithms used for underwater localization and mapping, and to make suggestions for future research. Design/methodology/approach The authors first review various sensors and algorithms used for AUVs in the terms of basic working principle, characters, their advantages and disadvantages. The statistical analysis is carried out by studying 35 AUV platforms according to the application circumstances of sensors and algorithms. Findings As real-world applications have different requirements and specifications, it is necessary to select the most appropriate one by balancing various factors such as accuracy, cost, size, etc. Although highly accurate localization and mapping in an underwater environment is very difficult, more and more accurate and robust navigation solutions will be achieved with the development of both sensors and algorithms. Research limitations/implications This paper provides an overview of the state of art underwater localisation and mapping algorithms and systems. No experiments are conducted for verification. Practical implications The paper will give readers a clear guideline to find suitable underwater localisation and mapping algorithms and systems for their practical applications in hand. Social implications There is a wide range of audiences who will benefit from reading this comprehensive survey of autonomous localisation and mapping of UAVs. Originality/value The paper will provide useful information and suggestions to research students, engineers and scientists who work in the field of autonomous underwater vehicles

KALMAN FILTER AND NARX NEURAL NETWORK FOR ROBOT VISION BASED HUMAN TRACKING

Tracking human is an important and challenging problem in video-based intelligent robot systems. In this paper, a vision-based human tracking system is supposed to provide sensor input for vision-based control of a mobile robot that works in a team helping the human co-worker. A comparison between NARX neural network and Kalman filter in solving the prediction problem of human tracking in robot vision is presented. After collecting video data from a robot, simulation results obtained from the Kalman filter model are used to compare with the simulation results obtained from the NARX Neural network.Key words: robot vision, Kalman filter, neural networks, human trackin

Process analytical technology in food biotechnology

Biotechnology is an area where precision and reproducibility are vital. This is due to the fact that products are often in form of food, pharmaceutical or cosmetic products and therefore very close to the human being. To avoid human error during the production or the evaluation of the quality of a product and to increase the optimal utilization of raw materials, a very high amount of automation is desired. Tools in the food and chemical industry that aim to reach this degree of higher automation are summarized in an initiative called Process Analytical Technology (PAT). Within the scope of the PAT, is to provide new measurement technologies for the purpose of closed loop control in biotechnological processes. These processes are the most demanding processes in regards of control issues due to their very often biological rate-determining component. Most important for an automation attempt is deep process knowledge, which can only be achieved via appropriate measurements. These measurements can either be carried out directly, measuring a crucial physical value, or if not accessible either due to the lack of technology or a complicated sample state, via a soft-sensor.Even after several years the ideal aim of the PAT initiative is not fully implemented in the industry and in many production processes. On the one hand a lot effort still needs to be put into the development of more general algorithms which are more easy to implement and especially more reliable. On the other hand, not all the available advances in this field are employed yet. The potential users seem to stick to approved methods and show certain reservations towards new technologies.Die Biotechnologie ist ein Wissenschaftsbereich, in dem hohe Genauigkeit und Wiederholbarkeit eine wichtige Rolle spielen. Dies ist der Tatsache geschuldet, dass die hergestellten Produkte sehr oft den Bereichen Nahrungsmitteln, Pharmazeutika oder Kosmetik angehöhren und daher besonders den Menschen beeinflussen. Um den menschlichen Fehler bei der Produktion zu vermeiden, die Qualität eines Produktes zu sichern und die optimale Verwertung der Rohmaterialen zu gewährleisten, wird ein besonders hohes Maß an Automation angestrebt. Die Werkzeuge, die in der Nahrungsmittel- und chemischen Industrie hierfür zum Einsatz kommen, werden in der Process Analytical Technology (PAT) Initiative zusammengefasst. Ziel der PAT ist die Entwicklung zuverlässiger neuer Methoden, um Prozesse zu beschreiben und eine automatische Regelungsstrategie zu realisieren. Biotechnologische Prozesse gehören hierbei zu den aufwändigsten Regelungsaufgaben, da in den meisten Fällen eine biologische Komponente der entscheidende Faktor ist. Entscheidend für eine erfolgreiche Regelungsstrategie ist ein hohes Maß an Prozessverständnis. Dieses kann entweder durch eine direkte Messung der entscheidenden physikalischen, chemischen oder biologischen Größen gewonnen werden oder durch einen SoftSensor. Zusammengefasst zeigt sich, dass das finale Ziel der PAT Initiative auch nach einigen Jahren des Propagierens weder komplett in der Industrie noch bei vielen Produktionsprozessen angekommen ist. Auf der einen Seite liegt dies mit Sicherheit an der Tatsache, dass noch viel Arbeit in die Generalisierung von Algorithmen gesteckt werden muss. Diese müsse einfacher zu implementieren und vor allem noch zuverlässiger in der Funktionsweise sein. Auf der anderen Seite wurden jedoch auch Algorithmen, Regelungsstrategien und eigne Ansätze für einen neuartigen Sensor sowie einen Soft-Sensors vorgestellt, die großes Potential zeigen. Nicht zuletzt müssen die möglichen Anwender neue Strategien einsetzen und Vorbehalte gegenüber unbekannten Technologien ablegen

Embarking on the Autonomous Journey: A Strikingly Engineered Car Control System Design

openThis thesis develops an autonomous car control system with Raspberry Pi. Two predictive models are implemented: a convolutional neural network (CNN) using machine learning and an input-based decision tree model using sensor data. The Raspberry Module controls the car hardware and acquires real-time camera data with OpenCV. A dedicated web server and event stream processor process data in real-time using the trained neural network model, facilitating real-time decision-making. Unity and Meta Quest 2 VR set create the VR interface, while a generic DIY kit from Amazon and Raspberry PI provide the car hardware inputs. This research demonstrates the potential of VR in automotive communication, enhancing autonomous car testing and user experience.This thesis develops an autonomous car control system with Raspberry Pi. Two predictive models are implemented: a convolutional neural network (CNN) using machine learning and an input-based decision tree model using sensor data. The Raspberry Module controls the car hardware and acquires real-time camera data with OpenCV. A dedicated web server and event stream processor process data in real-time using the trained neural network model, facilitating real-time decision-making. Unity and Meta Quest 2 VR set create the VR interface, while a generic DIY kit from Amazon and Raspberry PI provide the car hardware inputs. This research demonstrates the potential of VR in automotive communication, enhancing autonomous car testing and user experience

Autonomous robot systems and competitions: proceedings of the 12th International Conference

This is the 2012’s edition of the scientific meeting of the Portuguese Robotics Open (ROBOTICA’ 2012). It aims to disseminate scientific contributions and to promote discussion of theories, methods and experiences in areas of relevance to Autonomous Robotics and Robotic Competitions. All accepted contributions are included in this proceedings book. The conference program has also included an invited talk by Dr.ir. Raymond H. Cuijpers, from the Department of Human Technology Interaction of Eindhoven University of Technology, Netherlands.The conference is kindly sponsored by the IEEE Portugal Section / IEEE RAS ChapterSPR-Sociedade Portuguesa de Robótic

Robust Intelligent Sensing and Control Multi Agent Analysis Platform for Research and Education

The aim of this thesis is the development and implementation of a controlled testing platform for the Robust Intelligent Sensing and Controls (RISC) Lab at Utah State University (USU). This will be an open source adaptable expandable robotics platform usable for both education and research. This differs from the many other platforms developed in that the entire platform software will be made open source. This open source software will encourage collaboration among other universities and enable researchers to essentially pick up where others have left off without the necessity of replicating months or even years of work. The expected results of this research will create a foundation for diverse robotics investigation at USU as well as enable attempts at novel methods of control, estimation and optimization. This will also contribute a complete software testbed setup to the already vibrant robotics open source research community. This thesis first outlines the platform setup and novel developments therein. The second stage provides an example of how this has been used in education, providing an example curriculum implementing modern control techniques. The third section provides some exploratory research in trajectory control and state estimation of the tip of an inverted pendulum atop a small unmanned aerial vehicle as well as bearing-only cooperative localization experimentation. Finally, a conclusion and future work is discussed

Cooperative Localization in Mobile Underwater Acoustic Sensor Networks

Die großflächige Erkundung und Überwachung von Tiefseegebieten gewinnt mehr und mehr an Bedeutung für Industrie und Wissenschaft. Diese schwer zugänglichen Areale in der Tiefsee können nur mittels Teams unbemannter Tauchbote effizient erkundet werden. Aufgrund der hohen Kosten, war bisher ein Einsatz von mehreren autonomen Unterwasserfahrzeugen (AUV) wirtschaftlich undenkbar, wodurch AUV-Teams nur in Simulationen erforscht werden konnten. In den letzten Jahren konnte jedoch eine Entwicklung hin zu günstigeren und robusteren AUVs beobachtet werden. Somit wird der Einsatz von AUV-Teams in Zukunft zu einer realen Option. Die wachsende Nachfrage nach Technologien zur Unterwasseraufklärung und Überwachung konnte diese Entwicklung noch zusätzlich beschleunigen. Eine der größten technischen Hürden für tief tauchende AUVs ist die Unterwasserlokalisierug. Satelitengestützte Navigation ist in der Tiefe nicht möglich, da Radiowellen bereits nach wenigen Metern im Wasser stark an Intensität verlieren. Daher müssen neue Ansätze für die Unterwasserlokalisierung entwickelt werden die sich auch für Fahrzeugenverbände skalieren lassen. Der Einsatz von AUV-Teams ermöglicht nicht nur völlig neue Möglichkeiten der Kooperation, sondern erlaubt auch jedem einzelnen AUV von den Navigationsdaten der anderen Fahrzeuge im Verband zu profitieren, um die eigene Lokalisierung zu verbessern. In dieser Arbeit wird ein kooperativer Lokalisierungsansatz vorgestellt, welcher auf dem Nachrichtenaustausch durch akustische Ultra-Short Base-Line (USBL) Modems basiert. Ein akustisches Modem ermöglicht die Übertragung von Datenpaketen im Wasser, wärend ein USBL-Sensor die Richtung einer akustischen Quelle bestimmen kann. Durch die Kombination von Modem und Sensor entsteht ein wichtiges Messinstrument für die Unterwasserlokalisierung. Wenn ein Fahrzeug ein Datenpaket mit seiner eignen Position aussendet, können andere Fahrzeuge mit einem USBL-Modem diese Nachricht empfangen. In Verbindung mit der Richtungsmessung zur Quelle, können diese Daten von einem Empfangenden AUV verwendet werden, um seine eigene Positionsschatzung zu verbessern. Diese Arbeit schlägt einen Ansatz zur Fusionierung der empfangenen Nachricht mit der Richtungsmessung vor, welcher auch die jeweiligen Messungenauigkeiten berücksichtigt. Um die Messungenauigkeit des komplexen USBL-Sensors bestimmen zu können, wurde zudem ein detailliertes Sensormodell entwickelt. Zunächst wurden existierende Ansätze zur kooperativen Lokalisierung (CL) untersucht, um daraus eine Liste von erwünschten Eigenschaften für eine CL abzuleiten. Darauf aufbauend wurde der Deep-Sea Network Lokalisation (DNL) Ansatz entwickelt. Bei DNL handelt es sich um eine CL Methode, bei der die Skalierbarkeit sowie die praktische Anwendbarkeit im Fokus stehen. DNL ist als eine Zwischenschicht konzipiert, welche USBL-Modem und Navigationssystem miteinander verbindet. Es werden dabei Messwerte und Kommunikationsdaten des USBL zu einer Standortbestimmung inklusive Richtungsschätzung fusioniert und an das Navigationssystem weiter geleitet, ähnlich einem GPS-Sensor. Die Funktionalität von USBL-Modell und DNL konnten evaluiert werden anhand von Messdaten aus Seeerprobungen in der Ostsee sowie im Mittelatlantik. Die Qualität einer CL hangt häufig von vielen unterschiedlichen Faktoren ab. Die Netzwerktopologie muss genauso berücksichtig werden wie die Lokalisierungsfähigkeiten jedes einzelnen Teilnehmers. Auch das Kommunikationsverhalten der einzelnen Teilnehmer bestimmt, welche Informationen im Netzwerk vorhanden sind und hat somit einen starken Einfluss auf die CL. Um diese Einflussfaktoren zu untersuchen, wurden eine Reihe von Szenarien simuliert, in denen Kommunikationsverhalten und Netzwerktopologie für eine Gruppe von AUVs variiert wurden. In diesen Experimenten wurden die AUVs durch ein Oberflächenfahrzeug unterstützt, welches seine geo-referenzierte Position über DNL an die getauchten Fahrzeuge weiter leitete. Anhand der untersuchten Topologie können die Experimente eingeteilt werden in Single-Hop und Multi-Hop. Single-Hop bedeutet, dass jedes AUV sich in der Sendereichweite des Oberflächenfahrzeugs befindet und dessen Positionsdaten auf direktem Wege erhält. Wie die Ergebnisse der Single-Hop Experimente zeigen, kann der Lokalisierungsfehler der AUVs eingegrenzt werden, wenn man DNL verwendet. Dabei korreliert der Lokalisierungsfehler mit der kombinierten Ungenauigkeit von USBL-Messung und Oberflächenfahrzeugposition. Bei den Multi-Hop Experimenten wurde die Topologie so geändert, dass sich nur eines der AUVs in direkter Sendereichweite des Oberflächenfahrzeugs befindet. Dieses AUV verbessert seine Position mit den empfangen Daten des Oberflächenfahrzeugs und sendet wiederum seine verbesserte Position an die anderen AUVs. Auch hier konnte gezeigt werden, dass sich der Lokalisierungfehler der Gruppe mit DNL einschränken lässt. Ändert man nun das Schema der Kommunikation so, dass alle AUVs zyklisch ihre Position senden, zeigte sich eine Verschlechterung der Lokalisierungsqualität der Gruppe. Dieses unerwartet Ergebnis konnte auf einen Teil des DNL-Algorithmus zurück geführt werden. Da die verwendete USBL-Klasse nur die Richtung eines Signals misst, nicht jedoch die Entfernung zum Sender, wird in der DNL-Schicht eine Entfernungsschatzung vorgenommen. Wenn die Kommunikation nicht streng unidirektional ist, entsteht eine Ruckkopplungsschleife, was zu fehlerhaften Entfernungsschatzungen führt. Im letzten Experiment wird gezeigt wie sich dieses Problem vermeiden lasst, mithilfe einer relativ neue USBL-Klasse, die sowohl Richtung als auch Entfernung zum Sender misst. Die zwei wesentlichen Beiträge dieser Arbeit sind das USBL-Model zum einen und zum Anderen, der neue kooperative Lokalisierungsansatz DNL. Mithilfe des Sensormodels lassen sich nicht nur Messabweichungen einer USBL-Messung bestimmen, es kann auch dazu genutzt werden, einige Fehlereinflüsse zu korrigieren. Mit DNL wurde eine skalierbare CL-Methode entwickelt, die sich gut für den den Einsatz bei mobilen Unterwassersensornetzwerken eignet. Durch das Konzept als Zwischenschicht, lasst sich DNL einfach in bestehende Navigationslösungen integrieren, um die Langzeitstabilität der Navigation für große Verbände von tiefgetauchten Fahrzeugen zu gewährleisten. Sowohl USBL-Model als auch DNL sind dabei so ressourcenschonend, dass sie auf dem Computer eines Standard USBL laufen können, ohne die ursprüngliche Funktionalität einzuschränken, was den praktischen Einsatz zusätzlich vereinfacht

Opportunistic timing signals for pervasive mobile localization

Mención Internacional en el título de doctorThe proliferation of handheld devices and the pressing need of location-based services call for precise and accurate ubiquitous geographic mobile positioning that can serve a vast set of devices. Despite the large investments and efforts in academic and industrial communities, a pin-point solution is however still far from reality. Mobile devices mainly rely on Global Navigation Satellite System (GNSS) to position themselves. GNSS systems are known to perform poorly in dense urban areas and indoor environments, where the visibility of GNSS satellites is reduced drastically. In order to ensure interoperability between the technologies used indoor and outdoor, a pervasive positioning system should still rely on GNSS, yet complemented with technologies that can guarantee reliable radio signals in indoor scenarios. The key fact that we exploit is that GNSS signals are made of data with timing information. We then investigate solutions where opportunistic timing signals can be extracted out of terrestrial technologies. These signals can then be used as additional inputs of the multi-lateration problem. Thus, we design and investigate a hybrid system that combines range measurements from the Global Positioning System (GPS), the world’s most utilized GNSS system, and terrestrial technologies; the most suitable one to consider in our investigation is WiFi, thanks to its large deployment in indoor areas. In this context, we first start investigating standalone WiFi Time-of-flight (ToF)-based localization. Time-of-flight echo techniques have been recently suggested for ranging mobile devices overWiFi radios. However, these techniques have yielded only moderate accuracy in indoor environments because WiFi ToF measurements suffer from extensive device-related noise which makes it challenging to differentiate between direct path from non-direct path signal components when estimating the ranges. Existing multipath mitigation techniques tend to fail at identifying the direct path when the device-related Gaussian noise is in the same order of magnitude, or larger than the multipath noise. In order to address this challenge, we propose a new method for filtering ranging measurements that is better suited for the inherent large noise as found in WiFi radios. Our technique combines statistical learning and robust statistics in a single filter. The filter is lightweight in the sense that it does not require specialized hardware, the intervention of the user, or cumbersome on-site manual calibration. This makes the method we propose as the first contribution of the present work particularly suitable for indoor localization in large-scale deployments using existing legacy WiFi infrastructures. We evaluate our technique for indoor mobile tracking scenarios in multipath environments, and, through extensive evaluations across four different testbeds covering areas up to 1000m2, the filter is able to achieve a median ranging error between 1:7 and 2:4 meters. The next step we envisioned towards preparing theoretical and practical basis for the aforementioned hybrid positioning system is a deep inspection and investigation of WiFi and GPS ToF ranges, and initial foundations of single-technology self-localization. Self-localization systems based on the Time-of-Flight of radio signals are highly susceptible to noise and their performance therefore heavily rely on the design and parametrization of robust algorithms. We study the noise sources of GPS and WiFi ToF ranging techniques and compare the performance of different selfpositioning algorithms at a mobile node using those ranges. Our results show that the localization error varies greatly depending on the ranging technology, algorithm selection, and appropriate tuning of the algorithms. We characterize the localization error using real-world measurements and different parameter settings to provide guidance for the design of robust location estimators in realistic settings. These tools and foundations are necessary to tackle the problem of hybrid positioning system providing high localization capabilities across indoor and outdoor environments. In this context, the lack of a single positioning system that is able the fulfill the specific requirements of diverse indoor and outdoor applications settings has led the development of a multitude of localization technologies. Existing mobile devices such as smartphones therefore commonly rely on a multi-RAT (Radio Access Technology) architecture to provide pervasive location information in various environmental contexts as the user is moving. Yet, existing multi-RAT architectures consider the different localization technologies as monolithic entities and choose the final navigation position from the RAT that is foreseen to provide the highest accuracy in the particular context. In contrast, we propose in this work to fuse timing range (Time-of-Flight) measurements of diverse radio technologies in order to circumvent the limitations of the individual radio access technologies and improve the overall localization accuracy in different contexts. We introduce an Extended Kalman filter, modeling the unique noise sources of each ranging technology. As a rich set of multiple ranges can be available across different RATs, the intelligent selection of the subset of ranges with accurate timing information is critical to achieve the best positioning accuracy. We introduce a novel geometrical-statistical approach to best fuse the set of timing ranging measurements. We also address practical problems of the design space, such as removal of WiFi chipset and environmental calibration to make the positioning system as autonomous as possible. Experimental results show that our solution considerably outperforms the use of monolithic technologies and methods based on classical fault detection and identification typically applied in standalone GPS technology. All the contributions and research questions described previously in localization and positioning related topics suppose full knowledge of the anchors positions. In the last part of this work, we study the problem of deriving proximity metrics without any prior knowledge of the positions of the WiFi access points based on WiFi fingerprints, that is, tuples of WiFi Access Points (AP) and respective received signal strength indicator (RSSI) values. Applications that benefit from proximity metrics are movement estimation of a single node over time, WiFi fingerprint matching for localization systems and attacks on privacy. Using a large-scale, real-world WiFi fingerprint data set consisting of 200,000 fingerprints resulting from a large deployment of wearable WiFi sensors, we show that metrics from related work perform poorly on real-world data. We analyze the cause for this poor performance, and show that imperfect observations of APs with commodity WiFi clients in the neighborhood are the root cause. We then propose improved metrics to provide such proximity estimates, without requiring knowledge of location for the observed AP. We address the challenge of imperfect observations of APs in the design of these improved metrics. Our metrics allow to derive a relative distance estimate based on two observed WiFi fingerprints. We demonstrate that their performance is superior to the related work metrics.This work has been supported by IMDEA Networks InstitutePrograma Oficial de Doctorado en Ingeniería TelemáticaPresidente: Francisco Barceló Arroyo.- Secretario: Paolo Casari.- Vocal: Marco Fior

Artificial Intelligence-Assisted Inertial Geomagnetic Passive Navigation

In recent years, the integration of machine learning techniques into navigation systems has garnered significant interest due to their potential to improve estimation accuracy and system robustness. This doctoral dissertation investigates the use of Deep Learning combined with a Rao-Blackwellized Particle Filter for enhancing geomagnetic navigation in airborne simulated missions. A simulation framework is developed to facilitate the evaluation of the proposed navigation system. This framework includes a detailed aircraft model, a mathematical representation of the Earth\u27s magnetic field, and the incorporation of real-world magnetic field data obtained from online databases. The setup allows an accurate assessment of the performance and effectiveness of the proposed Geomagentic architecture in diverse and realistic geomagnetic scenarios. The results of this research demonstrate the potential of Machine Learning algorithms in improving the performance of the sensor fusion filter for geomagnetic navigation, and introduces a novel approach for resolution enhancing of available geomagnetic models, which provides a better description of the magnetic features within these models. The integration leads to more accurate and robust inertial guidance in airborne missions, thus paving the way for advanced, reliable navigation systems for a variety of aerial vehicles. Overall, this dissertation contributes to the state-of-the-art in geomagnetic navigation research by offering a novel approach to integrating machine learning techniques with traditional estimation methods, with a novel technique to obtain more accurate geomagnetic models required within these navigation architectures. The findings of this work hold promise for the development of advanced, adaptive navigation systems for both civilian and military aviation applications