Robot Navigation in Distorted Magnetic Fields

This thesis investigates the utilization of magnetic field distortions for the localization and navigation of robotic systems. The work comprehensively illuminates the various aspects that are relevant in this context. Among other things, the characteristics of magnetic field environments are assessed and examined for their usability for robot navigation in various typical mobile robot deployment scenarios. A strong focus of this work lies in the self-induced static and dynamic magnetic field distortions of complex kinematic robots, which could hinder the use of magnetic fields because of their interference with the ambient magnetic field. In addition to the examination of typical distortions in robots of different classes, solutions for compensation and concrete tools are developed both in hardware (distributed magnetometer sensor systems) and in software. In this context, machine learning approaches for learning static and dynamic system distortions are explored and contrasted with classical methods for calibrating magnetic field sensors. In order to extend probabilistic state estimation methods towards the localization in magnetic fields, a measurement model based on Mises-Fisher distributions is developed in this thesis. Finally, the approaches of this work are evaluated in practice inside and outside the laboratory in different environments and domains (e.g. office, subsea, desert, etc.) with different types of robot systems

Autonomous landing of fixed-wing aircraft on mobile platforms

E n esta tesis se propone un nuevo sistema que permite la operación de aeronaves autónomas sin tren de aterrizaje. El trabajo está motivado por el interés industrial en aeronaves con la capacidad de volar a gran altitud, con más capacidad de carga útil y capaces de aterrizar con viento cruzado. El enfoque seguido en este trabajo consiste en eliminar el sistema de aterrizaje de una aeronave de ala fija empleando una plataforma móvil de aterrizaje en tierra. La aeronave y la plataforma deben sincronizar su movimiento antes del aterrizaje, lo que se logra mediante la estimación del estado relativo entre ambas y el control cooperativo del movimiento. El objetivo principal de esta Tesis es el desarrollo de una solución práctica para el aterrizaje autónomo de una aeronave de ala fija en una plataforma móvil. En la tesis se combinan nuevos métodos con experimentos prácticos para los cuales se ha desarrollado un sistema de pruebas específico. Se desarrollan dos variantes diferentes del sistema de aterrizaje. El primero presta atención especial a la seguridad, es robusto ante retrasos en la comunicación entre vehículos y cumple procedimientos habituales de aterrizaje, al tiempo que reduce la complejidad del sistema. En el segundo se utilizan trayectorias optimizadas del vehículo y sincronización bilateral de posición para maximizar el rendimiento del aterrizaje en términos de requerimientos de longitud necesaria de pista, pero la estabilidad es dependiente del retraso de tiempo, con lo cual es necesario desarrollar un controlador estabilizador ampliado, basado en pasividad, que permite resolver este problema. Ambas estrategias imponen requisitos funcionales a los controladores de cada uno de los vehículos, lo que implica la capacidad de controlar el movimiento longitudinal sin afectar el control lateral o vertical, y viceversa. El control de vuelo basado en energía se utiliza para proporcionar dicha funcionalidad a la aeronave. Los sistemas de aterrizaje desarrollados se han analizado en simulación estableciéndose los límites de rendimiento mediante múltiples repeticiones aleatorias. Se llegó a la conclusión de que el controlador basado en seguridad proporciona un rendimiento de aterrizaje satisfactorio al tiempo que suministra una mayor seguridad operativa y un menor esfuerzo de implementación y certificación. El controlador basado en el rendimiento es prometedor para aplicaciones con una longitud de pista limitada. Se descubrió que los beneficios del controlador basado en el rendimiento son menos pronunciados para una dinámica de vehículos terrestres más lenta. Teniendo en cuenta la dinámica lenta de la configuración del demostrador, se eligió el enfoque basado en la seguridad para los primeros experimentos de aterrizaje. El sistema de aterrizaje se validó en diversas pruebas de aterrizaje exitosas, que, a juicio del autor, son las primeras en el mundo realizadas con aeronaves reales. En última instancia, el concepto propuesto ofrece importantes beneficios y constituye una estrategia prometedora para futuras soluciones de aterrizaje de aeronaves.In this thesis a new landing system is proposed, which allows for the operation of autonomous aircraft without landing gear. The work was motivated by the industrial need for more capable high altitude aircraft systems, which typically suffer from low payload capacity and high crosswind landing sensitivity. The approach followed in this work consists in removing the landing gear system from the aircraft and introducing a mobile ground-based landing platform. The vehicles must synchronize their motion prior to landing, which is achieved through relative state estimation and cooperative motion control. The development of a practical solution for the autonomous landing of an aircraft on a moving platform thus constitutes the main goal of this thesis. Therefore, theoretical investigations are combined with real experiments for which a special setup is developed and implemented. Two different landing system variants are developed — the safety-based landing system is robust to inter-vehicle communication delays and adheres to established landing procedures, while reducing system complexity. The performance-based landing system uses optimized vehicle trajectories and bilateral position synchronization to maximize landing performance in terms of used runway, but suffers from time delay-dependent stability. An extended passivity-based stabilizing controller was implemented to cope with this issue. Both strategies impose functional requirements on the individual vehicle controllers, which imply independent controllability of the translational degrees of freedom. Energy-based flight control is utilized to provide such functionality for the aircraft. The developed landing systems are analyzed in simulation and performance bounds are determined by means of repeated random sampling. The safety-based controller was found to provide satisfactory landing performance while providing higher operational safety, and lower implementation and certification effort. The performance-based controller is promising for applications with limited runway length. The performance benefits were found to be less pronounced for slower ground vehicle dynamics. Given the slow dynamics of the demonstrator setup, the safety-based approach was chosen for first landing experiments. The landing system was validated in a number of successful landing trials, which to the author’s best knowledge was the first time such technology was demonstrated on the given scale, worldwide. Ultimately, the proposed concept offers decisive benefits and constitutes a promising strategy for future aircraft landing solutions

Heading drift mitigation for low-cost inertial pedestrian navigation

The concept of autonomous pedestrian navigation is often adopted for indoor pedestrian navigation. For outdoors, a Global Positioning System (GPS) is often used for navigation by utilizing GPS signals for position computation but indoors, its signals are often unavailable. Therefore, autonomous pedestrian navigation for indoors can be realized with the use of independent sensors, such as low-cost inertial sensors, and these sensors are often known as Inertial Measurement Unit (IMU) where they do not rely on the reception of external information such as GPS signals. Using these sensors, a relative positioning concept from initialized position and attitude is used for navigation. The sensors sense the change in velocity and after integration, it is added to the previous position to obtain the current position. Such low-cost systems, however, are prone to errors that can result in a large position drift. This problem can be minimized by mounting the sensors on the pedestrian’s foot. During walking, the foot is briefly stationary while it is on the ground, sometimes called the zero-velocity period. If a non-zero velocity is then measured by the inertial sensors during this period, it is considered as an error and thus can be corrected. These repeated corrections to the inertial sensor’s velocity measurements can, therefore, be used to control the error growth and minimize the position drift. Nonetheless, it is still inadequate, mainly due to the remaining errors on the inertial sensor’s heading when the velocity corrections are used alone. Apart from the initialization issue, therefore, the heading drift problem still remains in such low-cost systems. In this research, two novel methods are developed and investigated to mitigate the heading drift problem when used with the velocity updates. The first method is termed Cardinal Heading Aided Inertial Navigation (CHAIN), where an algorithm is developed to use building ‘heading’ to aid the heading measurement in the Kalman Filter. The second method is termed the Rotated IMU (RIMU), where the foot-mounted inertial sensor is rotated about a single axis to increase the observability of the sensor’s heading. For the CHAIN, the method proposed has been investigated with real field trials using the low-cost Microstrain 3DM-GX3-25 inertial sensor. It shows a clear improvement in mitigating the heading drift error. It offers significant improvement in navigation accuracy for a long period, allowing autonomous pedestrian navigation for as long as 40 minutes with below 5 meters position error between start and end position. It does not require any extra heading sensors, such as a magnetometer or visual sensors such as a camera nor an extensive position or map database, and thus offers a cost-effective solution. Furthermore, its simplicity makes it feasible for it to be implemented in real-time, as very little computing capability is needed. For the RIMU, the method was tested with Nottingham Geospatial Institute (NGI) inertial data simulation software. Field trials were also undertaken using the same low-cost inertial sensor, mounted on a rotated platform prototype. This method improves the observability of the inertial sensor’s errors, resulting also in a decrease in the heading drift error at the expense of requiring extra components

Heading drift mitigation for low-cost inertial pedestrian navigation

The concept of autonomous pedestrian navigation is often adopted for indoor pedestrian navigation. For outdoors, a Global Positioning System (GPS) is often used for navigation by utilizing GPS signals for position computation but indoors, its signals are often unavailable. Therefore, autonomous pedestrian navigation for indoors can be realized with the use of independent sensors, such as low-cost inertial sensors, and these sensors are often known as Inertial Measurement Unit (IMU) where they do not rely on the reception of external information such as GPS signals. Using these sensors, a relative positioning concept from initialized position and attitude is used for navigation. The sensors sense the change in velocity and after integration, it is added to the previous position to obtain the current position. Such low-cost systems, however, are prone to errors that can result in a large position drift. This problem can be minimized by mounting the sensors on the pedestrian’s foot. During walking, the foot is briefly stationary while it is on the ground, sometimes called the zero-velocity period. If a non-zero velocity is then measured by the inertial sensors during this period, it is considered as an error and thus can be corrected. These repeated corrections to the inertial sensor’s velocity measurements can, therefore, be used to control the error growth and minimize the position drift. Nonetheless, it is still inadequate, mainly due to the remaining errors on the inertial sensor’s heading when the velocity corrections are used alone. Apart from the initialization issue, therefore, the heading drift problem still remains in such low-cost systems. In this research, two novel methods are developed and investigated to mitigate the heading drift problem when used with the velocity updates. The first method is termed Cardinal Heading Aided Inertial Navigation (CHAIN), where an algorithm is developed to use building ‘heading’ to aid the heading measurement in the Kalman Filter. The second method is termed the Rotated IMU (RIMU), where the foot-mounted inertial sensor is rotated about a single axis to increase the observability of the sensor’s heading. For the CHAIN, the method proposed has been investigated with real field trials using the low-cost Microstrain 3DM-GX3-25 inertial sensor. It shows a clear improvement in mitigating the heading drift error. It offers significant improvement in navigation accuracy for a long period, allowing autonomous pedestrian navigation for as long as 40 minutes with below 5 meters position error between start and end position. It does not require any extra heading sensors, such as a magnetometer or visual sensors such as a camera nor an extensive position or map database, and thus offers a cost-effective solution. Furthermore, its simplicity makes it feasible for it to be implemented in real-time, as very little computing capability is needed. For the RIMU, the method was tested with Nottingham Geospatial Institute (NGI) inertial data simulation software. Field trials were also undertaken using the same low-cost inertial sensor, mounted on a rotated platform prototype. This method improves the observability of the inertial sensor’s errors, resulting also in a decrease in the heading drift error at the expense of requiring extra components

Aerial Robotics for Inspection and Maintenance

Aerial robots with perception, navigation, and manipulation capabilities are extending the range of applications of drones, allowing the integration of different sensor devices and robotic manipulators to perform inspection and maintenance operations on infrastructures such as power lines, bridges, viaducts, or walls, involving typically physical interactions on flight. New research and technological challenges arise from applications demanding the benefits of aerial robots, particularly in outdoor environments. This book collects eleven papers from different research groups from Spain, Croatia, Italy, Japan, the USA, the Netherlands, and Denmark, focused on the design, development, and experimental validation of methods and technologies for inspection and maintenance using aerial robots

Inertial Motion Tracking for Inserting Humans into a Networked Synthetic Environment

Inertial/Magnetic tracking is based on the use of sensors containing three orthogonally mounted angular rate sensors, three orthogonal linear accelerometers and three orthogonal magnetometers to determine independently the orientation of each link of an articulated rigid body. Inertial/magnetic orientation tracking could be applied to a broad range of problems which require real-time tracking of an articulated structure without being continuously dependent upon an artificially generated source. This research focuses on the goal of developing and demonstrating wireless full body tracking using MARG sensor modules.U.S. Army Research OfficeW911NF-04-1-030

Bio-Inspired Robotics

Modern robotic technologies have enabled robots to operate in a variety of unstructured and dynamically-changing environments, in addition to traditional structured environments. Robots have, thus, become an important element in our everyday lives. One key approach to develop such intelligent and autonomous robots is to draw inspiration from biological systems. Biological structure, mechanisms, and underlying principles have the potential to provide new ideas to support the improvement of conventional robotic designs and control. Such biological principles usually originate from animal or even plant models, for robots, which can sense, think, walk, swim, crawl, jump or even fly. Thus, it is believed that these bio-inspired methods are becoming increasingly important in the face of complex applications. Bio-inspired robotics is leading to the study of innovative structures and computing with sensory–motor coordination and learning to achieve intelligence, flexibility, stability, and adaptation for emergent robotic applications, such as manipulation, learning, and control. This Special Issue invites original papers of innovative ideas and concepts, new discoveries and improvements, and novel applications and business models relevant to the selected topics of ``Bio-Inspired Robotics''. Bio-Inspired Robotics is a broad topic and an ongoing expanding field. This Special Issue collates 30 papers that address some of the important challenges and opportunities in this broad and expanding field

Multimodal, Embodied and Location-Aware Interaction

This work demonstrates the development of mobile, location-aware, eyes-free applications which utilise multiple sensors to provide a continuous, rich and embodied interaction. We bring together ideas from the fields of gesture recognition, continuous multimodal interaction, probability theory and audio interfaces to design and develop location-aware applications and embodied interaction in both a small-scale, egocentric body-based case and a large-scale, exocentric `world-based' case. BodySpace is a gesture-based application, which utilises multiple sensors and pattern recognition enabling the human body to be used as the interface for an application. As an example, we describe the development of a gesture controlled music player, which functions by placing the device at different parts of the body. We describe a new approach to the segmentation and recognition of gestures for this kind of application and show how simulated physical model-based interaction techniques and the use of real world constraints can shape the gestural interaction. GpsTunes is a mobile, multimodal navigation system equipped with inertial control that enables users to actively explore and navigate through an area in an augmented physical space, incorporating and displaying uncertainty resulting from inaccurate sensing and unknown user intention. The system propagates uncertainty appropriately via Monte Carlo sampling and output is displayed both visually and in audio, with audio rendered via granular synthesis. We demonstrate the use of uncertain prediction in the real world and show that appropriate display of the full distribution of potential future user positions with respect to sites-of-interest can improve the quality of interaction over a simplistic interpretation of the sensed data. We show that this system enables eyes-free navigation around set trajectories or paths unfamiliar to the user for varying trajectory width and context. We demon- strate the possibility to create a simulated model of user behaviour, which may be used to gain an insight into the user behaviour observed in our field trials. The extension of this application to provide a general mechanism for highly interactive context aware applications via density exploration is also presented. AirMessages is an example application enabling users to take an embodied approach to scanning a local area to find messages left in their virtual environment