A 6-DOF haptic manipulation system to verify assembly procedures on CAD models

During the design phase of products and before going into production, it is necessary to verify the presence of mechanical plays, tolerances, and encumbrances on production mockups. This work introduces a multi-modal system that allows verifying assembly procedures of products in Virtual Reality starting directly from CAD models. Thus leveraging the costs and speeding up the assessment phase in product design. For this purpose, the design of a novel 6-DOF Haptic device is presented. The achieved performance of the system has been validated in a demonstration scenario employing state-of-the-art volumetric rendering of interaction forces together with a stereoscopic visualization setup

Advances towards behaviour-based indoor robotic exploration

215 p.The main contributions of this research work remain in object recognition by computer vision, by one side, and in robot localisation and mapping by the other. The first contribution area of the research address object recognition in mobile robots. In this area, door handle recognition is of great importance, as it help the robot to identify doors in places where the camera is not able to view the whole door. In this research, a new two step algorithm is presented based on feature extraction that aimed at improving the extracted features to reduce the superfluous keypoints to be compared at the same time that it increased its efficiency by improving accuracy and reducing the computational time. Opposite to segmentation based paradigms, the feature extraction based two-step method can easily be generalized to other types of handles or even more, to other type of objects such as road signals. Experiments have shown very good accuracy when tested in real environments with different kind of door handles. With respect to the second contribution, a new technique to construct a topological map during the exploration phase a robot would perform on an unseen office-like environment is presented. Firstly a preliminary approach proposed to merge the Markovian localisation in a distributed system, which requires low storage and computational resources and is adequate to be applied in dynamic environments. In the same area, a second contribution to terrain inspection level behaviour based navigation concerned to the development of an automatic mapping method for acquiring the procedural topological map. The new approach is based on a typicality test called INCA to perform the so called loop-closing action. The method was integrated in a behaviour-based control architecture and tested in both, simulated and real robot/environment system. The developed system proved to be useful also for localisation purpose

Antenas setoriais para sistemas de localização em redes de sensores sem fios

Doutoramento em Engenharia EletrotécnicaThis work investigates low cost localization systems (LS) based on received signal strength (RSS) and integrated with different types of antennas with main emphasis on sectorial antennas. The last few years have witnessed an outstanding growth in wireless sensor networks (WSN). Among its various possible applications, the localization field became a major area of research. The localization techniques based on RSS are characterized by simplicity and low cost of integration. The integration of LS based on RSS and sectorial antennas (SA) was proven to provide an effective solution for reducing the number of required nodes of the networks and allows the combination of several techniques, such as RSS and angle of arrival (AoA). This PhD thesis focuses on studying techniques, antennas and protocols that best meet the needs of each LS with main focus on low cost systems based on RSS and AoA. Firstly there are studied localization techniques and system that best suit the requirements of the user and the antennas that are most appropriate according to the nature of the signal. In this step it is intended to provide a fundamental understanding of the undertaken work. Then the developed antennas are presented according to the following categories: sectorial and microstrip antennas. Two sectorial antennas are presented: a narrowband antenna operating at 2.4 to 2.5 GHz and a broadband antenna operating at 800MHz-2.4GHz. The low cost printed antennas were designed to operate at 5 GHz, which may be used for vehicular communication. After presenting the various antennas, several prototypes of indoor/outdoor LS are implemented and analyzed. Localization protocols are also proposed, one based on simplicity and low power, and the other on interoperability with different types of antennas and system requirements.O presente trabalho investiga sistemas de localização (SL) de baixo custo baseados na intensidade do sinal (RSS) e integrados com diferentes tipos de antenas com principal destaque para antenas sectoriais. Os últimos anos testemunharam um crescimento surpreendente de redes de sensores sem fios (RSSF), onde entre diversas aplicações possíveis, a localização tornou-se uma das principais áreas de pesquisa. Técnicas baseadas na intensidade do sinal caracterizam-se pela simplicidade e baixo custo de integração. A integração de SL baseados na intensidade do sinal recebido e antenas sectoriais (AS) oferecem uma solução eficaz para reduzir o número de nós necessários e para combinar diversas técnicas de localização. Esta tese de doutoramento foca-se no estudado de técnicas, antenas e protocolos de acordo com os requisitos de cada sistema localização com especial atenção para sistemas de baixo custo baseados na intensidade do sinal e no ângulo de chegada. Inicialmente são estudadas técnicas e SL de acordo com as necessidades do utilizador e as antenas que melhor se enquadram de acordo com a natureza do sinal. Esta etapa tem como objectivo proporcionar a compreensão fundamental do trabalho desenvolvido. Em seguida são apresentadas as antenas desenvolvidas divididas em: antenas sectorias e antenas impressas de baixo custo. Duas antenas sectoriais são apresentadas: uma de banda estreita a operar a 2,4-2,5GHz e outro de banda larga 800MHz-2.4GHz. As antenas impressas foram desenvolvidas para operar a 5 GHz, pelo que podem ser utilizadas para comunicação veicular. Após apresentação das diversas antenas vários protótipos de SL interiores/exteriores são implementados e analisados. Protocolos de localização são também propostos, um baseado na simplicidade e baixo consumo, outro na interoperabilidade com diferentes tipos de antenas e requisitos do sistema

Theory, Design, and Implementation of Landmark Promotion Cooperative Simultaneous Localization and Mapping

Simultaneous Localization and Mapping (SLAM) is a challenging problem in practice, the use of multiple robots and inexpensive sensors poses even more demands on the designer. Cooperative SLAM poses specific challenges in the areas of computational efficiency, software/network performance, and robustness to errors. New methods in image processing, recursive filtering, and SLAM have been developed to implement practical algorithms for cooperative SLAM on a set of inexpensive robots. The Consolidated Unscented Mixed Recursive Filter (CUMRF) is designed to handle non-linear systems with non-Gaussian noise. This is accomplished using the Unscented Transform combined with Gaussian Mixture Models. The Robust Kalman Filter is an extension of the Kalman Filter algorithm that improves the ability to remove erroneous observations using Principal Component Analysis (PCA) and the X84 outlier rejection rule. Forgetful SLAM is a local SLAM technique that runs in nearly constant time relative to the number of visible landmarks and improves poor performing sensors through sensor fusion and outlier rejection. Forgetful SLAM correlates all measured observations, but stops the state from growing over time. Hierarchical Active Ripple SLAM (HAR-SLAM) is a new SLAM architecture that breaks the traditional state space of SLAM into a chain of smaller state spaces, allowing multiple robots, multiple sensors, and multiple updates to occur in linear time with linear storage with respect to the number of robots, landmarks, and robots poses. This dissertation presents explicit methods for closing-the-loop, joining multiple robots, and active updates. Landmark Promotion SLAM is a hierarchy of new SLAM methods, using the Robust Kalman Filter, Forgetful SLAM, and HAR-SLAM. Practical aspects of SLAM are a focus of this dissertation. LK-SURF is a new image processing technique that combines Lucas-Kanade feature tracking with Speeded-Up Robust Features to perform spatial and temporal tracking. Typical stereo correspondence techniques fail at providing descriptors for features, or fail at temporal tracking. Several calibration and modeling techniques are also covered, including calibrating stereo cameras, aligning stereo cameras to an inertial system, and making neural net system models. These methods are important to improve the quality of the data and images acquired for the SLAM process

Development and Adaptation of Robotic Vision in the Real-World: the Challenge of Door Detection

Mobile service robots are increasingly prevalent in human-centric, real-world domains, operating autonomously in unconstrained indoor environments. In such a context, robotic vision plays a central role in enabling service robots to perceive high-level environmental features from visual observations. Despite the data-driven approaches based on deep learning push the boundaries of vision systems, applying these techniques to real-world robotic scenarios presents unique methodological challenges. Traditional models fail to represent the challenging perception constraints typical of service robots and must be adapted for the specific environment where robots finally operate. We propose a method leveraging photorealistic simulations that balances data quality and acquisition costs for synthesizing visual datasets from the robot perspective used to train deep architectures. Then, we show the benefits in qualifying a general detector for the target domain in which the robot is deployed, showing also the trade-off between the effort for obtaining new examples from such a setting and the performance gain. In our extensive experimental campaign, we focus on the door detection task (namely recognizing the presence and the traversability of doorways) that, in dynamic settings, is useful to infer the topology of the map. Our findings are validated in a real-world robot deployment, comparing prominent deep-learning models and demonstrating the effectiveness of our approach in practical settings

Attention-controlled acquisition of a qualitative scene model for mobile robots

Haasch A. Attention-controlled acquisition of a qualitative scene model for mobile robots. Bielefeld (Germany): Bielefeld University; 2007.Robots that are used to support humans in dangerous environments, e.g., in manufacture facilities, are established for decades. Now, a new generation of service robots is focus of current research and about to be introduced. These intelligent service robots are intended to support humans in everyday life. To achieve a most comfortable human-robot interaction with non-expert users it is, thus, imperative for the acceptance of such robots to provide interaction interfaces that we humans are accustomed to in comparison to human-human communication. Consequently, intuitive modalities like gestures or spontaneous speech are needed to teach the robot previously unknown objects and locations. Then, the robot can be entrusted with tasks like fetch-and-carry orders even without an extensive training of the user. In this context, this dissertation introduces the multimodal Object Attention System which offers a flexible integration of common interaction modalities in combination with state-of-the-art image and speech processing techniques from other research projects. To prove the feasibility of the approach the presented Object Attention System has successfully been integrated in different robotic hardware. In particular, the mobile robot BIRON and the anthropomorphic robot BARTHOC of the Applied Computer Science Group at Bielefeld University. Concluding, the aim of this work, to acquire a qualitative Scene Model by a modular component offering object attention mechanisms, has been successfully achieved as demonstrated on numerous occasions like reviews for the EU-integrated Project COGNIRON or demos

The Future of Humanoid Robots

This book provides state of the art scientific and engineering research findings and developments in the field of humanoid robotics and its applications. It is expected that humanoids will change the way we interact with machines, and will have the ability to blend perfectly into an environment already designed for humans. The book contains chapters that aim to discover the future abilities of humanoid robots by presenting a variety of integrated research in various scientific and engineering fields, such as locomotion, perception, adaptive behavior, human-robot interaction, neuroscience and machine learning. The book is designed to be accessible and practical, with an emphasis on useful information to those working in the fields of robotics, cognitive science, artificial intelligence, computational methods and other fields of science directly or indirectly related to the development and usage of future humanoid robots. The editor of the book has extensive R&D experience, patents, and publications in the area of humanoid robotics, and his experience is reflected in editing the content of the book

Advances in Stereo Vision

Stereopsis is a vision process whose geometrical foundation has been known for a long time, ever since the experiments by Wheatstone, in the 19th century. Nevertheless, its inner workings in biological organisms, as well as its emulation by computer systems, have proven elusive, and stereo vision remains a very active and challenging area of research nowadays. In this volume we have attempted to present a limited but relevant sample of the work being carried out in stereo vision, covering significant aspects both from the applied and from the theoretical standpoints