Learning Matchable Image Transformations for Long-term Metric Visual Localization

Long-term metric self-localization is an essential capability of autonomous mobile robots, but remains challenging for vision-based systems due to appearance changes caused by lighting, weather, or seasonal variations. While experience-based mapping has proven to be an effective technique for bridging the `appearance gap,' the number of experiences required for reliable metric localization over days or months can be very large, and methods for reducing the necessary number of experiences are needed for this approach to scale. Taking inspiration from color constancy theory, we learn a nonlinear RGB-to-grayscale mapping that explicitly maximizes the number of inlier feature matches for images captured under different lighting and weather conditions, and use it as a pre-processing step in a conventional single-experience localization pipeline to improve its robustness to appearance change. We train this mapping by approximating the target non-differentiable localization pipeline with a deep neural network, and find that incorporating a learned low-dimensional context feature can further improve cross-appearance feature matching. Using synthetic and real-world datasets, we demonstrate substantial improvements in localization performance across day-night cycles, enabling continuous metric localization over a 30-hour period using a single mapping experience, and allowing experience-based localization to scale to long deployments with dramatically reduced data requirements.Comment: In IEEE Robotics and Automation Letters (RA-L) and presented at the IEEE International Conference on Robotics and Automation (ICRA'20), Paris, France, May 31-June 4, 202

Generation of dynamic motion for anthropomorphic systems under prioritized equality and inequality constraints

In this paper, we propose a solution to compute full-dynamic motions for a humanoid robot, accounting for various kinds of constraints such as dynamic balance or joint limits. As a first step, we propose a unification of task-based control schemes, in inverse kinematics or inverse dynamics. Based on this unification, we generalize the cascade of quadratic programs that were developed for inverse kinematics only. Then, we apply the solution to generate, in simulation, wholebody motions for a humanoid robot in unilateral contact with the ground, while ensuring the dynamic balance on a non horizontal surface

Discrete Cosserat Approach for Multi-Section Soft Robots Dynamics

In spite of recent progress, soft robotics still suffers from a lack of unified modeling framework. Nowadays, the most adopted model for the design and control of soft robots is the piece-wise constant curvature model, with its consolidated benefits and drawbacks. In this work, an alternative model for multisection soft robots dynamics is presented based on a discrete Cosserat approach, which, not only takes into account shear and torsional deformations, essentials to cope with out-of-plane external loads, but also inherits the geometrical and mechanical properties of the continuous Cosserat model, making it the natural soft robotics counterpart of the traditional rigid robotics dynamics model. The soundness of the model is demonstrated through extensive simulation and experimental results for both plane and out-of-plane motions.Comment: 13 pages, 9 figure

Dynamic whole-body motion generation under rigid contacts and other unilateral constraints

The most widely used technique for generating wholebody motions on a humanoid robot accounting for various tasks and constraints is inverse kinematics. Based on the task-function approach, this class of methods enables the coordination of robot movements to execute several tasks in parallel and account for the sensor feedback in real time, thanks to the low computation cost. To some extent, it also enables us to deal with some of the robot constraints (e.g., joint limits or visibility) and manage the quasi-static balance of the robot. In order to fully use the whole range of possible motions, this paper proposes extending the task-function approach to handle the full dynamics of the robot multibody along with any constraint written as equality or inequality of the state and control variables. The definition of multiple objectives is made possible by ordering them inside a strict hierarchy. Several models of contact with the environment can be implemented in the framework. We propose a reduced formulation of the multiple rigid planar contact that keeps a low computation cost. The efficiency of this approach is illustrated by presenting several multicontact dynamic motions in simulation and on the real HRP-2 robot

Roborobo! a Fast Robot Simulator for Swarm and Collective Robotics

Roborobo! is a multi-platform, highly portable, robot simulator for large-scale collective robotics experiments. Roborobo! is coded in C++, and follows the KISS guideline ("Keep it simple"). Therefore, its external dependency is solely limited to the widely available SDL library for fast 2D Graphics. Roborobo! is based on a Khepera/ePuck model. It is targeted for fast single and multi-robots simulation, and has already been used in more than a dozen published research mainly concerned with evolutionary swarm robotics, including environment-driven self-adaptation and distributed evolutionary optimization, as well as online onboard embodied evolution and embodied morphogenesis.Comment: 2 pages, 1 figur

An acoustic multi-touch sensing method using amplitude disturbed ultrasonic wave diffraction patterns

This paper proposes an acoustic multi-touch tactile sensing method. The proposed method is based on an amplitude disturbed ultrasonic wave diffraction pattern. An A0 Lamb wave transmitted in a thin finite copper plate is processed to provide tactile information, for one or two fingers. A touch event is localized by identifying the diffraction signals among a database of diffracted Lamb wave references. Statistic models are used to improve the localization reliability. An artificial silicone finger is used in the calibration procedure. This touch interface is evaluated as a 2-touch interface

Which activities threaten independent living of elderly when becoming problematic : inspiration for meaningful service robot functionality

Purpose: In light of the increasing elderly population and the growing demand for home care, the potential of robot support is given increasing attention. In this paper, an inventory of activities was made that threaten independent living of elderly when becoming problematic. Results will guide the further development of an existing service robot, the Care-O-bot®. Method: A systematic literature search of PubMed was performed, focused on the risk factors for institutionalization. Additionally, focus group sessions were conducted in the Netherlands, United Kingdom and France. In these focus group sessions, problematic activities threatening the independence of elderly people were discussed. Three separate target groups were included in the focus group sessions: (1) elderly persons (n = 41), (2) formal caregivers (n = 40) and (3) informal caregivers (n = 32). Results: Activities within the International Classification of Functioning domains mobility, self-care, and interpersonal interaction and relationships were found to be the most problematic. Conclusions: A distinct set of daily activities was identified that may threaten independent living, but no single activity could be selected as the main activity causing a loss of independence as it is often a combination of problematic activities that is person-specific. Supporting the problematic activities need not involve a robotic solution Read More: http://informahealthcare.com/doi/abs/10.3109/17483107.2013.840861Peer reviewe

Assistive technology design and development for acceptable robotics companions for ageing years

© 2013 Farshid Amirabdollahian et al., licensee Versita Sp. z o. o. This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivs license, which means that the text may be used for non-commercial purposes, provided credit is given to the author.A new stream of research and development responds to changes in life expectancy across the world. It includes technologies which enhance well-being of individuals, specifically for older people. The ACCOMPANY project focuses on home companion technologies and issues surrounding technology development for assistive purposes. The project responds to some overlooked aspects of technology design, divided into multiple areas such as empathic and social human-robot interaction, robot learning and memory visualisation, and monitoring persons’ activities at home. To bring these aspects together, a dedicated task is identified to ensure technological integration of these multiple approaches on an existing robotic platform, Care-O-Bot®3 in the context of a smart-home environment utilising a multitude of sensor arrays. Formative and summative evaluation cycles are then used to assess the emerging prototype towards identifying acceptable behaviours and roles for the robot, for example role as a butler or a trainer, while also comparing user requirements to achieved progress. In a novel approach, the project considers ethical concerns and by highlighting principles such as autonomy, independence, enablement, safety and privacy, it embarks on providing a discussion medium where user views on these principles and the existing tension between some of these principles, for example tension between privacy and autonomy over safety, can be captured and considered in design cycles and throughout project developmentsPeer reviewe