Programming-by-demonstration of reaching motions for robot grasping

Proceedings of: 14th International Conference on Advanced Robotics (ICAR 2009), 22-26 June 2009, Munich (Germany)This paper presents a novel approach to skill modeling acquired from human demonstration. The approach is based on fuzzy modeling and is using a planner for generating corresponding robot trajectories. One of the main challenges stems from the morphological differences between human and robot hand/arm structure, which makes direct copying of human motions impossible in the general case. Thus, the planner works in hand state space, which is defined such that it is perception-invariant and valid for both human and robot hand. We show that this representation simplifies task reconstruction and preserves the essential parts of the task as well as the coordination between reaching and grasping motion. We also show how our approach can generalize observed trajectories based on multiple demonstrations and that the robot can match a demonstrated behavoir, despite morphological differences. To validate our approach we use a general-purpose robot manipulator equipped with an anthropomorphic three-fingered robot hand.European Community's Seventh Framework Progra

A Model-Driven Engineering Approach for ROS using Ontological Semantics

This paper presents a novel ontology-driven software engineering approach for the development of industrial robotics control software. It introduces the ReApp architecture that synthesizes model-driven engineering with semantic technologies to facilitate the development and reuse of ROS-based components and applications. In ReApp, we show how different ontological classification systems for hardware, software, and capabilities help developers in discovering suitable software components for their tasks and in applying them correctly. The proposed model-driven tooling enables developers to work at higher abstraction levels and fosters automatic code generation. It is underpinned by ontologies to minimize discontinuities in the development workflow, with an integrated development environment presenting a seamless interface to the user. First results show the viability and synergy of the selected approach when searching for or developing software with reuse in mind.Comment: Presented at DSLRob 2015 (arXiv:1601.00877), Stefan Zander, Georg Heppner, Georg Neugschwandtner, Ramez Awad, Marc Essinger and Nadia Ahmed: A Model-Driven Engineering Approach for ROS using Ontological Semantic

Using the DiaSpec design language and compiler to develop robotics systems

A Sense/Compute/Control (SCC) application is one that interacts with the physical environment. Such applications are pervasive in domains such as building automation, assisted living, and autonomic computing. Developing an SCC application is complex because: (1) the implementation must address both the interaction with the environment and the application logic; (2) any evolution in the environment must be reflected in the implementation of the application; (3) correctness is essential, as effects on the physical environment can have irreversible consequences. The SCC architectural pattern and the DiaSpec domain-specific design language propose a framework to guide the design of such applications. From a design description in DiaSpec, the DiaSpec compiler is capable of generating a programming framework that guides the developer in implementing the design and that provides runtime support. In this paper, we report on an experiment using DiaSpec (both the design language and compiler) to develop a standard robotics application. We discuss the benefits and problems of using DiaSpec in a robotics setting and present some changes that would make DiaSpec a better framework in this setting.Comment: DSLRob'11: Domain-Specific Languages and models for ROBotic systems (2011

Generating Images with Physics-Based Rendering for an Industrial Object Detection Task: Realism versus Domain Randomization

Limited training data is one of the biggest challenges in the industrial application of deep learning. Generating synthetic training images is a promising solution in computer vision; however, minimizing the domain gap between synthetic and real-world images remains a problem. Therefore, based on a real-world application, we explored the generation of images with physics-based rendering for an industrial object detection task. Setting up the render engine’s environment requires a lot of choices and parameters. One fundamental question is whether to apply the concept of domain randomization or use domain knowledge to try and achieve photorealism. To answer this question, we compared different strategies for setting up lighting, background, object texture, additional foreground objects and bounding box computation in a data-centric approach. We compared the resulting average precision from generated images with different levels of realism and variability. In conclusion, we found that domain randomization is a viable strategy for the detection of industrial objects. However, domain knowledge can be used for object-related aspects to improve detection performance. Based on our results, we provide guidelines and an open-source tool for the generation of synthetic images for new industrial applications

Robotics Dexterous Grasping: The Methods Based on Point Cloud and Deep Learning

Dexterous manipulation, especially dexterous grasping, is a primitive and crucial ability of robots that allows the implementation of performing human-like behaviors. Deploying the ability on robots enables them to assist and substitute human to accomplish more complex tasks in daily life and industrial production. A comprehensive review of the methods based on point cloud and deep learning for robotics dexterous grasping from three perspectives is given in this paper. As a new category schemes of the mainstream methods, the proposed generation-evaluation framework is the core concept of the classification. The other two classifications based on learning modes and applications are also briefly described afterwards. This review aims to afford a guideline for robotics dexterous grasping researchers and developers

Small Spacecraft Based Multiple Near-Earth Asteroid Rendezvous and Landing with Near-Term Solar Sails and ‘Now-Term‘ Technologies

Physical interaction with small solar system bodies (SSSB) is the next step in planetary science, planetary in-situ resource utilization (ISRU), and planetary defense (PD). It requires a broader understanding of the surface properties of the target objects, with particular interest focused on those near Earth. Knowledge of composition, multi-scale surface structure, thermal response, and interior structure is required to design, validate and operate missions addressing these three fields. The current level of understanding is occasionally simplified into the phrase, ”If you’ve seen one asteroid, you’ve seen one asteroid”, meaning that the in-situ characterization of SSSBs has yet to cross the threshold towards a robust and stable scheme of classification. This would enable generic features in spacecraft design, particularly for ISRU and science missions. Currently, it is necessary to characterize any potential target object sufficiently by a dedicated pre-cursor mission to design the mission which then interacts with the object in a complex fashion. To open up strategic approaches, much broader in-depth characterization of potential target objects would be highly desirable. In SSSB science missions, MASCOT-like nano-landers and instrument carriers which integrate at the instrument level to their mothership have met interest. By its size, MASCOT is compatible with small interplanetary missions. The DLR-ESTEC Gossamer Roadmap Science Working Groups‘ studies identified Multiple Near-Earth asteroid (NEA) Rendezvous (MNR) as one of the space science missions only feasible with solar sail propulsion. The Solar Polar Orbiter (SPO) study showed the ability to access any inclination, theDisplaced-L1 (DL1) mission operates close to Earth, where objects of interest to PD and for ISRU reside. Other studies outline the unique capability of solar sails to provide access to all SSSB, at least within the orbit of Jupiter, and significant progress has been made to explore the performance envelope of near-term solar sails for MNR. However, it is difficult for sailcraft to interact physically with a SSSB. We expand and extend the philosophy of the recently qualified DLR Gossamer solar sail deployment technology using efficient multiple sub-spacecraft integration to also include landers for one-way in-situ investigations and sample-return missions by synergetic integration and operation of sail and lander. The MASCOT design concept and its characteristic features have created an ideal counterpart for thisand has already been adapted to the needs of the AIM spacecraft, former part of the NASA-ESA AIDA mission. Designing the combined spacecraft for piggy-back launch accommodation enables low-cost massively parallel access to the NEA population

Small Spacecraft Based Multiple Near-Earth Asteroid Rendezvous and Landing with Near-Term Solar Sails and ‘Now-Term‘ Technologies

Physical interaction with small solar system bodies (SSSB) is the next step in planetary science, planetary in-situ resource utilization (ISRU), and planetary defense (PD). It requires a broader understanding of the surface properties of the target objects, with particular interest focused on those near Earth. Knowledge of composition, multi-scale surface structure, thermal response, and interior structure is required to design, validate and operate missions addressing these three fields. The current level of understanding is occasionally simplified into the phrase, ”If you’ve seen one asteroid, you’ve seen one asteroid”, meaning that the in-situ characterization of SSSBs has yet to cross the threshold towards a robust and stable scheme of classification. This would enable generic features in spacecraft design, particularly for ISRU and science missions. Currently, it is necessary to characterize any potential target object sufficiently by a dedicated pre-cursor mission to design the mission which then interacts with the object in a complex fashion. To open up strategic approaches, much broader in-depth characterization of potential target objects would be highly desirable. In SSSB science missions, MASCOT-like nano-landers and instrument carriers which integrate at the instrument level to their mothership have met interest. By its size, MASCOT is compatible with small interplanetary missions. The DLR-ESTEC Gossamer Roadmap Science Working Groups‘ studies identified Multiple Near-Earth asteroid (NEA) Rendezvous (MNR) as one of the space science missions only feasible with solar sail propulsion. The Solar Polar Orbiter (SPO) study showed the ability to access any inclination, theDisplaced-L1 (DL1) mission operates close to Earth, where objects of interest to PD and for ISRU reside. Other studies outline the unique capability of solar sails to provide access to all SSSB, at least within the orbit of Jupiter, and significant progress has been made to explore the performance envelope of near-term solar sails for MNR. However, it is difficult for sailcraft to interact physically with a SSSB. We expand and extend the philosophy of the recently qualified DLR Gossamer solar sail deployment technology using efficient multiple sub-spacecraft integration to also include landers for one-way in-situ investigations and sample-return missions by synergetic integration and operation of sail and lander. The MASCOT design concept and its characteristic features have created an ideal counterpart for thisand has already been adapted to the needs of the AIM spacecraft, former part of the NASA-ESA AIDA mission. Designing the combined spacecraft for piggy-back launch accommodation enables low-cost massively parallel access to the NEA population

Soft Gloves: A Review on Recent Developments in Actuation, Sensing, Control and Applications

Interest in soft gloves, both robotic and haptic, has enormously grown over the past decade, due to their inherent compliance, which makes them particularly suitable for direct interaction with the human hand. Robotic soft gloves have been developed for hand rehabilitation, for ADLs assistance, or sometimes for both. Haptic soft gloves may be applied in virtual reality (VR) applications or to give sensory feedback in combination with prostheses or to control robots. This paper presents an updated review of the state of the art of soft gloves, with a particular focus on actuation, sensing, and control, combined with a detailed analysis of the devices according to their application field. The review is organized on two levels: a prospective review allows the highlighting of the main trends in soft gloves development and applications, and an analytical review performs an in-depth analysis of the technical solutions developed and implemented in the revised scientific research. Additional minor evaluations integrate the analysis, such as a synthetic investigation of the main results in the clinical studies and trials referred in literature which involve soft gloves