A model-based residual approach for human-robot collaboration during manual polishing operations

A fully robotized polishing of metallic surfaces may be insufficient in case of parts with complex geometric shapes, where a manual intervention is still preferable. Within the EU SYMPLEXITY project, we are considering tasks where manual polishing operations are performed in strict physical Human-Robot Collaboration (HRC) between a robot holding the part and a human operator equipped with an abrasive tool. During the polishing task, the robot should firmly keep the workpiece in a prescribed sequence of poses, by monitoring and resisting to the external forces applied by the operator. However, the user may also wish to change the orientation of the part mounted on the robot, simply by pushing or pulling the robot body and changing thus its configuration. We propose a control algorithm that is able to distinguish the external torques acting at the robot joints in two components, one due to the polishing forces being applied at the end-effector level, the other due to the intentional physical interaction engaged by the human. The latter component is used to reconfigure the manipulator arm and, accordingly, its end-effector orientation. The workpiece position is kept instead fixed, by exploiting the intrinsic redundancy of this subtask. The controller uses a F/T sensor mounted at the robot wrist, together with our recently developed model-based technique (the residual method) that is able to estimate online the joint torques due to contact forces/torques applied at any place along the robot structure. In order to obtain a reliable residual, which is necessary to implement the control algorithm, an accurate robot dynamic model (including also friction effects at the joints and drive gains) needs to be identified first. The complete dynamic identification and the proposed control method for the human-robot collaborative polishing task are illustrated on a 6R UR10 lightweight manipulator mounting an ATI 6D sensor

Human-Robot Collaboration for Kinesthetic Teaching

Recent industrial interest in producing smaller volumes of products in shorter time frames, in contrast to mass production in previous decades, motivated the introduction of human–robot collaboration (HRC) in industrial settings, as an attempt to increase flexibility in manufacturing applications by incorporating human intelligence and dexterity to these processes. This thesis presents methods for improving the involvement of human operators in industrial settings where robots are present, with a particular focus on kinesthetic teaching, i.e., manually guiding the robot to define or correct its motion, since it can facilitate non-expert robot programming.To increase flexibility in the manufacturing industry implies a loss of a fixed structure of the industrial environment, which increases the uncertainties in the shared workspace between humans and robots. Two methods have been proposed in this thesis to mitigate such uncertainty. First, null-space motion was used to increase the accuracy of kinesthetic teaching by reducing the joint static friction, or stiction, without altering the execution of the robotic task. This was possible since robots used in HRC, i.e., collaborative robots, are often designed with additional degrees of freedom (DOFs) for a greater dexterity. Second, to perform effective corrections of the motion of the robot through kinesthetic teaching in partially-unknown industrial environments, a fast identification of the source of robot–environment contact is necessary. Fast contact detection and classification methods in literature were evaluated, extended, and modified to use them in kinesthetic teaching applications for an assembly task. For this, collaborative robots that are made compliant with respect to their external forces/torques (as an active safety mechanism) were used, and only embedded sensors of the robot were considered.Moreover, safety is a major concern when robotic motion occurs in an inherently uncertain scenario, especially if humans are present. Therefore, an online variation of the compliant behavior of the robot during its manual guidance by a human operator was proposed to avoid undesired parts of the workspace of the robot. The proposed method used safety control barrier functions (SCBFs) that considered the rigid-body dynamics of the robot, and the method’s stability was guaranteed using a passivity-based energy-storage formulation that includes a strict Lyapunov function.All presented methods were tested experimentally on a real collaborative robot

Robot Introspection with Bayesian Nonparametric Vector Autoregressive Hidden Markov Models

Robot introspection, as opposed to anomaly detection typical in process monitoring, helps a robot understand what it is doing at all times. A robot should be able to identify its actions not only when failure or novelty occurs, but also as it executes any number of sub-tasks. As robots continue their quest of functioning in unstructured environments, it is imperative they understand what is it that they are actually doing to render them more robust. This work investigates the modeling ability of Bayesian nonparametric techniques on Markov Switching Process to learn complex dynamics typical in robot contact tasks. We study whether the Markov switching process, together with Bayesian priors can outperform the modeling ability of its counterparts: an HMM with Bayesian priors and without. The work was tested in a snap assembly task characterized by high elastic forces. The task consists of an insertion subtask with very complex dynamics. Our approach showed a stronger ability to generalize and was able to better model the subtask with complex dynamics in a computationally efficient way. The modeling technique is also used to learn a growing library of robot skills, one that when integrated with low-level control allows for robot online decision making.Comment: final version submitted to humanoids 201

A Depth Space Approach for Evaluating Distance to Objects -- with Application to Human-Robot Collision Avoidance

We present a novel approach to estimate the distance between a generic point in the Cartesian space and objects detected with a depth sensor. This information is crucial in many robotic applications, e.g., for collision avoidance, contact point identification, and augmented reality. The key idea is to perform all distance evaluations directly in the depth space. This allows distance estimation by considering also the frustum generated by the pixel on the depth image, which takes into account both the pixel size and the occluded points. Different techniques to aggregate distance data coming from multiple object points are proposed. We compare the Depth space approach with the commonly used Cartesian space or Configuration space approaches, showing that the presented method provides better results and faster execution times. An application to human-robot collision avoidance using a KUKA LWR IV robot and a Microsoft Kinect sensor illustrates the effectiveness of the approach

Human-Robot Collaborations in Industrial Automation

Technology is changing the manufacturing world. For example, sensors are being used to track inventories from the manufacturing floor up to a retail shelf or a customer’s door. These types of interconnected systems have been called the fourth industrial revolution, also known as Industry 4.0, and are projected to lower manufacturing costs. As industry moves toward these integrated technologies and lower costs, engineers will need to connect these systems via the Internet of Things (IoT). These engineers will also need to design how these connected systems interact with humans. The focus of this Special Issue is the smart sensors used in these human–robot collaborations

Human-system concurrent task analysis for maritime autonomous surface ship operation and safety

Maritime Autonomous Surface Ships (MASS) are the subject of a diversity of projects and some are in testing phase. MASS will probably include operators working in a shore control center (SCC), whose responsibilities may from supervision to remote control, according to Level of Autonomy (LoA) of the voyage. Moreover, MASS may operate with a dynamic LoA. The strong reliance on Human-Autonomous System collaboration and the dynamic LoA should be comprised on the analysis of MASS to ensure its safety; and are shortcomings of current methods. This paper presents the Human-System Interaction in Autonomy (H-SIA) method for MASS collision scenarios, and illustrates its application through a case study. H-SIA consists of an Event Sequence Diagram (ESD) and a concurrent task analysis (CoTA). The ESD models the scenario in a high level and consists of events related to all system's agents. The CoTA is a novel method to analyse complex systems. It comprises of Task Analysis of each agent, which are preformed concurrently, and uses specific rules for re-description. The H-SIA method analyses the system as whole, rather than focus on each component separately, allowing identification of dependent tasks between agents and visualization of propagation of failure between the agents’ tasks.acceptedVersion© 2019. This is the authors’ accepted and refereed manuscript to the article. Locked until 22.10.2021 due to copyright restrictions. This manuscript version is made available under the CC-BY-NC-ND 4.0 license http://creativecommons.org/licenses/by-nc-nd/4.0

Towards the Safety of Human-in-the-Loop Robotics: Challenges and Opportunities for Safety Assurance of Robotic Co-Workers

The success of the human-robot co-worker team in a flexible manufacturing environment where robots learn from demonstration heavily relies on the correct and safe operation of the robot. How this can be achieved is a challenge that requires addressing both technical as well as human-centric research questions. In this paper we discuss the state of the art in safety assurance, existing as well as emerging standards in this area, and the need for new approaches to safety assurance in the context of learning machines. We then focus on robotic learning from demonstration, the challenges these techniques pose to safety assurance and indicate opportunities to integrate safety considerations into algorithms "by design". Finally, from a human-centric perspective, we stipulate that, to achieve high levels of safety and ultimately trust, the robotic co-worker must meet the innate expectations of the humans it works with. It is our aim to stimulate a discussion focused on the safety aspects of human-in-the-loop robotics, and to foster multidisciplinary collaboration to address the research challenges identified

Perirobot space representations for safe human-robot interaction

Bezpečnost je nutnou podmínkou fyzické spolupráce robota a člověka. Bohužel však v praxi dodržení bezpečnostních požadavků vede ke snížení výkonnosti celé robotické palikace. Z toho důvodu je žádoucí zkoumat různé cesty, jakými zajistit bezpečnosti a jejich vlliv na výkon. Předmětem této disertace je zkoumání takových metod u kolaborativních robotů v jejich tzv. perirobotím prostoru, tj. prostoru kolem robota. Tento výzkum vede k syntéze tří oblastí: bezpečnosti ve fyzické interakci mezi člověkem a robotem, efektivity bezpečné spolupráce mezi člověkem a robotem a samotného perirobotického prostoru a jeho interpretace. Práce představuje příklady, jak je stávajícíc návrh normy pro bezpečnou spoupráci mezi člověkem a robotem (ISO/TS15066) nedostačující a proč je třeba přistupovat k bezpečnosti komplexněji než jak ji prezentuje norma. Tyto závěry josu podpořeny výsledky z již publikovaných prací autora dizertace pro různé sestavy i roboty (zejména UR10e a KUKA LBR, iiwa). V závěřu práce argumentuje pro nový přístup k interpraci prostoru kolem robotů, tzv. perirobotického prostoru.Safety is a necessity in physical human-robot collaboration, but it can come at the cos