Hand-Gesture Based Programming of Industrial Robot Manipulators

Nowadays, industrial robot manipulators and manufacturing processes are associated as never before. Robot manipulators execute repetitive tasks with increased accuracy and speed, features necessary for industries with needs for manufacturing of products in large quantities by reducing the production time. Although robot manipulators have a significant role for the enhancement of productivity within industries, the programming process of the robot manipulators is an important drawback. Traditional programming methodologies requires robot programming experts and are time consuming. This thesis work aims to develop an application for programming industrial robot manipulators excluding the need of traditional programing methodologies exploiting the intuitiveness of humans’ hands’ gestures. The development of input devices for intuitive Human-Machine Interactions provides the possibility to capture such gestures. Hence, the need of the need of robot manipulator programming experts can be replaced by task experts. In addition, the integration of intuitive means of interaction can reduce be also reduced. The components to capture the hands’ operators’ gestures are a data glove and a precise hand-tracking device. The robot manipulator imitates the motion that human operator performs with the hand, in terms of position. Inverse kinematics are applied to enhance the programming of robot manipulators in-dependently of their structure and manufacturer and researching the possibility for optimizing the programmed robot paths. Finally, a Human-Machine Interface contributes in the programming process by offering important information for the programming process and the status of the integrated components

Mission Control Concepts for Robotic Operations: Existing approaches and new Solutions

This paper gives a preliminary overview on activities within the currently ongoing Mission Control Concepts for Robotic Operations (MICCRO) study. The aim of the MICCRO study is to reveal commonalities in the operations of past, current and future robotic space missions in order to find an abstract, representative mission control concept applicable to multiple future missions with robotic systems involved. The existing operational concepts, responsibilities and information flows during the different mission phases are taken into account. A particular emphasis is put on the possible interaction between different autonomous components (on-board and on-ground), their synchronisation and the possible shift of autonomy borders during different mission phases

Progressive co-adaptation in human-machine interaction

In this paper we discuss the concept of co-adaptation between a human operator and a machine interface and we summarize its application with emphasis on two different domains, teleoperation and assistive technology. The analysis of the literature reveals that only in few cases the possibility of a temporal evolution of the co-adaptation parameters has been considered. In particular, it has been overlooked the role of time-related indexes that capture changes in motor and cognitive abilities of the human operator. We argue that for a more effective long-term co-adaptation process, the interface should be able to predict and adjust its parameters according to the evolution of human skills and performance. We thus propose a novel approach termed progressive co-adaptation, whereby human performance is continuously monitored and the system makes inferences about changes in the users' cognitive and motor skills. We illustrate the features of progressive co-adaptation in two possible applications, robotic telemanipulation and active vision for the visually impaired

Chapter 15 Matching Brain–Machine Interface Performance to Space Applications

A brain-machine interface (BMI) is a particular class of human-machine interface (HMI). BMIs have so far been studied mostly as a communication means for people who have little or no voluntary control of muscle activity. For able-bodied users, such as astronauts, a BMI would only be practical if conceived as an augmenting interface. A method is presented for pointing out effective combinations of HMIs and applications of robotics and automation to space. Latency and throughput are selected as performance measures for a hybrid bionic system (HBS), that is, the combination of a user, a device, and a HMI. We classify and briefly describe HMIs and space applications and then compare the performance of classes of interfaces with the requirements of classes of applications, both in terms of latency and throughput. Regions of overlap correspond to effective combinations. Devices requiring simpler control, such as a rover, a robotic camera, or environmental controls are suitable to be driven by means of BMI technology. Free flyers and other devices with six degrees of freedom can be controlled, but only at low-interactivity levels. More demanding applications require conventional interfaces, although they could be controlled by BMIs once the same levels of performance as currently recorded in animal experiments are attained. Robotic arms and manipulators could be the next frontier for noninvasive BMIs. Integrating smart controllers in HBSs could improve interactivity and boost the use of BMI technology in space applications. © 2009 Elsevier Inc. All rights reserved

An Augmented Interaction Strategy For Designing Human-Machine Interfaces For Hydraulic Excavators

Lack of adequate information feedback and work visibility, and fatigue due to repetition have been identified as the major usability gaps in the human-machine interface (HMI) design of modern hydraulic excavators that subject operators to undue mental and physical workload, resulting in poor performance. To address these gaps, this work proposed an innovative interaction strategy, termed “augmented interaction”, for enhancing the usability of the hydraulic excavator. Augmented interaction involves the embodiment of heads-up display and coordinated control schemes into an efficient, effective and safe HMI. Augmented interaction was demonstrated using a framework consisting of three phases: Design, Implementation/Visualization, and Evaluation (D.IV.E). Guided by this framework, two alternative HMI design concepts (Design A: featuring heads-up display and coordinated control; and Design B: featuring heads-up display and joystick controls) in addition to the existing HMI design (Design C: featuring monitor display and joystick controls) were prototyped. A mixed reality seating buck simulator, named the Hydraulic Excavator Augmented Reality Simulator (H.E.A.R.S), was used to implement the designs and simulate a work environment along with a rock excavation task scenario. A usability evaluation was conducted with twenty participants to characterize the impact of the new HMI types using quantitative (task completion time, TCT; and operating error, OER) and qualitative (subjective workload and user preference) metrics. The results indicated that participants had a shorter TCT with Design A. For OER, there was a lower error probability due to collisions (PER1) with Design A, and lower error probability due to misses (PER2)with Design B. The subjective measures showed a lower overall workload and a high preference for Design B. It was concluded that augmented interaction provides a viable solution for enhancing the usability of the HMI of a hydraulic excavator

Human-Robot Collaborations in Industrial Automation

Technology is changing the manufacturing world. For example, sensors are being used to track inventories from the manufacturing floor up to a retail shelf or a customer’s door. These types of interconnected systems have been called the fourth industrial revolution, also known as Industry 4.0, and are projected to lower manufacturing costs. As industry moves toward these integrated technologies and lower costs, engineers will need to connect these systems via the Internet of Things (IoT). These engineers will also need to design how these connected systems interact with humans. The focus of this Special Issue is the smart sensors used in these human–robot collaborations

Formulation of a new gradient descent MARG orientation algorithm: case study on robot teleoperation

We introduce a novel magnetic angular rate gravity (MARG) sensor fusion algorithm for inertial measurement. The new algorithm improves the popular gradient descent (ʻMadgwick’) algorithm increasing accuracy and robustness while preserving computa- tional efficiency. Analytic and experimental results demonstrate faster convergence for multiple variations of the algorithm through changing magnetic inclination. Furthermore, decoupling of magnetic field variance from roll and pitch estimation is pro- ven for enhanced robustness. The algorithm is validated in a human-machine interface (HMI) case study. The case study involves hardware implementation for wearable robot teleoperation in both Virtual Reality (VR) and in real-time on a 14 degree-of-freedom (DoF) humanoid robot. The experiment fuses inertial (movement) and mechanomyography (MMG) muscle sensing to control robot arm movement and grasp simultaneously, demon- strating algorithm efficacy and capacity to interface with other physiological sensors. To our knowledge, this is the first such formulation and the first fusion of inertial measure- ment and MMG in HMI. We believe the new algorithm holds the potential to impact a very wide range of inertial measurement applications where full orientation necessary. Physiological sensor synthesis and hardware interface further provides a foundation for robotic teleoperation systems with necessary robustness for use in the field

Haptic microrobotic intracellular injection assistance using virtual fixtures

In manual cell injection the operator relies completely on visual information for task feedback and is subject to extended training times as well as poor success rates and repeatability. From this perspective, enhancing human-in-the-loop intracellular injection through haptic interaction offers significant benefits. This paper outlines two haptic virtual fixtures aiming to assist the human operator while performing cell injection. The first haptic virtual fixture is a parabolic force field designed to assist the operator in guiding the micropipette\u27s tip to a desired penetration point on the cell\u27s surface. The second is a planar virtual fixture which attempts to assist the operator from moving the micropipette\u27s tip beyond the deposition target location inside the cell. Preliminary results demonstrate the operation of the haptically assisted microrobotic cell injection system

Stabilizer architecture for humanoid robots collaborating with humans

Hoy en día, los avances en las tecnologías de información y comunicación permiten el uso de robots como compañeros en las actividades con los seres humanos. Mientras que la mayoría de las investigaciones existentes se dedica a la interacción entre humanos y robots, el marco de esta investigación está centrado en el uso de robots como agentes de colaboración. En particular, este estudio está dedicado a los robots humanoides que puedan ayudar a la gente en varias tareas en entornos de trabajo. Los robots humanoides son sin duda los m as adecuados para este tipo de situaciones: pueden usar las mismas herramientas que los seres humanos y son lo m as probablemente aceptados por ellos. Después de explicar las ventajas de las tareas de colaboración entre los humanos y los robots y las diferencias con respecto a los sistemas de interacción y de teleoperación, este trabajo se centra en el nivel de las tecnologías que es necesario para lograr ese objetivo. El problema más complicado en el control de humanoides es el balance de la estructura. Este estudio se centra en técnicas novedosas para la estimación de la actitud del robot, que se utilizarán para el control. El control del robot se basa en un modelo muy conocido y simplificado: el péndulo invertido. Este modelo permite tener un control en tiempo real sobre la estructura, mientras que esté sometida a fuerzas externas / disturbios. Trayectorias suaves para el control de humanoides se han propuesto y probado en plataformas reales: éstos permiten reducir los impactos del robot con su entorno. Finalmente, el estudio extiende estos resultados a una contribución para la arquitectura de colaboración humano-humanoide. Dos tipos de colaboraciones humano humanoide se analizan: la colaboración física, donde robots y humanos comparten el mismo espacio y tienen un contacto físico (o por medio de un objeto), y una colaboración a distancia, en la que el ser humano está relativamente lejos del robot y los dos agentes colaboran por medio de una interfaz. El paradigma básico de esta colaboración robótica es: lo que es difícil (o peligroso) para el ser humano se hace por medio del robot y lo que es difícil para el robot lo puede mejor hacer el humano. Es importante destacar que el contexto de los experimentos no se basa en una unica plataforma humanoide; por el contrario, tres plataformas han sido objeto de los experimentos: se han empleado los robots HOAP-3, HRP-2 y TEO. ----------------------------------------------------------------------------------------------------------------------------------------------------------Nowadays, the advances in information and communication technologies permit the use of robots as companions in activities with humans. While most of the existing research is dedicated to the interaction between humans and robots, the framework of this research is the use of robots as collaborative agents. In particular, this study is dedicated to humanoid robots which should assist people in several tasks in working environments. Humanoid robots are certainly the most adequate for such situations: they can use the same tools as humans and are most likely accepted by them. After explaining the advantages of collaborative tasks among humans and robots and the differences with respect to interaction and teleoperation systems, this work focuses on the level of technologies which is necessary in order to achieve such a goal. The most complicated problem in humanoid control is the structure balance. This study focuses in novel techniques in the attitude estimation of the robot, to be used for the control. The control of the robot is based on a very well-known and simplified model: the double inverted pendulum. This model permits having a real-time control on the structure while submitted to external forces/disturbances. The control actions are strongly dependent on the three stability regions, which are determined by the position of the ZMP in the support polygon. Smooth trajectories for the humanoid control have been proposed and tested on real platforms: these permit reducing the impacts of the robot with its environment. Finally, the study extends these results to a contribution for human-humanoid collaboration architecture. Two types of human-humanoid collaborations are analyzed: a physical collaboration, where robot and human share the same space and have a physical contact (or by means of an object), and a remote collaboration, in which the human is relatively far away from the robot and the two agents collaborate using an interface. The basic paradigm for this robotic collaboration is: what is difficult (or dangerous) for the human is done by the robot and what is difficult for the robot is better done by the human. Importantly, the testing context is not based on a single humanoid platform; on the contrary, three platforms have been object of the experiments: the Hoap-3, HRP-2 and HRP2 robot have been employed