Hand-Gesture Based Programming of Industrial Robot Manipulators

Nowadays, industrial robot manipulators and manufacturing processes are associated as never before. Robot manipulators execute repetitive tasks with increased accuracy and speed, features necessary for industries with needs for manufacturing of products in large quantities by reducing the production time. Although robot manipulators have a significant role for the enhancement of productivity within industries, the programming process of the robot manipulators is an important drawback. Traditional programming methodologies requires robot programming experts and are time consuming. This thesis work aims to develop an application for programming industrial robot manipulators excluding the need of traditional programing methodologies exploiting the intuitiveness of humans’ hands’ gestures. The development of input devices for intuitive Human-Machine Interactions provides the possibility to capture such gestures. Hence, the need of the need of robot manipulator programming experts can be replaced by task experts. In addition, the integration of intuitive means of interaction can reduce be also reduced. The components to capture the hands’ operators’ gestures are a data glove and a precise hand-tracking device. The robot manipulator imitates the motion that human operator performs with the hand, in terms of position. Inverse kinematics are applied to enhance the programming of robot manipulators in-dependently of their structure and manufacturer and researching the possibility for optimizing the programmed robot paths. Finally, a Human-Machine Interface contributes in the programming process by offering important information for the programming process and the status of the integrated components

Pick and Place ABB Working with a Liner Follower Robot

AbstractIndustrial robot is widely used in small and medium workshops, however, the robot cooperating with other devices are important aspect for achieving the full autonomous system. This paper reports on the development of line follower mobile robot correlated with ABB industrial robot manipulator. The line follower mobile robot is a prototype model design and fabricated for material handling purpose. Thus, hardware components as well as software programming are concurrently developed with each other. Meanwhile, a specific micro-controller for the line follower robot associated with the ABB main controller is developed. A sensory system also attached for completing the operational loop. Experimental operation shows fully successful for the developed system. Hence, ABB industrial robot could incorporates further in low cost fully automation system

Robot agnostic interface for industrial aplications

The quick evolution of robotic arms has generated many manufacturers of robotic arms, such as Universal Robots, ABB, or Fanuc. Each manufacturer offers a unique interface to program and control their robots. This can limit companies choices when selecting a suitable robot for their industrial operations, as they will choose an interface that doesn’t require new training. For that reason, and based on the experience at UPC CIM, this project will focus on creating a common interface for robotic arms. The main objectives are to produce an interface to simulate robots from different manufacturers, save and load data, and create a simple scripting language. By using ROS, an open-source software infrastructure to communicate between different robotic elements, and Python, the code will be created in five different modules: the launch application, obtaining information about the robot, editing files, moving the robot, and scripting actions. To test the resulting interface, first a setup sequence is performed to see the limitations of the interaction. Then, three theoretical scenarios are proposed, and a scripting sequence is created for each one: Pick and Place, Sorting, and Bin Picking. While limited in some aspects, the application performs as expected and offers the basic options to solve many robot implementations. New options for the future of robot interaction are open with this project, as people could also further develop this program if considere

Robot agnostic interface for industrial aplications

The quick evolution of robotic arms has generated many manufacturers of robotic arms, such as Universal Robots, ABB, or Fanuc. Each manufacturer offers a unique interface to program and control their robots. This can limit companies choices when selecting a suitable robot for their industrial operations, as they will choose an interface that doesn’t require new training. For that reason, and based on the experience at UPC CIM, this project will focus on creating a common interface for robotic arms. The main objectives are to produce an interface to simulate robots from different manu- facturers, save and load data, and create a simple scripting language. By using ROS, an open-source software infrastructure to communicate between different robotic elements, and Python, the code will be created in five different modules: the launch application, obtaining information about the robot, editing files, moving the robot, and scripting actions. To test the resulting interface, first a setup sequence is performed to see the limitations of the interaction. Then, three theoretical scenarios are proposed, and a scripting sequence is created for each one: Pick and Place, Sorting, and Bin Picking. While limited in some aspects, the application performs as expected and offers the basic options to solve many robot implementations. New options for the future of robot in- teraction are open with this project, as people could also further develop this program if considered

Advanced automation concepts

Los conceptos elaborados en este TFG son celda de pegado para cristales en ensamblaje final e inspección de soldaduras en carrocería en blanco con un robot universal, inserción de rueda de repuesto e inserción de batería en ensamblaje final con un robot FANUC y pintura de carrocería con un robot ABB, todo ello utilizando Process Simulate para las simulaciones. Finalmente se desarrolla un entorno de prueba para equipos PLC utilizando el SoftPLC TwinCat de Beckhoff.University College Leuven-Limburg (UCLL)Grado en Ingeniería en Electrónica Industrial y Automátic

Programming Robots by Demonstration using Augmented Reality

O mundo está a viver a quarta revolução industrial, a Indústria 4.0; marcada pela crescente inteligência e automação dos sistemas industriais. No entanto, existem tarefas que são muito complexas ou caras para serem totalmente automatizadas, seria mais eficiente se a máquina pudesse trabalhar com o ser humano, não apenas partilhando o mesmo espaço de trabalho, mas como colaboradores úteis. O foco da investigação para solucionar esse problema está em sistemas de interação homem-robô, percebendo em que aplicações podem ser úteis para implementar e quais são os desafios que enfrentam. Neste contexto, uma melhor interação entre as máquinas e os operadores pode levar a múltiplos benefícios, como menos, melhor e mais fácil treino, um ambiente mais seguro para o operador e a capacidade de resolver problemas mais rapidamente. O tema desta dissertação é relevante na medida em que é necessário aprender e implementar as tecnologias que mais contribuem para encontrar soluções para um trabalho mais simples e eficiente na indústria. Assim, é proposto o desenvolvimento de um protótipo industrial de um sistema de interação homem-máquina através de Realidade Estendida, no qual o objetivo é habilitar um operador industrial sem experiência em programação, a programar um robô colaborativo utilizando o Microsoft HoloLens 2. O sistema desenvolvido é dividido em duas partes distintas: o sistema de tracking, que regista o movimento das mãos do operador, e o sistema de tradução da programação por demonstração, que constrói o programa a ser enviado ao robô para que ele se mova. O sistema de monitorização e supervisão é executado pelo Microsoft HoloLens 2, utilizando a plataforma Unity e Visual Studio para programá-lo. A base do sistema de programação por demonstração foi desenvolvida em Robot Operating System (ROS). Os robôs incluídos nesta interface são Universal Robots UR5 (robô colaborativo) e ABB IRB 2600 (robô industrial). Adicionalmente, a interface foi construída para incorporar facilmente mais robôs.The world is living the fourth industrial revolution, Industry 4.0; marked by the increasing intelligence and automation of manufacturing systems. Nevertheless, there are types of tasks that are too complex or too expensive to be fully automated, it would be more efficient if the machine were able to work with the human, not only by sharing the same workspace but also as useful collaborators. A possible solution to that problem is on human-robot interactions systems, understanding the applications where they can be helpful to implement and what are the challenges they face. In this context a better interaction between the machines and the operators can lead to multiples benefits, like less, better, and easier training, a safer environment for the operator and the capacity to solve problems quicker. The focus of this dissertation is relevant as it is necessary to learn and implement the technologies which most contribute to find solutions for a simpler and more efficient work in industry. This dissertation proposes the development of an industrial prototype of a human machine interaction system through Extended Reality (XR), in which the objective is to enable an industrial operator without any programming experience to program a collaborative robot using the Microsoft HoloLens 2. The system itself is divided into two different parts: the tracking system, which records the operator's hand movement, and the translator of the programming by demonstration system, which builds the program to be sent to the robot to execute the task. The monitoring and supervision system is executed by the Microsoft HoloLens 2, using the Unity platform and Visual Studio to program it. The programming by demonstration system's core was developed in Robot Operating System (ROS). The robots included in this interface are Universal Robots UR5 (collaborative robot) and ABB IRB 2600 (industrial robot). Moreover, the interface was built to easily add other robots