Quality-Latency Trade-Off in Bilateral Teleoperation

The purpose of this thesis is to investigate how the latency in mobile networks affect the quality of highly demanding and sensitive applications running on it. Furthermore, this thesis will provide some information to what is going on in the field of Cloud Computing and the Internet of Things. It will hopefully spark a discussion about what possibilities will come with the development of the Cloud and Internet of Things. The application chosen was a bilateral teleoperation, with force feedback, controlled in 6 dimensions. To investigate how the quality depends on network latency, different network models were simulated as the communication channel. The networks chosen to be simulated were a 3G, 4G, and a 5G cellular network along with a wired network chosen as a baseline. On this setup two main experiments were done. The first one was a collision test and the second one a dexterity test, where a user was supposed to pick up a small wooden brick and put it into a box. The results from the experiments showed that there was indeed a difference in behavior when having a network delay larger than 20 ms

Towards a framework for socially interactive robots

250 p.En las últimas décadas, la investigación en el campo de la robótica social ha crecido considerablemente. El desarrollo de diferentes tipos de robots y sus roles dentro de la sociedad se están expandiendo poco a poco. Los robots dotados de habilidades sociales pretenden ser utilizados para diferentes aplicaciones; por ejemplo, como profesores interactivos y asistentes educativos, para apoyar el manejo de la diabetes en niños, para ayudar a personas mayores con necesidades especiales, como actores interactivos en el teatro o incluso como asistentes en hoteles y centros comerciales.El equipo de investigación RSAIT ha estado trabajando en varias áreas de la robótica, en particular,en arquitecturas de control, exploración y navegación de robots, aprendizaje automático y visión por computador. El trabajo presentado en este trabajo de investigación tiene como objetivo añadir una nueva capa al desarrollo anterior, la capa de interacción humano-robot que se centra en las capacidades sociales que un robot debe mostrar al interactuar con personas, como expresar y percibir emociones, mostrar un alto nivel de diálogo, aprender modelos de otros agentes, establecer y mantener relaciones sociales, usar medios naturales de comunicación (mirada, gestos, etc.),mostrar personalidad y carácter distintivos y aprender competencias sociales.En esta tesis doctoral, tratamos de aportar nuestro grano de arena a las preguntas básicas que surgen cuando pensamos en robots sociales: (1) ¿Cómo nos comunicamos (u operamos) los humanos con los robots sociales?; y (2) ¿Cómo actúan los robots sociales con nosotros? En esa línea, el trabajo se ha desarrollado en dos fases: en la primera, nos hemos centrado en explorar desde un punto de vista práctico varias formas que los humanos utilizan para comunicarse con los robots de una maneranatural. En la segunda además, hemos investigado cómo los robots sociales deben actuar con el usuario.Con respecto a la primera fase, hemos desarrollado tres interfaces de usuario naturales que pretenden hacer que la interacción con los robots sociales sea más natural. Para probar tales interfaces se han desarrollado dos aplicaciones de diferente uso: robots guía y un sistema de controlde robot humanoides con fines de entretenimiento. Trabajar en esas aplicaciones nos ha permitido dotar a nuestros robots con algunas habilidades básicas, como la navegación, la comunicación entre robots y el reconocimiento de voz y las capacidades de comprensión.Por otro lado, en la segunda fase nos hemos centrado en la identificación y el desarrollo de los módulos básicos de comportamiento que este tipo de robots necesitan para ser socialmente creíbles y confiables mientras actúan como agentes sociales. Se ha desarrollado una arquitectura(framework) para robots socialmente interactivos que permite a los robots expresar diferentes tipos de emociones y mostrar un lenguaje corporal natural similar al humano según la tarea a realizar y lascondiciones ambientales.La validación de los diferentes estados de desarrollo de nuestros robots sociales se ha realizado mediante representaciones públicas. La exposición de nuestros robots al público en esas actuaciones se ha convertido en una herramienta esencial para medir cualitativamente la aceptación social de los prototipos que estamos desarrollando. De la misma manera que los robots necesitan un cuerpo físico para interactuar con el entorno y convertirse en inteligentes, los robots sociales necesitan participar socialmente en tareas reales para las que han sido desarrollados, para así poder mejorar su sociabilida

Dynamic virtual reality user interface for teleoperation of heterogeneous robot teams

This research investigates the possibility to improve current teleoperation control for heterogeneous robot teams using modern Human-Computer Interaction (HCI) techniques such as Virtual Reality. It proposes a dynamic teleoperation Virtual Reality User Interface (VRUI) framework to improve the current approach to teleoperating heterogeneous robot teams

Adoption of vehicular ad hoc networking protocols by networked robots

This paper focuses on the utilization of wireless networking in the robotics domain. Many researchers have already equipped their robots with wireless communication capabilities, stimulated by the observation that multi-robot systems tend to have several advantages over their single-robot counterparts. Typically, this integration of wireless communication is tackled in a quite pragmatic manner, only a few authors presented novel Robotic Ad Hoc Network (RANET) protocols that were designed specifically with robotic use cases in mind. This is in sharp contrast with the domain of vehicular ad hoc networks (VANET). This observation is the starting point of this paper. If the results of previous efforts focusing on VANET protocols could be reused in the RANET domain, this could lead to rapid progress in the field of networked robots. To investigate this possibility, this paper provides a thorough overview of the related work in the domain of robotic and vehicular ad hoc networks. Based on this information, an exhaustive list of requirements is defined for both types. It is concluded that the most significant difference lies in the fact that VANET protocols are oriented towards low throughput messaging, while RANET protocols have to support high throughput media streaming as well. Although not always with equal importance, all other defined requirements are valid for both protocols. This leads to the conclusion that cross-fertilization between them is an appealing approach for future RANET research. To support such developments, this paper concludes with the definition of an appropriate working plan

A plug and play transparent communication layer for cloud robotics architectures

The cloud robotics paradigm aims at enhancing the abilities of robots by using cloud services, but it still poses several challenges in the research community. Most of the current literature focuses on how to enrich specific robotic capabilities, overlooking how to effectively establish communication between the two fields. Our work proposes a “plug-and-play” solution to bridge the communication gap between cloud and robotic applications. The proposed solution is designed based on the mature WebSocket technology and it can be extended to any ROS-based robotic platform. The main contributions of this work are the definition of a reliable autoconnection/autoconfiguration mechanism as well as to outline a scalable communication layer that allows the effective control of multiple robots from multiple users. The “plug-and-play” solution was evaluated in both simulated and real scenarios. In the first case, the presence of users and robots was simulated with Robot Operating System (ROS) nodes running on five machines. In the real scenario, three non-expert users teleoperated, simultaneously, three remote robots by using the proposed communication layer with different networking protocols. Results confirmed the reliability at different levels: at startup (success_rate = 100%); during high-rate communications (message_lost = 0%); in performing open-loop spiral trajectories with enhancement, with respect to similar works; and in the quality of simultaneous teleoperations

Distributing intelligence in the wireless control of a mobile robot using a personal digital assistant

Personal Digital Assistants (PDAs) have recently become a popular component in mobile robots. This compact processing device with its touch screen, variety of built-in features, wireless technologies and affordability can perform various roles within a robotic system. Applications include low-cost prototype development, rapid prototyping, low-cost humanoid robots, robot control, robot vision systems, algorithm development, human-robot interaction, mobile user interfaces as well as wireless robot communication schemes. Limits on processing power, memory, battery life and screen size impact the usefulness of a PDA in some applications. In addition various implementation strategies exist, each with its own strengths and weaknesses. No comparison of the advantages and disadvantages of the different strategies and resulting architectures exist. This makes it difficult for designers to decide on the best use of a PDA within their mobile robot system. This dissertation examines and compares the available mobile robot architectures. A thorough literature study identifies robot projects using a PDA and examines how the designs incorporate a PDA and what purpose it fulfils within the system it forms part of. The dissertation categorises the architectures according to the role of the PDA within the robot system. The hypothesis is made that using a distributed control system architecture makes optimal use of the rich feature set gained from including a PDA in a robot system’s design and simultaneously overcomes the device’s inherent shortcomings. This architecture is developed into a novel distributed intelligence framework that is supported by a hybrid communications architecture, using two wireless connection schemes. A prototype implementation illustrates the framework and communications architecture in action. Various performance measurements are taken in a test scenario for an office robot. The results indicate that the proposed framework does deliver performance gains and is a viable alternative for future projects in this area

CCRP: A Novel Clone-Based Cloud Robotic Platform for Multi-Robots

Recently, the cloud computing paradigm has evolved from various research fields. A new path of research, cloud robotics, has emerged which allows robots to inherit the enormous computing and storage capability of cloud. Advances in cloud computing technologies, networking, parallel computing and other evolving technologies, and the integration with multi-robot systems, make it possible to design systems with new capabilities. The main advantages of cloud robotics are in overcoming the limitations of on-board robot computing and storage capabilities and in improving energy efficiency. Nevertheless, there is a lack of cloud robotics frameworks that can provide a secured environment for multi-robot application. The implementation of a robust cloud robotic platform capable of handling multi-robot applications has been shown to be challenging. This research proposes a novel Clone-based Cloud Robotic Platform architecture (CCRP) which assigns a Virtual Machine (VM) clone of each individual robot's operating system in the cloud, enabling fast and efficient collaboration between them via the cloud's inner-network. The system utilises Robot Operating System (ROS) as a middleware and programmable environment for robot development. This model is using the OpenVPN as a communication protocol between the robot and the VM, which provides considerable enhancement for the security and additional network for the system to allow multi-master ROS deployment. The Quality of Service (QoS) for the system has been tested and evaluated in terms of performance, compatibility and scalability via comparison study, which examines the CCRP performance against a local system and a proxy-based cloud system. Two case studies have been deployed for different robot scenarios. Case study 1 was focused on a navigation task which includes the process of mapping and teleoperation implemented in Google public cloud. The real time response has been examined by using the CCRP to teleoperate the NAO and Turtlebot robots. A response time and video streaming delays were measured to assess the overall QoS performance. Case study 2 is composed of a face recognition task performed using the CCRP in a private cloud on an Openstack platform. The objective of this task was to evaluate the system ability of running the tasks in the cloud effectively and to assess the collaborative learning capability. During the CCRP development and deployment stages an optimization study was conducted to determine optimal parameters for data offloading to the cloud and energy efficiency of a low-cost robot. The result of the CCRP performance evaluation proved that it is capable of running on a public and private cloud platform for self-configuring and programmable robotic systems, as well as executing various applications on different robot types. The CCRP is facilitating the improvements to QoS performance, compatibility and scalability and is providing a secure cloud computing environment for on-board robots