Master of Science

thesisIncreased demand for powered wheelchairs and their inherent mobility limitations have prompted the development of omnidirectional wheelchairs. These wheelchairs provide improved mobility in confined spaces, but can be more difficult to control and impact the ability of the user to embody the wheelchair. We hypothesize that control and embodiment of omnidirectional wheelchairs can be improved by providing intuitive control with three degree of freedom (3-DOF) haptic feedback that directly corresponds to the degrees of freedom of an omnidirectional wheelchair. This thesis introduces a novel 3-DOF Haptic Joystick designed for the purpose of controlling omnidirectional wheelchairs. When coupled with range finders, it is able to provide the user with feedback that improves the operator's awareness of the area surrounding the vehicle and assists the driver in obstacle avoidance. The haptic controller design and a stability analysis of the coupled wheelchair joystick systems are presented. Experimental results from the coupled systems validate the ability of the controller to influence the trajectory of the wheelchair and assist in obstacle avoidance

Master of Science

thesisThe objective of this research is to improve the ability of a human operator to drive an omnidirectional robot by using omnidirectional force-feedback. Omnidirectional vehicles offer improved mobility over conventional vehicles and can potentially benefit people requiring motorized transportation and industries where vehicles must operate in confined spaces. However, omnidirectional vehicles require more skill to control due to the additional degrees of freedom inherent in the vehicle’s design. We hypothesize that providing force-feedback to the driver through an omnidirectional joystick will allow the robot to assist the driver in navigating and avoiding collisions with obstacles in a manner that is natural to the operator. This research is the first attempt to use true omnidirectional 3-DOF (degree of freedom) force-feedback to provide navigational assistance for a human to drive an omnidirectional vehicle. While 2-DOF force-feedback has been used in a limited capacity for obstacle avoidance on omnidirectional vehicles, this is the first study to include a third rotational axis of force-feedback and use it to guide a driver along planar collision-avoiding trajectories with a natural coordination of orientation. Unique intellectual merits put forth by this research include use of a novel omnidirectional haptic device and force-feedback strategies to guide operators and experiments to quantify the ability of force-feedback to improve omnidirectional driving performance and driver experience in a real time scenario

Ankle-Actuated Human-Machine Interface for Walking in Virtual Reality

This thesis work presents design, implementation and experimental study of an impedance type ankle haptic interface for providing users with the immersive navigation experience in virtual reality (VR). The ankle platform enables the use of foot-tapping gestures to reproduce realistic walking experience in VR and to haptically render different types of walking terrains. The system is designed to be used by seated users allowing more comfort, causing less fatigue and motion sickness. The custom-designed ankle interface is composed of a single actuator-sensors system making it a cost-efficient solution for VR applications. The designed interface consists of a single degree of freedom actuated platform which can rotate around the ankle joint of the user. The platform is impedance controlled around the horizontal position by an electric motor and capstan transmission system. to perform walking in a virtual scene, a seated user is expected to perform walking gestures in form of ankle plantar-flexion and dorsiflexion movements causing the platform to tilt forward and backward. We present three algorithms for simulating the immersive locomotion of a VR avatar using the platform movement information. We also designed multiple impedance controllers to render haptic feedback for different virtual terrains during walking. We carried out experiments to understand how quickly users adapt to the interface, how well they can control their locomotion speed in VR, and how well they can distinguish different types of terrains presented through haptic feedback. We implemented qualitative questionnaires on the usability of the device and the task load of the experimental procedures. The experimental studies demonstrated that the interface can be easily used to navigate in VR and it is capable of rendering dynamic multi-layer complex terrains containing structures with different stiffness and brittleness properties

Teleoperation control based on combination of wave variable and neural networks

In this paper, a novel control scheme is developed for a teleoperation system, combining the radial basis function (RBF) neural networks (NNs) and wave variable technique to simultaneously compensate for the effects caused by communication delays and dynamics uncertainties. The teleoperation system is set up with a TouchX joystick as the master device and a simulated Baxter robot arm as the slave robot. The haptic feedback is provided to the human operator to sense the interaction force between the slave robot and the environment when manipulating the stylus of the joystick. To utilize the workspace of the telerobot as much as possible, a matching process is carried out between the master and the slave based on their kinematics models. The closed loop inverse kinematics method and RBF NN approximation technique are seamlessly integrated in the control design. To overcome the potential instability problem in the presence of delayed communication channels, wave variables and their corrections are effectively embedded into the control system, and Lyapunov-based analysis is performed to theoretically establish the closed-loop stability. Comparative experiments have been conducted for a trajectory tracking task, under the different conditions of various communication delays. Experimental results show that in terms of tracking performance and force reflection, the proposed control approach shows superior performance over the conventional methods

Sistema de aquisição de dados por interface háptica

Mestrado em Engenharia MecânicaNeste trabalho e apresentada uma interface háptica com realimentação de força para a teleoperação de um robô humanoide é que aborda um novo conceito destinado à aprendizagem por demonstração em robôs, denominado de ensino telecinestésico. A interface desenvolvida pretende promover o ensino cinestésico num ambiente de tele-robótica enriquecido pela virtualização háptica do ambiente e restrições do robô. Os dados recolhidos através desta poderão então ser usados em aprendizagem por demonstração, uma abordagem poderosa que permite aprender padrões de movimento sem a necessidade de modelos dinâmicos complexos, mas que geralmente é apresentada com demonstrações que não são fornecidas teleoperando os robôs. Várias experiências são referidas onde o ensino cinestésico em aprendizagem robótica foi utilizado com um sucesso considerável, bem como novas metodologias e aplicações com aparelhos hápticos. Este trabalho foi realizado com base na plataforma proprietária de 27 graus-de-liberdade do Projeto Humanoide da Universidade de Aveiro (PHUA), definindo novas methodologias de comando em tele-operação, uma nova abordagem de software e ainda algumas alterações ao hardware. Um simulador de corpo inteiro do robô em MATLAB SimMechanics é apresentado que é capaz de determinar os requisitos dinâmicos de binário de cada junta para uma dada postura ou movimento, exemplificando com um movimento efectuado para subir um degrau. Ir a mostrar algumas das potencialidades mas também algumas das limitações restritivas do software. Para testar esta nova abordagem tele-cinestésica são dados exemplos onde o utilizador pode desenvolver demonstrações interagindo fisicamente com o robô humanoide através de um joystick háptico PHANToM. Esta metodologia ir a mostrar que permite uma interação natural para o ensino e perceção tele-robóticos, onde o utilizador fornece instruções e correções funcionais estando ciente da dinâmica do sistema e das suas capacidades e limitações físicas. Ser a mostrado que a abordagem consegue atingir um bom desempenho mesmo com operadores inexperientes ou não familiarizados com o sistema. Durante a interação háptica, a informação sensorial e as ordens que guiam a uma tarefa específica podem ser gravados e posteriormente utilizados para efeitos de aprendizagem.In this work an haptic interface using force feedback for the teleoperation of a humanoid robot is presented, that approaches a new concept for robot learning by demonstration known as tele-kinesthethic teaching. This interface aims at promoting kinesthethic teaching in telerobotic environments enriched by the haptic virtualization of the robot's environment and restrictions. The data collected through this interface can later be in robot learning by demonstration, a powerful approach for learning motion patterns without complex dynamical models, but which is usually presented using demonstrations that are not provided by teleoperating the robots. Several experiments are referred where kinesthetic teaching for robot learning was used with considerable success, as well as other new methodologies and applications with haptic devices. This work was conducted on the proprietary 27 DOF University of Aveiro Humanoid Project (PHUA) robot, de ning new wiring and software solutions, as well as a new teleoperation command methodology. A MATLAB Sim- Mechanics full body robot simulator is presented that is able to determine dynamic joint torque requirements for a given robot movement or posture, exempli ed with a step climbing application. It will show some of the potentialities but also some restricting limitations of the software. To test this new tele-kinesthetic approach, examples are shown where the user can provide demonstrations by physically interacting with the humanoid robot through a PHANToM haptic joystick. This methodology will show that it enables a natural interface for telerobotic teaching and sensing, in which the user provides functional guidance and corrections while being aware of the dynamics of the system and its physical capabilities and / or constraints. It will also be shown that the approach can have a good performance even with inexperienced or unfamiliarized operators. During haptic interaction, the sensory information and the commands guiding the execution of a speci c task can be recorded and that data log from the human-robot interaction can be later used for learning purposes

User Experience Enchanced Interface ad Controller Design for Human-Robot Interaction

The robotic technologies have been well developed recently in various fields, such as medical services, industrial manufacture and aerospace. Despite their rapid development, how to deal with the uncertain envi-ronment during human-robot interactions effectively still remains un-resolved. The current artificial intelligence (AI) technology does not support robots to fulfil complex tasks without human’s guidance. Thus, teleoperation, which means remotely controlling a robot by a human op-erator, is indispensable in many scenarios. It is an important and useful tool in research fields. This thesis focuses on the study of designing a user experience (UX) enhanced robot controller, and human-robot in-teraction interfaces that try providing human operators an immersion perception of teleoperation. Several works have been done to achieve the goal.First, to control a telerobot smoothly, a customised variable gain con-trol method is proposed where the stiffness of the telerobot varies with the muscle activation level extracted from signals collected by the surface electromyograph(sEMG) devices. Second, two main works are conducted to improve the user-friendliness of the interaction interfaces. One is that force feedback is incorporated into the framework providing operators with haptic feedback to remotely manipulate target objects. Given the high cost of force sensor, in this part of work, a haptic force estimation algorithm is proposed where force sensor is no longer needed. The other main work is developing a visual servo control system, where a stereo camera is mounted on the head of a dual arm robots offering operators real-time working situations. In order to compensate the internal and ex-ternal uncertainties and accurately track the stereo camera’s view angles along planned trajectories, a deterministic learning techniques is utilised, which enables reusing the learnt knowledge before current dynamics changes and thus features increasing the learning efficiency. Third, in-stead of sending commands to the telerobts by joy-sticks, keyboards or demonstrations, the telerobts are controlled directly by the upper limb motion of the human operator in this thesis. Algorithm that utilised the motion signals from inertial measurement unit (IMU) sensor to captures humans’ upper limb motion is designed. The skeleton of the operator is detected by Kinect V2 and then transformed and mapped into the joint positions of the controlled robot arm. In this way, the upper limb mo-tion signals from the operator is able to act as reference trajectories to the telerobts. A more superior neural networks (NN) based trajectory controller is also designed to track the generated reference trajectory. Fourth, to further enhance the human immersion perception of teleop-eration, the virtual reality (VR) technique is incorporated such that the operator can make interaction and adjustment of robots easier and more accurate from a robot’s perspective.Comparative experiments have been performed to demonstrate the effectiveness of the proposed design scheme. Tests with human subjects were also carried out for evaluating the interface design

Design of a six degree-of-freedom haptic hybrid platform manipultor

Thesis (Master)--Izmir Institute of Technology, Mechanical Engineering, Izmir, 2010Includes bibliographical references (leaves: 97-103)Text in English; Abstract: Turkish and Englishxv, 115 leavesThe word Haptic, based on an ancient Greek word called haptios, means related with touch. As an area of robotics, haptics technology provides the sense of touch for robotic applications that involve interaction with human operator and the environment. The sense of touch accompanied with the visual feedback is enough to gather most of the information about a certain environment. It increases the precision of teleoperation and sensation levels of the virtual reality (VR) applications by exerting physical properties of the environment such as forces, motions, textures. Currently, haptic devices find use in many VR and teleoperation applications. The objective of this thesis is to design a novel Six Degree-of-Freedom (DOF) haptic desktop device with a new structure that has the potential to increase the precision in the haptics technology. First, previously developed haptic devices and manipulator structures are reviewed. Following this, the conceptual designs are formed and a hybrid structured haptic device is designed manufactured and tested. Developed haptic device.s control algorithm and VR application is developed in Matlab© Simulink. Integration of the mechanism with mechanical, electromechanical and electronic components and the initial tests of the system are executed and the results are presented. According to the results, performance of the developed device is discussed and future works are addressed

Kinova modular robot arms for service robotics applications

This article presents Kinova's modular robotic systems, including the robots JACO2 and MICO2, actuators and grippers. Kinova designs and manufactures robotics platforms and components that are simple, sexy and safe under two business units: Assistive Robotics empowers people living with disabilities to push beyond their current boundaries and limitations while Service Robotics empowers people in industry to interact with their environment more efficiently and safely. Kinova is based in Boisbriand, Québec, Canada. Its technologies are exploited in over 25 countries and are used in many applications, including as service robotics, physical assistance, medical applications, mobile manipulation, rehabilitation, teleoperation and in research in different areas such as computer vision, artificial intelligence, grasping, planning and control interfaces. The article describes Kinova's hardware platforms, their different control modes (position, velocity and torque), control features and possible control interfaces. Integration to other systems and application examples are also presented

Combining haptics and inertial motion capture to enhance remote control of a dual-arm robot

High dexterity is required in tasks in which there is contact between objects, such as surface conditioning (wiping, polishing, scuffing, sanding, etc.), specially when the location of the objects involved is unknown or highly inaccurate because they are moving, like a car body in automotive industry lines. These applications require the human adaptability and the robot accuracy. However, sharing the same workspace is not possible in most cases due to safety issues. Hence, a multi-modal teleoperation system combining haptics and an inertial motion capture system is introduced in this work. The human operator gets the sense of touch thanks to haptic feedback, whereas using the motion capture device allows more naturalistic movements. Visual feedback assistance is also introduced to enhance immersion. A Baxter dual-arm robot is used to offer more flexibility and manoeuvrability, allowing to perform two independent operations simultaneously. Several tests have been carried out to assess the proposed system. As it is shown by the experimental results, the task duration is reduced and the overall performance improves thanks to the proposed teleoperation method