Human-Machine Interface for Remote Training of Robot Tasks

Regardless of their industrial or research application, the streamlining of robot operations is limited by the proximity of experienced users to the actual hardware. Be it massive open online robotics courses, crowd-sourcing of robot task training, or remote research on massive robot farms for machine learning, the need to create an apt remote Human-Machine Interface is quite prevalent. The paper at hand proposes a novel solution to the programming/training of remote robots employing an intuitive and accurate user-interface which offers all the benefits of working with real robots without imposing delays and inefficiency. The system includes: a vision-based 3D hand detection and gesture recognition subsystem, a simulated digital twin of a robot as visual feedback, and the "remote" robot learning/executing trajectories using dynamic motion primitives. Our results indicate that the system is a promising solution to the problem of remote training of robot tasks.Comment: Accepted in IEEE International Conference on Imaging Systems and Techniques - IST201

Learning visual docking for non-holonomic autonomous vehicles

This paper presents a new method of learning visual docking skills for non-holonomic vehicles by direct interaction with the environment. The method is based on a reinforcement algorithm, which speeds up Q-learning by applying memorybased sweeping and enforcing the “adjoining property”, a filtering mechanism to only allow transitions between states that satisfy a fixed distance. The method overcomes some limitations of reinforcement learning techniques when they are employed in applications with continuous non-linear systems, such as car-like vehicles. In particular, a good approximation to the optimal behaviour is obtained by a small look-up table. The algorithm is tested within an image-based visual servoing framework on a docking task. The training time was less than 1 hour on the real vehicle. In experiments, we show the satisfactory performance of the algorithm

Distributed coordinate tracking control of multiple wheeled mobile robots

In this thesis, distributed coordinate tracking control of multiple wheeled-mobile robots is studied. Control algorithms are proposed for both kinematic and dynamic models. All vehicle agents share the same mechanical structure. The communication topology is leader-follower topology and the reference signal is generated by the virtual leader. We will introduce two common kinematic models of WMR and control algorithms are proposed for both kinematic models with the aid of graph theory. Since it is more realistic that the control inputs are torques so dynamic extension is studied following by the kinematics. Torque controllers are designed with the aid of backstepping method so that the velocities of the mobile robots converge to the desired velocities. Because of the fact that in practice, the inertial parameter of WMR maybe not exactly known or even unknown, so both dynamics with and without inertial uncertainties are considered in this thesis