Remote Control of Mobile Robot using the Virtual Reality

In this paper we present the simulation and manipulation of  teleoperation system for remote control of mobile robot using the Virtual Reality (VR). The objective of this work is to allow the operator to control and supervise a unicycle type mobile robot. In this research we followed three ways: The use of articulated robotic mobile on the Web, the design of remote environment for the experimentation using the network for the mobile robot and the  architecture of control is proposed to facilitate the piloting of the robot. This work proposes a hardware and software architecture based on communication and information technologies to control the virtual robot to improve the control towards the remote robot. A path planning method is integrated to the remote control system. Results show the real possibilities offered by this manipulation, in order to follow a trajectory of the robot and to create applications with a distance access to facilities through networks like the Internet and wireless

An Overview of Self-Adaptive Technologies Within Virtual Reality Training

This overview presents the current state-of-the-art of self-adaptive technologies within virtual reality (VR) training. Virtual reality training and assessment is increasingly used for five key areas: medical, industrial & commercial training, serious games, rehabilitation and remote training such as Massive Open Online Courses (MOOCs). Adaptation can be applied to five core technologies of VR including haptic devices, stereo graphics, adaptive content, assessment and autonomous agents. Automation of VR training can contribute to automation of actual procedures including remote and robotic assisted surgery which reduces injury and improves accuracy of the procedure. Automated haptic interaction can enable tele-presence and virtual artefact tactile interaction from either remote or simulated environments. Automation, machine learning and data driven features play an important role in providing trainee-specific individual adaptive training content. Data from trainee assessment can form an input to autonomous systems for customised training and automated difficulty levels to match individual requirements. Self-adaptive technology has been developed previously within individual technologies of VR training. One of the conclusions of this research is that while it does not exist, an enhanced portable framework is needed and it would be beneficial to combine automation of core technologies, producing a reusable automation framework for VR training

Prospects in Agricultural Engineering in the Information Age - Technological Development for the Producer and the Consumer

Rosana G. Moreira, Editor-in-Chief; Texas A&M UniversityThis is an Invited article from International Commission of Agricultural Engineering (CIGR, Commission Internationale du Genie Rural) E-Journal Volume 1 (1999): N. Sigrimis, Y. Hashimoto, A. Munack and J. De Baerdemaker. Prospects in Agricultural Engineering in the Information Age - Technological Development for the Producer and the Consumer

Feasibility Study: Development and Demonstration of Virtual Reality Simulation Training for the BHPB Olympic Dam Site Inductions

This report presents the findings of the project ―Feasibility Study: Development and Demonstration of Virtual Reality Simulation Training for the BHPB Olympic Dam Site Inductions.‖ The project was a collaborative exercise between the University of New South Wales (UNSW) - School of Mining Engineering, the University of Adelaide - Australian Centre for Visual Technologies, BHPB Olympic Dam Expansion, RESA, TAFESA and Skills DMC. The project Chief Investigators were Dr Phillip Stothard (UNSW) and Prof Anton van den Hengel (University of Adelaide).The project was a pilot study research project that looked into the feasibility of developing interactive virtual reality simulations for mine site inductions in the hard rock industry. Many simulations have been successfully implemented into the coal industry and the aim was to build a pilot module that looked at a high risk environment on a surface mine that would also have application to the wider construction industry and other heavy industries. The project collaborators came together as a group of parties interested in virtual reality simulation. The research and development was led by UNSW and University of Adelaide. Invaluable input was provided by the collaborators. The project had a value of $431, 306. Of which$208,563 was in cash and $222,743 was in kind. The budget was fully expended during the course of the project. The subject area of the project was ̳Working at Heights‘ and this was chosen because it is a high risk area. Substantial documentation, mining industry input and effort was placed on building the five sub-modules that form the Working at Heights module. The outcome is a high quality visualisation of an area of the Olympic Dam Mine Site. This high quality visualisation is enhanced by the inclusion of interaction within the module that requires the user to interrogate data within the site and to assess and understand issues that arise when working at heights in relation ladders, scaffolding, open excavations and elevated work platforms. Much project emphasis and time was placed on producing the 3D model. Also, as much information as possible was placed into the module itself as this was to be a pilot example to show to the Olympic Dam Expansion Project Team. The module allows users to interact with Safety Documentation and equipment and procedures that they would encounter on sit

Remote Monitoring and Teleoperation of Autonomous Vehicles −- Is Virtual Reality an Option?

While the promise of autonomous vehicles has led to significant scientific and industrial progress, fully automated, SAE level 5 conform cars will likely not see mass adoption anytime soon. Instead, in many applications, human supervision, such as remote monitoring and teleoperation, will be required for the foreseeable future. While Virtual Reality (VR) has been proposed as one potential interface for teleoperation, its benefits and drawbacks over physical monitoring and teleoperation solutions have not been thoroughly investigated. To this end, we contribute three user studies, comparing and quantifying the performance of and subjective feedback for a VR-based system with an existing monitoring and teleoperation system, which is in industrial use today. Through these three user studies, we contribute to a better understanding of future virtual monitoring and teleoperation solutions for autonomous vehicles. The results of our first user study (n=16) indicate that a VR interface replicating the physical interface does not outperform the physical interface. It also quantifies the negative effects that combined monitoring and teleoperating tasks have on users irrespective of the interface being used. The results of the second user study (n=24) indicate that the perceptual and ergonomic issues caused by VR outweigh its benefits, like better concentration through isolation. The third follow-up user study (n=24) specifically targeted the perceptual and ergonomic issues of VR; the subjective feedback of this study indicates that newer-generation VR headsets have the potential to catch up with the current physical displays

Virtual Reality-Based Interface for Advanced Assisted Mobile Robot Teleoperation

[EN] This work proposes a new interface for the teleoperation of mobile robots based on virtual reality that allows a natural and intuitive interaction and cooperation between the human and the robot, which is useful for many situations, such as inspection tasks, the mapping of complex environments, etc. Contrary to previous works, the proposed interface does not seek the realism of the virtual environment but provides all the minimum necessary elements that allow the user to carry out the teleoperation task in a more natural and intuitive way. The teleoperation is carried out in such a way that the human user and the mobile robot cooperate in a synergistic way to properly accomplish the task: the user guides the robot through the environment in order to benefit from the intelligence and adaptability of the human, whereas the robot is able to automatically avoid collisions with the objects in the environment in order to benefit from its fast response. The latter is carried out using the well-known potential field-based navigation method. The efficacy of the proposed method is demonstrated through experimentation with the Turtlebot3 Burger mobile robot in both simulation and real-world scenarios. In addition, usability and presence questionnaires were also conducted with users of different ages and backgrounds to demonstrate the benefits of the proposed approach. In particular, the results of these questionnaires show that the proposed virtual reality based interface is intuitive, ergonomic and easy to use.This research was funded by the Spanish Government (Grant PID2020-117421RB-C21 funded byMCIN/AEI/10.13039/501100011033) and by the Generalitat Valenciana (Grant GV/2021/181).Solanes, JE.; Muñoz García, A.; Gracia Calandin, LI.; Tornero Montserrat, J. (2022). Virtual Reality-Based Interface for Advanced Assisted Mobile Robot Teleoperation. Applied Sciences. 12(12):1-22. https://doi.org/10.3390/app12126071122121

Intelligent decision support for maintenance: an overview and future trends

The changing nature of manufacturing, in recent years, is evident in industry’s willingness to adopt network-connected intelligent machines in their factory development plans. A number of joint corporate/government initiatives also describe and encourage the adoption of Artificial Intelligence (AI) in the operation and management of production lines. Machine learning will have a significant role to play in the delivery of automated and intelligently supported maintenance decision-making systems. While e-maintenance practice provides aframework for internet-connected operation of maintenance practice the advent of IoT has changed the scale of internetworking and new architectures and tools are needed. While advances in sensors and sensor fusion techniques have been significant in recent years, the possibilities brought by IoT create new challenges in the scale of data and its analysis. The development of audit trail style practice for the collection of data and the provision of acomprehensive framework for its processing, analysis and use should be avaluable contribution in addressing the new data analytics challenges for maintenance created by internet connected devices. This paper proposes that further research should be conducted into audit trail collection of maintenance data, allowing future systems to enable ‘Human in the loop’ interactions