Mixed Reality Environment and High-Dimensional Continuification Control for Swarm Robotics

A significant challenge in control theory and technology is to devise agile and less resource-intensive experiments for evaluating the performance and feasibility of control algorithms for the collective coordination of large-scale complex systems. Many new methodologies are based on macroscopic representations of the emerging system behavior, and can be easily validated only through numerical simulations, because of the inherent hurdle of developing full scale experimental platforms. In this paper, we introduce a novel hybrid mixed reality set-up for testing swarm robotics techniques, focusing on the collective motion of robotic swarms. This hybrid apparatus combines both real differential drive robots and virtual agents to create a heterogeneous swarm of tunable size. We validate the methodology by extending to higher dimensions, and investigating experimentally, continuification-based control methods for swarms. Our study demonstrates the versatility and effectiveness of the platform for conducting large-scale swarm robotics experiments. Also, it contributes new theoretical insights into control algorithms exploiting continuification approaches

Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces

This paper contributes to a taxonomy of augmented reality and robotics based on a survey of 460 research papers. Augmented and mixed reality (AR/MR) have emerged as a new way to enhance human-robot interaction (HRI) and robotic interfaces (e.g., actuated and shape-changing interfaces). Recently, an increasing number of studies in HCI, HRI, and robotics have demonstrated how AR enables better interactions between people and robots. However, often research remains focused on individual explorations and key design strategies, and research questions are rarely analyzed systematically. In this paper, we synthesize and categorize this research field in the following dimensions: 1) approaches to augmenting reality; 2) characteristics of robots; 3) purposes and benefits; 4) classification of presented information; 5) design components and strategies for visual augmentation; 6) interaction techniques and modalities; 7) application domains; and 8) evaluation strategies. We formulate key challenges and opportunities to guide and inform future research in AR and robotics

A Novel Framework for Mixed Reality–Based Control of Collaborative Robot: Development Study

Background: Applications of robotics in daily life are becoming essential by creating new possibilities in different fields, especially in the collaborative environment. The potentials of collaborative robots are tremendous as they can work in the same workspace as humans. A framework employing a top-notch technology for collaborative robots will surely be worthwhile for further research. Objective: This study aims to present the development of a novel framework for the collaborative robot using mixed reality. Methods: The framework uses Unity and Unity Hub as a cross-platform gaming engine and project management tool to design the mixed reality interface and digital twin. It also uses the Windows Mixed Reality platform to show digital materials on holographic display and the Azure mixed reality services to capture and expose digital information. Eventually, it uses a holographic device (HoloLens 2) to execute the mixed reality–based collaborative system. Results: A thorough experiment was conducted to validate the novel framework for mixed reality–based control of a collaborative robot. This framework was successfully applied to implement a collaborative system using a 5–degree of freedom robot (xArm-5) in a mixed reality environment. The framework was stable and worked smoothly throughout the collaborative session. Due to the distributed nature of cloud applications, there is a negligible latency between giving a command and the execution of the physical collaborative robot. Conclusions: Opportunities for collaborative robots in telerehabilitation and teleoperation are vital as in any other field. The proposed framework was successfully applied in a collaborative session, and it can also be applied in other similar potential applications for robust and more promising performance

Applications of mixed reality for industry 4.0 and robotics

Předmětem této práce je rešerše současného vývoje trendu využívání smíšené reality v průmyslu a robotice a jejich možný vývoj do budoucna. Dále pak praktické seznámení se se systémem Acer Mixed Reality Headset a vytvoření virtuální scény.Focus of this thesis is research contemporary development of use of mixed reality in engineering a robotics and their possible development for the futire. Also to practicaly get to know Acer Mixed Reality Headset a creation of virtual scene.

Post-industrial Virtue Epistemology on Globalized Games and Robotics

With the development of personalized and globalized technologies, a discussion regarding how and why virtue epistemology should be an essential part of post-industrial ethical analysis on augmented technologies and use of robotics in the global age becomes crucial. These globalized technologies in the form of either game apps (i.e., Pokémon Go) or robotics like drones become through the Internet multimedia a structural part of planetary digitalization. While this development takes place, traditional virtue epistemology responds insufficiently to the devitalization of knowledge regarding manners (savoir vivre) and ways (savoir faire) of practicing and the need to respond to the sudden expansion of augmented games and drone use with personal and social intellect, responsibility, and consequently safety. The chapter intends to discuss this analysis in order to argue that a postindustrial epistemic reconfiguration of digital ethics is necessary, since augmented reality games and robotics are taking the form of massive trends for adults and nonadults, while for the first time, digital gaming and robot entertainment exceed the limits of the personal space and the virtual mode of the screen, moving out into the public realm, where reality is mixed with virtuality and human environment with unmanned robots