An Interactive VR System for Anatomy Training

In recent decades, virtual reality (VR) becomes a potential solution to enhance clinical medical (functional reeducation, training, etc.), especially with the growth evolution of technologies form both visualization (e.g., HoloLens, VR in Case, etc.) and 3D gestural interaction (Ray Casting, Free Hand, etc.) point of views. The 3D visualization of the human anatomy could be a serious asset for students in medicine. This new technology could provide a clear and realistic representation of the internal organs of the human body, without having to resort to surgery. 3D organs based-course supports visualization could be a useful tool for students, especially in their first graduate studies, to enhance their perception on human’s internal composition. This system is composed of two modules, 3D human’s anatomy visualization module and interaction module for organs manipulation. Finally, the system will be tested and evaluated with several subjects

MVC-3D: Adaptive Design Pattern for Virtual and Augmented Reality Systems

International audienceIn this paper, we present MVC-3D design pattern to develop virtual and augmented (or mixed) reality interfaces that use new types of sensors, modalities and implement specific algorithms and simulation models. The proposed pattern represents the extension of classic MVC pattern by enriching the View component (interactive View) and adding a specific component (Library). The results obtained on the development of augmented reality interfaces showed that the complexity of M, iV and C components is reduced. The complexity increases only on the Library component (L). This helps the programmers to well structure their models even if the interface complexity increases. The proposed design pattern is also used in a design process called MVC-3D in the loop that enables a seamless evolution from initial prototype to the final system

Low-cost VR Collaborative System equipped with Haptic Feedback

International audienceIn this paper, we present a low-cost virtual reality (VR) collaborative system equipped with a haptic feedback sensation system. This system is composed of a Kinect sensor for bodies and gestures detection, a microcontroller and vibrators to simulate outside interactions, and smartphone powered cardboard, all of this are put into a network implemented with Unity 3D game engine. CCS CONCEPTS • Interaction paradigms → Virtual reality; Collaborative interaction; • Hardware → Sensors and actuators; Wireless devices; KEYWORDS collaborative virtual reality, haptic feedback system

Contribution à la conception et à la réalisation d'un système de réalité augmentée pour la maintenance.

Our work presented in this thesis is part of Human Computer Interaction (HCI) and consists of designing and implementing an augmented reality system (AR) in maintenance context. In this research of Human computer Interaction (HCI), advances are important and are present in many domains such as medicine, maintenance, robotics... In this context, we have proposed an ergonomic concept of Augmented Reality systems. therefore, we have presented an ergonomic properties. In order to gain an understanding of the duality of interaction, (users interacting with part of the real world and simultaneously with part of the virtual world), we have defined an UML notation. Continuing the life cycle of interactive system from software engineering, we have discussed the software design step of the Augmented Reality system. We have defined the generic solution of software realization according to the hybrid PAC-Amodeus software architecture model for AR systems. This adapted model underscores the duality of interaction with two independent branches dedicated to the interaction with the real world and the virtual world. In collaboration with the technician, we have applied and tested our methodological results on a maintenance application, ARIMA. It provides the technician with on-screen guidance information in form of multimedia augmentation while performing a maintenance application.Nos travaux présentés dans cette thèse s'inscrivent dans le cadre de l'Interaction Homme-Machine (IHM) et contribuent à la conception et à la réalisation d'un système de réalité augmentée (RA) dans le cadre précis de la maintenance. Dans cet axe de recherche de l'IHM, les avancées sont importants et se manifestent par de nombreux systèmes présents dans des domaines aussi diverses que la médecine, la maintenance, la robotique... Dans ce contexte, nous avons proposé une démarche de conception ergonomique pour les systèmes de RA. Dans cet axe, nous avons présenté les propriétés ergonomiques. Afin de caractériser plus finement la dualité de l'interaction (Utilisateur- Monde Réel et Utilisateur-Monde Virtuel), nous avons défini la notation UML. Poursuivant le cycle de vie d'un système interactif issu du génie logiciel, nous avons abordé l'étape de la conception logicielle du système de RA. Nous avons défini une solution générique de réalisation logicielle selon le modèle d'architecture logicielle PAC-Amodeus. Ce modèle adapté souligne la dualité de l'interaction avec deux branches indépendantes dédiées à l'interaction avec le monde réel et le monde informatique. En collaboration avec le technicien, nous avons appliqué et testé nos résultats méthodologiques sur une application en maintenance. Cette application, ARIMA, permet de guider les techniciens en leur procurant des informations sous forme d'augmentations multimédia afin d'accroître leur efficacité dans des activités de maintenance

MVC-3DC: Software architecture model for designing collaborative augmented reality and virtual reality systems

International audienceIn this paper, software architecture model “MVC-3DC” for Collaborative Augmented and Virtual Reality Systems design is proposed. This model is the results of merging several aspects: Human-Computer Interaction (HCI), distribution systems, computer-supported cooperative work (CSCW) and new technologies such as augmented reality and virtual reality. MVC-3DC integrates collaboration principles between remote users. MVC-3DC allows a low dependency between components such as the core functions, 3D graphics API and data distribution modes. The proposed architectural model integrates simulation models, SDKs and algorithms for different nodes involved in a collaborative session. This facilitates interoperability and capability to manage heterogeneity and relationship between different nodes participating in the collaborative session. Finally, our model makes it possible to integrate other toolkits without completely changing the structure of collaboration model. A simple adaptation could be made

Augmented reality for photovoltaic pumping systems maintenance tasks

International audienc