INTERACTIVE PHYSICAL DESIGN AND HAPTIC PLAYING OF VIRTUAL MUSICAL INSTRUMENTS

International audienceIn Computer Music, a practical approach of many Digital Musical Instruments is to separate the gestural input stage from the sound synthesis stage. While these instruments offer many creative possibilities, they present a strong rupture with traditional acoustic instruments, as the physical coupling between human and sound is broken. This coupling plays a crucial role for the expressive musical playing of acoustic instruments; we believe restoring it in a digital context is of equal importance for revealing the full expressive potential of digital instruments. This paper first presents haptic and physical modelling technologies for representing the mechano-acoustical instrumental situation in the context of DMIs. From these technologies, a prototype environment has been implemented for both designing virtual musical instruments and interacting with them via a force feedback device, able to preserve the energetic coherency of the musician-sound chain

Exploration of Reaction Pathways and Chemical Transformation Networks

For the investigation of chemical reaction networks, the identification of all relevant intermediates and elementary reactions is mandatory. Many algorithmic approaches exist that perform explorations efficiently and automatedly. These approaches differ in their application range, the level of completeness of the exploration, as well as the amount of heuristics and human intervention required. Here, we describe and compare the different approaches based on these criteria. Future directions leveraging the strengths of chemical heuristics, human interaction, and physical rigor are discussed.Comment: 48 pages, 4 figure

A MODELLER-SIMULATOR FOR INSTRUMENTAL PLAYING OF VIRTUAL MUSICAL INSTRUMENTS

International audienceThis paper presents a musician-oriented modelling and simulation environment for designing physically modelled virtual instruments and interacting with them via a high performance haptic device. In particular, our system allows restoring the physical coupling between the user and the manipulated virtual instrument, a key factor for expressive playing of traditional acoustical instruments that is absent in the vast majority of computer-based musical systems. We first analyse the various uses of haptic devices in Computer Music, and introduce the various technologies involved in our system. We then present the modeller and simulation environments, and examples of musical virtual instruments created with this new environment

Virtual Reality Games for Motor Rehabilitation

This paper presents a fuzzy logic based method to track user satisfaction without the need for devices to monitor users physiological conditions. User satisfaction is the key to any product’s acceptance; computer applications and video games provide a unique opportunity to provide a tailored environment for each user to better suit their needs. We have implemented a non-adaptive fuzzy logic model of emotion, based on the emotional component of the Fuzzy Logic Adaptive Model of Emotion (FLAME) proposed by El-Nasr, to estimate player emotion in UnrealTournament 2004. In this paper we describe the implementation of this system and present the results of one of several play tests. Our research contradicts the current literature that suggests physiological measurements are needed. We show that it is possible to use a software only method to estimate user emotion

Interactive molecular dynamics in virtual reality from quantum chemistry to drug binding: An open-source multi-person framework

© 2019 Author(s). As molecular scientists have made progress in their ability to engineer nanoscale molecular structure, we face new challenges in our ability to engineer molecular dynamics (MD) and flexibility. Dynamics at the molecular scale differs from the familiar mechanics of everyday objects because it involves a complicated, highly correlated, and three-dimensional many-body dynamical choreography which is often nonintuitive even for highly trained researchers. We recently described how interactive molecular dynamics in virtual reality (iMD-VR) can help to meet this challenge, enabling researchers to manipulate real-time MD simulations of flexible structures in 3D. In this article, we outline various efforts to extend immersive technologies to the molecular sciences, and we introduce "Narupa," a flexible, open-source, multiperson iMD-VR software framework which enables groups of researchers to simultaneously cohabit real-time simulation environments to interactively visualize and manipulate the dynamics of molecular structures with atomic-level precision. We outline several application domains where iMD-VR is facilitating research, communication, and creative approaches within the molecular sciences, including training machines to learn potential energy functions, biomolecular conformational sampling, protein-ligand binding, reaction discovery using "on-the-fly" quantum chemistry, and transport dynamics in materials. We touch on iMD-VR's various cognitive and perceptual affordances and outline how these provide research insight for molecular systems. By synergistically combining human spatial reasoning and design insight with computational automation, technologies such as iMD-VR have the potential to improve our ability to understand, engineer, and communicate microscopic dynamical behavior, offering the potential to usher in a new paradigm for engineering molecules and nano-architectures

Real-time hybrid cutting with dynamic fluid visualization for virtual surgery

It is widely accepted that a reform in medical teaching must be made to meet today's high volume training requirements. Virtual simulation offers a potential method of providing such trainings and some current medical training simulations integrate haptic and visual feedback to enhance procedure learning. The purpose of this project is to explore the capability of Virtual Reality (VR) technology to develop a training simulator for surgical cutting and bleeding in a general surgery

Virtuālās Realitātes mācīšanās taksonomija

Promocijas darbs tika izstrādāts izglītības zinātņu nozarē, vispārīgās pedagoģijas apakšnozarē Latvijas Universitātes Pedagoģijas, psiholoģijas un mākslas fakultātē, profesores, Dr. paed. Lindas Danielas vadībā. Darba apjoms ir 147 lpp., ieskaitot 30 attēlus un 16 tabulas, kā arī literatūras un avotu sarakstu ar 114 nosaukumiem. Darbam papildus pievienoti arī 2 pielikumi uz 21 lpp. Pētījuma mērķis ir informēt pedagogus un mācīšanas dizaina izstrādātājus, kā arī VR tehnoloģiju izstrādātājus, un potenciālos izglītojamos par VR mācīšanās principiem, tostarp, to sinerģijām un mijsakarībām, piedāvājot pamatotu teoriju virtuālās realitātes mācīšanās taksonomijai. Šī pētījuma nozīmīgākais devums ietver esošo, bet sadrumstaloto zināšanu apkopošanu un sistematizēšanu, pierādījumos balstītas teorētiskās bāzes izstrādi virtuālās realitātes mācīšanās taksonomijai, kā arī praktisku VR mācīšanas pieredžu dizaina un izvērtēšanas rīku izstrādiThe doctoral thesis by Lana Frančeska Dreimane titled “Taxonomy of Learning in Virtual Reality” was developed in the field of Education at the Faculty of Education, Psychology and Arts of the University of Latvia, under supervision of Dr. paed., professor Linda Daniela. The volume of the thesis is 147 pages, 30 figures and 16 tables in the main text, as well as list of bibliographic sources with 114 titles and 2 appendices. This research aims to inform educators and instructors, as well as VR technology developers and potential learners, about the alignment synergies and interconnections of VR learning principles by generating a substantive theory for the taxonomy of learning in Virtual Reality. The most important contribution of this inquiry is in systemising already existing but fragmented knowledge, and presenting evidence for theoretical basis for the taxonomy, as well as developing VR learning experience design and evaluation tools for practical applications