Nordahl, Rolf

English

Rolf Nordahl, Medialogy in Copenhagen, will be giving an invited series of lectures at Yale University, Connecticut, USA in the last week of March, 2010. Rolf has been invited to give talks to Professors, research fellows, Ph.D.'s and graduate students of Yale University (USA), on his research in several topics. The lectures will address his innovative experiments on using methods from Film and Filmsound to inform research in Computer Games and Virtual Reality applications with real-life examples from the Natural Interactive Walking (NIW) project - a EU-funded project headed at Aalborg University Copenhagen by himself and Associate Professor Stefania Serafin

    Aalborg UniversitetInvited series of talks and lectures at Yale University (USA) on Rolf Nordahl's researchPresentation of Rolf Nordahls research on Presence and the "Natural Interactive Walking"project (FET OPEN, FP7)Nordahl, RolfPublication date:2010Document VersionPublisher's PDF, also known as Version of recordLink to publication from Aalborg UniversityCitation for published version (APA):Nordahl, R. (2010, Mar 25). Invited series of talks and lectures at Yale University (USA) on Rolf Nordahl'sresearch: Presentation of Rolf Nordahls research on Presence and the "Natural Interactive Walking"project (FET OPEN, FP7). (1 ed.).General rightsCopyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright ownersand it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights.            ? Users may download and print one copy of any publication from the public portal for the purpose of private study or research.            ? You may not further distribute the material or use it for any profit-making activity or commercial gain            ? You may freely distribute the URL identifying the publication in the public portal ?Take down policyIf you believe that this document breaches copyright please contact us at vbn@aub.aau.dk providing details, and we will remove access tothe work immediately and investigate your claim.Downloaded from vbn.aau.dk on: November 29, 2020S i i t ti d i t h don c  n erac on  es gn  o en ance presence an  motion in virtual environmentsRolf Nordahl Presenting at Yale University March 25th  & 26th 2010d l A lb U hMe ia ogy,  a org  niversity Copen agenrn@media.aau.dkO e iev rv w• MotivationE i t l D i• xper men a   es gn• Results• Future DirectionsMoti atiov nProblem: While subjects appreciate the visual quality of experiencing Image Based Rendering techniques, d i t i i hi h h l d tynam c even s were m ss ng w c  per aps  ea   o a smaller amount of movement.Through previous research we have experimented with:a. Static Sound Design (8 – Channel): Role of soundscapes in photorealistic environmentsb. Experiments with rendering acoustics for selfmovement without any additional sounds. Shoes and sensors• Pressure sensitive shoes• Realtime rendering of one’s own     footsteps• Wired solution Earlier findings• A system prototype was succesfully built         • The system has no intrinsic delay• Threshold for audio‐haptic latency is heightened by 20               ms when visual stimuli is introduced = visual modality is still dominant• Recognition of sound is improved with bi‐modal stimuli.• Sound synthesis was succesfull in most cases – however other algorithms for granular surfaces should be explored.• Presence significantly increases when audio rendering of footsteps is introducedGoalsTo understand how different kinds of sound designs affect the subject’s motion and perceived feeling of presence.Experiments with both self sounds and soundscapesWish to understand if sound helps to increase the ti f bj tmo on o  su ec sWi d Shre   oesWi ele Shoer ss  sCreation of footsteps S d th i• oun  syn es s– Easiness, realism, customisability   • Synthesis of different surfaces• Using physically informed stochastic models (Cook) and modal synthesis (Adrien).• Visuals delivered by Image Based Rendering method (BENOGO)• 3D Audio delivered through 8 channel speaker             systemExperimental DesignAuditory stimuli• Prerendered soundscape• Dynamic moving sound sources (3D)• Footstep synthesis126 tests were run succesfully and were divided as follows to the 6 conditionsExperimental Conditions in LaboratoryFull = 21 subjects Full sequenced = 21 subjectsVisual Only 21 subjects  =   Music = 21 subjectsVisual w. footsteps = 21 subjectsd bSoun  + 3D = 21 su jectsVi l f db ksua   ee acBenogo botanical gardenRe ults sTracked Full Visuals Visuals w. Sound + movement Full Music Seq only footsteps 3DMean 26,47 20,95 25,19 21,41 22,82 21,77Median 26,54 20,79 24,31 21,61 25,66 21,87st.d. 5,6 6,38 5,91 6,39 6,89 6,74E lidi di t ti (180 )uc an s ance over me  secsRe ults s Full Visual Visual w. Sound +Full Music seq. only  foot  3DFullMusic 0 003.Full seq. 0.243 0.018VisualOnly 0.006 0.41 0.03Visual w. foot 0.04 0.197 0.132 0.26Sound + 3D 0.011 0.347 0.048 0.431 0.32Experimental DesignThe movements of the subjects are tracked.             We have created 2D visualizations of this movement over time.Here is a video‐clip that shows the movement of a subjectin the condition ”Visuals Only”.Experimental DesignHere is a video‐clip that shows the movement of a subject in the condition ”Full Sequenced”.ResultsBetter understanding of the role of sound in Ve’s:               •Auditory rendering of ego‐motion     •Soundscapes•3D SoundIt is interesting that it is the combination of the 3 different sound‐di i h i h b l i f icon t ons t at g ve t e  est resu t  n terms o  mot on.However there are clear significant indications that the auditory,             rendering of Ego‐motion plays a important role in motivating movement.Future DirectionsDynamic creation of soundscapes, e.g. using adaptive techniques.Possibility to render impact sounds, especially when users grab objects.Investigation on whether these results may be transferable to other media‐types (Games, Mobile Devices, 3D animated environments).

Invited series of talks and lectures at Yale University (USA) on Rolf Nordahl's research:Presentation of Rolf Nordahls research on Presence and the "Natural Interactive Walking" project (FET OPEN, FP7)

https://vbn.aau.dk/ws/files/19876810/Rolf_Nordahl_at_Yale_NIW_Presentation_2_Motivation.pdf

Invited series of talks and lectures at Yale University (USA) on Rolf Nordahl's research:Presentation of Rolf Nordahls research on Presence and the "Natural Interactive Walking" project (FET OPEN, FP7)

Abstract

Similar works

Full text

Available Versions

VBN