Characterizing Embodied Interaction in First and Third Person Perspective Viewpoints

Third Person Perspective (3PP) viewpoints have the potential to expand how one perceives and acts in a virtual environment. They offer increased awareness of the posture and of the surrounding of the virtual body as compared to First Person Perspective (1PP). But from another standpoint, 3PP can be considered as less effective for inducing a strong sense of embodiment into a virtual body. Following an experimental paradigm based on full body motion capture and immersive interaction, this study investigates the effect of perspective and of visuomotor synchrony on the sense of embodiment. It provides evidence supporting a high sense of embodiment in both 1PP and 3PP during engaging motor tasks, as well as guidelines for choosing the optimal perspective depending on location of targets

De la présence à l’incarnation: proposition d’un méta-modèle pour la réalité virtuelle

Les sentiments de présence et d’incarnation sont deux dimensions centrales de l’expérience utilisateur en environnement virtuel immersif. Suite à une revue de littérature portant sur ces deux concepts, nous en proposons une articulation théorique au sein d’un méta-modèle « Présence – Incarnation ». L’introduction de ce modèle aboutit à la proposition d’un questionnaire permettant l’évaluation subjective des sentiments de présence et d’incarnation d’utilisateurs immergés dans une application de réalité virtuelle. Les implications méthodologiques de ce modèle et ses perspectives applicatives sont ensuite évoquées afin d’introduire la ligne directrice de nos travaux futurs

Characterizing first and third person viewpoints and their alternation for embodied interaction in virtual reality

Empirical research on the bodily self has shown that the body representation is malleable, and prone to manipulation when conflicting sensory stimuli are presented. Using Virtual Reality (VR) we assessed the effects of manipulating multisensory feedback (full body control and visuo-tactile congruence) and visual perspective (first and third person perspective) on the sense of embodying a virtual body that was exposed to a virtual threat. We also investigated how subjects behave when the possibility of alternating between first and third person perspective at will was presented. Our results support that illusory ownership of a virtual body can be achieved in both first and third person perspectives under congruent visuo-motor-tactile condition. However, subjective body ownership and reaction to threat were generally stronger for first person perspective and alternating condition than for third person perspective. This suggests that the possibility of alternating perspective is compatible with a strong sense of embodiment, which is meaningful for the design of new embodied VR experiences

Interaction for creative applications with the Kinect v2 device

Human-Computer Interaction (HCI) is a multidisciplinary field of research that designs, evaluates and implements interactive ways of communication between computer systems and people. The evolution of different technologies in the last decades has contributed to the expansion of HCI into other fields of study as computer vision, cognitive science, psychology, industrial design, and also into interactive art. The present document contains a case of HCI in the context of interactive art. In a first step we analyse what kind of interaction can be achieved with the available equipment: a range imaging camera, a computer and a video projector. Then, three range imaging techniques capable of fulfilling our objective are studied and some devices available for purchasing and based on these techniques are compared. Thereafter, we study and compare the two acquired range imaging devices: the Kinect for Windows v1 and the Kinect for Windows v2. In a later step we build our interaction system with the Kinect for Windows v2 and we test it. We use Processing as a programming environment in order to apply creative coding and to try the different types of interaction that this device allows. Finally, with the experience gained in the previous studies and in these test, we present three final interactive programs

The Sense of Self and Sensorimotor Functions

This thesis investigates whether biological sex and motor function have a role in the visual representation of the self. The principal contribution is a new virtual reality experiment that systematically varied an avatar’s sex and motion, after which participants recorded judgments about the relationship between themselves and the avatar. Virtual reality aims to produce the authentic experience of being present or the feeling of being there in an artificial environment. The third person perspective is similar to looking at oneself in a mirror but different than the first-person perspective, which places the user inside the body of the avatar, which are virtual simulated characters that can act as a visual representation of the self. The experiment assessed the role of biological sex and self-motion by presenting participants with pairs of avatars that visually represent the participant (“self avatar”), or another person (“opposite avatar”). Additionally, the avatars’ motion either corresponded to the participant’s motion, or was decoupled from the participant’s motion. Decoupled motion consisted of swaying slightly from side to side. By manipulating sex and motion, I tested whether these aspects affect how participants perceive themselves. The results support the conclusion that sex and normal motion both affect the visual representation of the self. These results relate to two theories of bodily awareness: the representationalist theory and sensorimotor theory. These theories explain how individuals come to have awareness of their bodies from the inside. While the representational theory focuses on sensorimotor representations, the sensorimotor theory focuses on sensorimotor functions and voluntary action. The results relate to the representational theory because sex and motion are both relevant to the body schema and body image. Although there is no consensus among researchers of their definitions, body schema is generally regarded as an unconscious, bottom-up, dynamic representation, relying on proprioceptive information from the muscles, joints, and skin. On the other hand, the body image is a more conscious, top down, cognitive representation, incorporating semantic knowledge of the body, and mostly used to make perceptual judgements. The results relate to the sensorimotor approach since motion and sensorimotor functions were manipulated. This finding is limited, however, by the fact that participants were not affected by motion in some trials

Embodiment and Presence in Virtual Reality After Stroke. A Comparative Study With Healthy Subjects

[EN] The ability of virtual reality (VR) to recreate controlled, immersive, and interactive environments that provide intensive and customized exercises has motivated its therapeutic use after stroke. Interaction and bodily presence in VR-based interventions is usually mediated through virtual selves, which synchronously represent body movements or responses to events on external input devices. Embodied self-representations in the virtual world not only provide an anchor for visuomotor tasks, but their morphologies can have behavioral implications. While research has focused on the underlying subjective mechanisms of exposure to VR on healthy individuals, the transference of these findings to individuals with stroke is not evident and remains unexplored, which could affect the experience and, ultimately, the clinical effectiveness of neurorehabilitation interventions. This study determined and compared the sense of embodiment and presence elicited by a virtual environment under different perspectives and levels of immersion in healthy subjects and individuals with stroke. Forty-six healthy subjects and 32 individuals with stroke embodied a gender-matched neutral avatar in a virtual environment that was displayed in a first-person perspective with a head-mounted display and in a third-person perspective with a screen, and the participants were asked to interact in a virtual task for 10 min under each condition in counterbalanced order, and to complete two questionnaires about the sense of embodiment and presence experienced during the interaction. The sense of body-ownership, self-location, and presence were more vividly experienced in a first-person than in a third-person perspective by both healthy subjects (p < 0.001, eta(2)(p) = 0.212; p = 0.005, eta(2)(p) = 0.101; p = 0.001, eta(2)(p) = 0.401, respectively) and individuals with stroke (p = 0.019, eta(2)(p) = 0.070; p = 0.001, eta(2)(p) = 0.135; p = 0.014, eta(2)(p) = 0.077, respectively). In contrast, no agency perspective-related differences were found in any group. All measures were consistently higher for healthy controls than for individuals with stroke, but differences between groups only reached statistical significance in presence under the first-person condition (p < 0.010, eta(2)(p) = 0.084). In spite of these differences, the participants experienced a vivid sense of embodiment and presence in almost all conditions. These results provide first evidence that, although less intensively, embodiment and presence are similarly experienced by individuals who have suffered a stroke and by healthy individuals, which could support the vividness of their experience and, consequently, the effectiveness of VR-based interventions.This study was funded by Ministerio de Economía y Competitividad of Spain (Project RTC-2017-6051-7 and Grant BES-2014-068218), Fundació la Marató de la TV3 (Grant 201701-10), and Universitat Politècnica de València (Grant PAID-10-18). We acknowledge the support of NVIDIA Corporation with the donation of the Titan Xp GPU used for this research.Borrego, A.; Latorre, J.; Alcañiz Raya, ML.; Llorens Rodríguez, R. (2019). Embodiment and Presence in Virtual Reality After Stroke. A Comparative Study With Healthy Subjects. Frontiers in Neurology. 10:1-8. https://doi.org/10.3389/fneur.2019.01061S1810Berlucchi, G., & Aglioti, S. (1997). The body in the brain: neural bases of corporeal awareness. Trends in Neurosciences, 20(12), 560-564. doi:10.1016/s0166-2236(97)01136-3Legrand, D. (2006). The Bodily Self: The Sensori-Motor Roots of Pre-Reflective Self-Consciousness. Phenomenology and the Cognitive Sciences, 5(1), 89-118. doi:10.1007/s11097-005-9015-6Arzy, S., Overney, L. S., Landis, T., & Blanke, O. (2006). Neural Mechanisms of Embodiment. Archives of Neurology, 63(7), 1022. doi:10.1001/archneur.63.7.1022De Vignemont, F. (2011). Embodiment, ownership and disownership. Consciousness and Cognition, 20(1), 82-93. doi:10.1016/j.concog.2010.09.004Giummarra, M. J., Gibson, S. J., Georgiou-Karistianis, N., & Bradshaw, J. L. (2008). Mechanisms underlying embodiment, disembodiment and loss of embodiment. Neuroscience & Biobehavioral Reviews, 32(1), 143-160. doi:10.1016/j.neubiorev.2007.07.001Ma, K., & Hommel, B. (2015). The role of agency for perceived ownership in the virtual hand illusion. Consciousness and Cognition, 36, 277-288. doi:10.1016/j.concog.2015.07.008Kilteni, K., Maselli, A., Kording, K. P., & Slater, M. (2015). Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception. Frontiers in Human Neuroscience, 9. doi:10.3389/fnhum.2015.00141Clark, A., Kiverstein, J., & Vierkant, T. (Eds.). (2013). Decomposing the Will. doi:10.1093/acprof:oso/9780199746996.001.0001Frith, C. D., Blakemore, S.-J., & Wolpert, D. M. (2000). Abnormalities in the awareness and control of action. Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences, 355(1404), 1771-1788. doi:10.1098/rstb.2000.0734Bermúdez i Badia, S., Fluet, G. G., Llorens, R., & Deutsch, J. E. (2016). Virtual Reality for Sensorimotor Rehabilitation Post Stroke: Design Principles and Evidence. Neurorehabilitation Technology, 573-603. doi:10.1007/978-3-319-28603-7_28Perez-Marcos, D., Sanchez-Vives, M. V., & Slater, M. (2011). Is my hand connected to my body? The impact of body continuity and arm alignment on the virtual hand illusion. Cognitive Neurodynamics, 6(4), 295-305. doi:10.1007/s11571-011-9178-5IJsselsteijn, W. A., de Kort, Y. A. W., & Haans, A. (2006). Is This My Hand I See Before Me? The Rubber Hand Illusion in Reality, Virtual Reality, and Mixed Reality. Presence: Teleoperators and Virtual Environments, 15(4), 455-464. doi:10.1162/pres.15.4.455Banakou, D., Groten, R., & Slater, M. (2013). Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes. Proceedings of the National Academy of Sciences, 110(31), 12846-12851. doi:10.1073/pnas.1306779110Yee, N., & Bailenson, J. (2007). The Proteus Effect: The Effect of Transformed Self-Representation on Behavior. Human Communication Research, 33(3), 271-290. doi:10.1111/j.1468-2958.2007.00299.xSteed, A., Frlston, S., Lopez, M. M., Drummond, J., Pan, Y., & Swapp, D. (2016). An ‘In the Wild’ Experiment on Presence and Embodiment using Consumer Virtual Reality Equipment. IEEE Transactions on Visualization and Computer Graphics, 22(4), 1406-1414. doi:10.1109/tvcg.2016.2518135Colomer, C., Llorens, R., Noé, E., & Alcañiz, M. (2016). Effect of a mixed reality-based intervention on arm, hand, and finger function on chronic stroke. Journal of NeuroEngineering and Rehabilitation, 13(1). doi:10.1186/s12984-016-0153-6Laver, K. E., Lange, B., George, S., Deutsch, J. E., Saposnik, G., & Crotty, M. (2017). Virtual reality for stroke rehabilitation. Cochrane Database of Systematic Reviews. doi:10.1002/14651858.cd008349.pub4Llorens, R., Borrego, A., Palomo, P., Cebolla, A., Noé, E., i Badia, S. B., & Baños, R. (2017). Body schema plasticity after stroke: Subjective and neurophysiological correlates of the rubber hand illusion. Neuropsychologia, 96, 61-69. doi:10.1016/j.neuropsychologia.2017.01.007Zeller, D., Gross, C., Bartsch, A., Johansen-Berg, H., & Classen, J. (2011). Ventral Premotor Cortex May Be Required for Dynamic Changes in the Feeling of Limb Ownership: A Lesion Study. Journal of Neuroscience, 31(13), 4852-4857. doi:10.1523/jneurosci.5154-10.2011Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). «Mini-mental state». Journal of Psychiatric Research, 12(3), 189-198. doi:10.1016/0022-3956(75)90026-6Romero, M., Sánchez, A., Marín, C., Navarro, M. D., Ferri, J., & Noé, E. (2012). Clinical usefulness of the Spanish version of the Mississippi Aphasia Screening Test (MASTsp): validation in stroke patients. Neurología (English Edition), 27(4), 216-224. doi:10.1016/j.nrleng.2011.06.001Latorre, J., Llorens, R., Colomer, C., & Alcañiz, M. (2018). Reliability and comparison of Kinect-based methods for estimating spatiotemporal gait parameters of healthy and post-stroke individuals. Journal of Biomechanics, 72, 268-273. doi:10.1016/j.jbiomech.2018.03.008Lloréns, R., Noé, E., Naranjo, V., Borrego, A., Latorre, J., & Alcañiz, M. (2015). Tracking Systems for Virtual Rehabilitation: Objective Performance vs. Subjective Experience. A Practical Scenario. Sensors, 15(3), 6586-6606. doi:10.3390/s150306586Slater, M., & Steed, A. (2000). A Virtual Presence Counter. Presence: Teleoperators and Virtual Environments, 9(5), 413-434. doi:10.1162/105474600566925Slater, M., Spanlang, B., Sanchez-Vives, M. V., & Blanke, O. (2010). First Person Experience of Body Transfer in Virtual Reality. PLoS ONE, 5(5), e10564. doi:10.1371/journal.pone.0010564Petkova, V. I., Khoshnevis, M., & Ehrsson, H. H. (2011). The Perspective Matters! Multisensory Integration in Ego-Centric Reference Frames Determines Full-Body Ownership. Frontiers in Psychology, 2. doi:10.3389/fpsyg.2011.00035Maselli, A., & Slater, M. (2013). The building blocks of the full body ownership illusion. Frontiers in Human Neuroscience, 7. doi:10.3389/fnhum.2013.00083Debarba, H. G., Molla, E., Herbelin, B., & Boulic, R. (2015). Characterizing embodied interaction in First and Third Person Perspective viewpoints. 2015 IEEE Symposium on 3D User Interfaces (3DUI). doi:10.1109/3dui.2015.7131728Burin, D., Livelli, A., Garbarini, F., Fossataro, C., Folegatti, A., Gindri, P., & Pia, L. (2015). Are Movements Necessary for the Sense of Body Ownership? Evidence from the Rubber Hand Illusion in Pure Hemiplegic Patients. PLOS ONE, 10(3), e0117155. doi:10.1371/journal.pone.0117155Post-stroke cognitive disorders TeasellR SalterK FaltynekP CotoiA EskesG Evidence-Based Review of Stroke Rehabilitatio

가상현실에서 몸의 자세와 공간인지, 공간이동방법, 존재감, 사이버멀미의 상호작용에 대한 연구

학위논문 (박사) -- 서울대학교 대학원 : 인문대학 협동과정 인지과학전공, 2021. 2. 이경민.가상현실은 몸과 마음이 공간에 함께 존재한다는 일상적 경험에 대해 새로운 관점을 제시한다. 컴퓨터로 매개된 커뮤니케이션에서 많은 경우 사용자들은 몸은 배제되며 마음의 존재가 중요하다고 느끼게 된다. 이와 관련하여 가상현실은 사용자들에게 커뮤니케이션에 있어 물리적 몸의 역할과 비체화된 상호작용의 중요성에 대해 연구할 수 있는 기회를 제공한다. 기존 연구에 의하면 실행, 주의집중, 기억, 지각과 같은 인지기능들이 몸의 자세에 따라 다르게 작용한다고 한다. 하지만 이와 같은 인지기능들과 몸 자세의 상호연관성은 여전히 명확히 밝혀지고 있지 않다. 특히 가상현실에서 몸의 자세가 지각반응에 대한 인지과정에 어떤 작용을 하는지에 대한 이해는 매우 부족한 상황이다. 가상현실 연구자들은 존재감을 가상현실의 핵심 개념으로 정의하였으며 효율적인 가상현실 시스템 구성과 밀접한 관계가 있다고 한다. 존재감은 가상공간에 있다고 느끼는 의식상태를 말한다. 구체적으로 가상현실 속 경험을 실재 존재한다고 느끼는 의식상태를 말한다. 이런 존재감이 높을 수록 현실처럼 인지하기에 존재감은 가상현실 경험을 측정하는 중요한 지표이다. 따라서 가상공간에 존재하고 있다는 의식적 경험 ((거기에 있다(being there)), 즉 존재감은 매개된 가상경험들의 인지 연구에 중요한 개념이다. 가상현실은 사이버멀미를 유발하는 것으로 알려져 있다. 이 증상은 가상현실의 사용성을 제약하는 주요 요인으로 효과적인 가상현실 경험을 위해 사이버멀미에 대한 다양한 연구가 필요하다. 사이버멀미는 가상현실 시스템을 사용할때 나타나며 어지러움, 방향상실, 두통, 땀흘림, 눈피로도등의 증상을 포함한다. 이런 사이버멀미에는 개인차, 사용된 기술, 공간디자인, 수행된 업무등 매우 다양 요인들이 관여하고 있어 명확한 원인을 규정할 수 없다. 이런 배경으로 인해 사이버멀미 저감과 관련한 다양한 연구들이 필요하며 이는 가상현실 발전에 중요한 의미를 갖는다. 공간인지는 3차원 공간에서 신체 움직임과 대상과의 상호작용에 중요한 역할을 하는 인지시스템이다. 가상공간에서 신체 움직임은 네비게이션, 사물조작, 다른 에이전트들과 상호작용에 관여한다. 특히 가상공간에서 네비게이션은 자주 사용되는 중요한 상호작용 방식이다. 이에 가상공간을 네비게이션 할때 존재감에 영향을 주지 않고 멀미증상을 유발하지 않는 효과적인 공간이동 방법에 대한 다양한 연구들이 이루어지고 있다. 이전 연구들에 의하면 시점이 존재감과 체화감에 영향을 준다고 한다. 이는 시점에 따라 사용자의 행동과 대상들과의 상호작용 방식에 달라지기 때문이다. 따라서 가상공간에서 경험 또한 시점에 따라 달라진다. 이런 배경으로 몸의 자세, 공간인지, 이동방법, 존재감, 사이버멀미의 상호 연관성에 대한 연구를 시점에 따라 분류해서 연구할 필요가 있다. 이를 통해 가상현실 속 공간 네비게이션에 대한 인지과정을 보다 다각적으로 이해 할 수 있을 것이다. 그동안 존재감과 사이버 멀미에 내재된 매커니즘을 이해하기 위해 다양한 연구들이 진행되어 왔다. 하지만 몸의 자세에 따른 인지작용이 존재감과 사이버멀미에 어떤 영향을 주는지에 대한 연구는 거의 이루어지지 않았다. 이에 본 학위논문에서는 1인칭과 3인칭 시점으로 분류된 별도의 실험과 연구를 진행하여 가상현실에서 몸의 자세와 공간인지, 공간이동방법, 존재감, 사이버멀미의 상호연관성을 보다 심층적으로 이해하고자 한다. 제3장에서는 3인칭시점의 실험과 결과에 대한 내용을 기술했다. 3인칭시점 실험에서는 가상공간에서 몸의 자세와 존재감의 상호연관성 연구를 위해 세가지 몸의 자세 (서있는 자세, 앉은 자세, 다리를 펴고 앉은 자세)와 2가지 타입의 공간이동 자유도 (무한, 유한)를 상호 비교했다. 실험결과에 의하면 공간이동 자유도가 무한한 경우 서있는 자세에서 존재감이 높게 나타났다. 추가적으로 가상공간에서 몸의 자세와 존재감은 공간이동자유도와 관련이 있는 것으로 나타났으며 여러 인지기능 중 주의집중이 몸의 자세, 존재감, 공간인지의 통합적 상호작용을 이끌어 낸 것으로 파악되었다. 3인칭시점의 결과들을 종합해 보면 몸 자세의 인지적 영향은 공간이동자유도와 상관관계가 있는 것으로 추측할 수 있다. 제4장에서는 1인칭시점의 실험과 결과에 대한 내용을 기술했다. 1인칭시점 실험에서는 가상공간에서 몸의 자세, 공간이동방법, 존재감, 사이버멀미의 상호연관성 연구를 위해 두 조건의 몸의 자세 (서있는 자세, 앉아 있는 자세)와 네가지 타입의 이동방법 (스티어링 + 몸을 활용한 회전, 스티어링 + 도구를 활용한 회전, 텔레포테이션 + 몸을 이용한 회전, 텔레포테이션 + 도구를 활용한 회전)의 상호 비교가 이루어 졌다. 실험결과에 의하면 위치이동방식과 회전방식에 따른 공간이동자유도는 성공적인 네비게이션과 관련이 있으며 존재감에 영향을 주는 것으로 나타났다. 추가적으로 연속적으로 시각정보가 입력되는 스티어링 방법은 자가운동을 높여 비연속적 방법인 텔레포테이션보다 사이버멀미를 더 유발하는 것으로 나타났다. 1인칭시점의 결과들을 종합해 보면 가상공간에서 네비게이션을 할때 존재감과 사이버멀미는 공간이동방법과 관련이 있는 것으로 가정할 수 있다. 제3장의 3인칭 시점 실험결과에 의하면 몸의 자세와 존재감은 상관관계가 있는 것으로 제시되었다. 반면 제4장의 실험결과에 의하면 1인칭시점으로 가상공간을 네비게이션 할 때는 공간이동방법이 존재감과 사이버멀미에 영향을 주는 것으로 나타났다. 이 두 실험에 대한 연구 결과를 통해 가상현실에서 몸의 자세와 공간인지 (네비게이션)의 상호연관성에 대한 이해를 확대하고 존재감 및 사이버멀미와 공간이동방법의 관련성을 밝힐 수 있을 것으로 기대한다.Immersive virtual environments (VEs) can disrupt the everyday connection between where our senses tell us we are and where we are actually located. In computer-mediated communication, the user often comes to feel that their body has become irrelevant and that it is only the presence of their mind that matters. However, virtual worlds offer users an opportunity to become aware of and explore both the role of the physical body in communication, and the implications of disembodied interactions. Previous research has suggested that cognitive functions such as execution, attention, memory, and perception differ when body position changes. However, the influence of body position on these cognitive functions is still not fully understood. In particular, little is known about how physical self-positioning may affect the cognitive process of perceptual responses in a VE. Some researchers have identified presence as a guide to what constitutes an effective virtual reality (VR) system and as the defining feature of VR. Presence is a state of consciousness related to the sense of being within a VE; in particular, it is a ‘psychological state in which the virtuality of the experience is unnoticed’. Higher levels of presence are considered to be an indicator of a more successful media experience, thus the psychological experience of ‘being there’ is an important construct to consider when investigating the association between mediated experiences on cognition. VR is known to induce cybersickness, which limits its application and highlights the need for scientific strategies to optimize virtual experiences. Cybersickness refers to the sickness associated with the use of VR systems, which has a range of symptoms including nausea, disorientation, headaches, sweating and eye strain. This is a complicated problem because the experience of cybersickness varies greatly between individuals, the technology being used, the design of the environment, and the task being performed. Thus, avoiding cybersickness represents a major challenge for VR development. Spatial cognition is an invariable precursor to action because it allows the formation of the necessary mental representations that code the positions of and relationships among objects. Thus, a number of bodily actions are represented mentally within a depicted VR space, including those functionally related to navigation, the manipulation of objects, and/or interaction with other agents. Of these actions, navigation is one of the most important and frequently used interaction tasks in VR environments. Therefore, identifying an efficient locomotion technique that does not alter presence nor cause motion sickness has become the focus of numerous studies. Though the details of the results have varied, past research has revealed that viewpoint can affect the sense of presence and the sense of embodiment. VR experience differs depending on the viewpoint of a user because this vantage point affects the actions of the user and their engagement with objects. Therefore, it is necessary to investigate the association between body position, spatial cognition, locomotion method, presence, and cybersickness based on viewpoint, which may clarify the understanding of cognitive processes in VE navigation. To date, numerous detailed studies have been conducted to explore the mechanisms underlying presence and cybersickness in VR. However, few have investigated the cognitive effects of body position on presence and cybersickness. With this in mind, two separate experiments were conducted in the present study on viewpoint within VR (i.e., third-person and first-person perspectives) to further the understanding of the effects of body position in relation to spatial cognition, locomotion method, presence, and cybersickness in VEs. In Chapter 3 (Experiment 1: third-person perspective), three body positions (standing, sitting, and half-sitting) were compared in two types of VR game with a different degree of freedom in navigation (DFN; finite and infinite) to explore the association between body position and the sense of presence in VEs. The results of the analysis revealed that standing has the most significant effect on presence for the three body positions that were investigated. In addition, the outcomes of this study indicated that the cognitive effect of body position on presence is associated with the DFN in a VE. Specifically, cognitive activity related to attention orchestrates the cognitive processes associated with body position, presence, and spatial cognition, consequently leading to an integrated sense of presence in VR. It can thus be speculated that the cognitive effects of body position on presence are correlated with the DFN in a VE. In Chapter 4 (Experiment 2: first-person perspective), two body positions (standing and sitting) and four types of locomotion method (steering + embodied control [EC], steering + instrumental control [IC], teleportation + EC, and teleportation + IC) were compared to examine the relationship between body position, locomotion method, presence, and cybersickness when navigating a VE. The results of Experiment 2 suggested that the DFN for translation and rotation is related to successful navigation and affects the sense of presence when navigating a VE. In addition, steering locomotion (continuous motion) increases self-motion when navigating a VE, which results in stronger cybersickness than teleportation (non-continuous motion). Overall, it can be postulated that presence and cybersickness are associated with the method of locomotion when navigating a VE. In this dissertation, the overall results of Experiment 1 suggest that the cognitive influence of presence is body-dependent in the sense that mental and brain processes rely on or are affected by the physical body. On the other hand, the outcomes of Experiment 2 illustrate the significant effects of locomotion method on the sense of presence and cybersickness during VE navigation. Taken together, the results of this study provide new insights into the cognitive effects of body position on spatial cognition (i.e., navigation) in VR and highlight the important implications of locomotion method on presence and cybersickness in VE navigation.Chapter 1. Introduction 1 1.1. An Introductory Overview of the Conducted Research 1 1.1.1. Presence and Body Position 1 1.1.2. Navigation, Cybersickness, and Locomotion Method 3 1.2. Research Objectives 6 1.3. Research Experimental Approach 7 Chapter 2. Theoretical Background 9 2.1. Presence 9 2.1.1. Presence and Virtual Reality 9 2.1.2. Presence and Spatiality 10 2.1.3. Presence and Action 12 2.1.4. Presence and Attention 14 2.2. Body Position 16 2.2.1. Body Position and Cognitive Effects 16 2.2.2. Body Position and Postural Control 18 2.2.3. Body Position and Postural Stability 19 2.3. Spatial Cognition: Degree of Freedom in Navigation 20 2.3.1. Degree of Freedom in Navigation and Decision-Making 20 2.4. Cybersickness 22 2.4.1. Cybersickness and Virtual Reality 22 2.4.2. Sensory Conflict Theory 22 2.4.3. Postural Instability Theory 23 2.5. Self-Motion 25 2.5.1. Vection and Virtual Reality 25 2.5.2. Self-Motion and Navigation in a VE 27 2.6. Navigation in Virtual Environments 29 2.6.1. Translation and Rotation in Navigation 29 2.6.2. Spatial Orientation and Embodiment 32 2.6.3. Locomotion Methods 37 2.6.4. Steering and Teleportation 38 Chapter 3. Experiment 1: Third-Person Perspective 40 3.1. Quantification of the Degree of Freedom in Navigation 40 3.2. Experiment 3.2.1. Experimental Design and Participants 41 3.2.2. Stimulus Materials 42 3.2.2.1. First- and Third-person Perspectives in Gameplay 43 3.2.3. Experimental Setup and Process 44 3.2.4. Measurements 45 3.3. Results 45 3.3.1. Presence: two-way ANOVA 45 3.3.2. Presence: one-way ANOVA 46 3.3.2.1. Finite Navigation Freedom 46 3.3.2.2. Infinite Navigation Freedom 47 3.3.3. Summary of the Results 48 3.4. Discussion 49 3.4.1. Presence and Body Position 49 3.4.2. Degree of Freedom in Navigation and Decision-Making 50 3.4.3. Gender Difference and Gameplay 51 3.5. Limitations 52 Chapter 4. Experiment 2: First-Person Perspective 53 4.1. Experiment 53 4.1.1. Experimental Design and Participants 53 4.1.2. Stimulus Materials 54 4.1.3. Experimental Setup and Process 55 4.1.4. Measurements 56 4.2. Results 57 4.2.1. Presence: two-way ANOVA 58 4.2.2. Cybersickness: two-way ANOVA 58 4.2.3. Presence: one-way ANOVA 60 4.2.3.1. Standing Position 60 4.2.3.2. Sitting Position 60 4.2.4. Cybersickness: one-way ANOVA 62 4.2.4.1. Standing Position 62 4.2.4.2. Sitting Position 62 4.2.5. Summary of the Results 63 4.3. Discussion 65 4.3.1. Presence 4.3.1.1. Presence and Locomotion Method 66 4.3.1.2. Presence and Body Position 68 4.3.2. Cybersickness 4.3.2.1. Cybersickness and Locomotion Method 69 4.3.2.2. Cybersickness and Body Position 70 4.4. Limitations 71 Chapter 5. Conclusion 72 5.1. Summary of Findings 72 5.2. Future Research Direction 73 References 75 Appendix A 107 Appendix B 110 국문초록 111Docto