Factors Affecting Spatial Awareness in Non- Stereo Visual Representations of Virtual, Real and Digital Image Environments

The increasing number of applications employing virtual environment (VE) technologies as a tool, particularly those that use VE as surrogates, makes it important to examine the ability of VE to provide realistic simulations to users. Accurate space and distance perceptions have been suggested as essential preconditions for the reliable use of VE technologies in various applications. However, space and distance perception in the VE has been reported by some investigators as being perceived differently from the real world. Thus, the overall aim of this thesis is to improve our understanding of factors affecting spatial awareness in the VE. The general approach is based on a strategy of conducting empirical investigations comparing tasks performed in the VE to similar tasks performed in the real world. This research has examined the effect of display related factors on users' spatial task performance in the context of static, dynamic and interactive presentations. Three sets of experiments in these respective contexts were conducted to explore the influence of image type, display size, viewing distance, physiological cues, interface device and travel modes on distance estimate and spatial memory tasks. For distance perception, results revealed that the effect of image type depends on the context of presentations, the type of asymmetrical distances and image resolution. The effect of display size in static and dynamic presentations is consistent with the results of previous investigations. However, results from evaluations conducted by the author have indicated that other factors such as viewing distance and physiological cues were also accountable. In interactive presentations, results indicated that display size had different effects on different users whereby familiarity with display size may influence user's performance. Similarly, it was shown that a commonly used interface device is more useful and beneficial for user's spatial memory performance in the VE than the less familiar ones. In terms of travel mode, the natural method of movement available in the real world may not necessary be better than the unnatural movement which is possible in the VE. The results of investigations reported in this thesis contribute towards knowledge and understanding on factors affecting spatial awareness in the real and VE. In particular, they highlight the influence of these factors in space and distance perception in different contexts of VE presentations which will serve as important scientifically based guidelines for designers and users ofVE applications

Influence of immersion on user's spatial presence and memory in virtual environments

This study examines the influence of immersion on users' sense of spatial presence and spatial memory in virtual environments. The single factor was systematically manipulated in three conditions. A sample of 32 participants was used to test the study hypotheses. This study employed a between-subject design, and participants were randomly assigned to one of the three experimental conditions. The results from statistical analysis of covariance (ANCOVA) revealed the influence of immersion on the spatial presence and spatial memory. The results of this study revealed that higher level of immersion including a wider field of view and the stereoscopic display did lead to a greater sense of presence and improved spatial memory performance. This study has practical implications across various domains including architectural design and visualization, developing virtual reality systems, and training simulators.Includes bibliographical reference

Collaborative interaction in immersive 360º experiences

Os sistemas de reprodução de vídeo tornaram-se, a cada dia, mais habituais e utilizados. Consequentemente, foram criadas extensões desta tecnologia permitindo colaboração multipessoal de modo a poder assistir remotamente e sincronamente. Exemplos conhecidos são o Watch2gether, Sync Video e Netflix Party, que nos permitem assistir vídeos síncrona e remotamente com amigos. Estas aplicações de visualização conjunta, apesar de bem desenvolvidas, estão limitadas ao típico formato, não se estendendo a vídeos 360. O principal objetivo deste projeto é então expandir a pesquisa nesta área ao desenvolver um sistema colaborativo para vídeos 360. Já foram direcionados vários esforços na área de vídeos 360o, um deles sendo o projeto AV360, aplicação que permite ao utilizador visualizar e editar este tipo de vídeos com anotações e guias. O sistema que se pretende integrar é um seguimento ao AV360, utilizando parte das tecnologias já implementadas. De maneira a compartimentalizar e facilitar a pesquisa são considerados os seguintes temas de forma individual: a visualização de vídeos 360o, a generalidade dos sistemas colaborativos, a aplicação de colaboração em ambientes virtuais e os sistemas de vídeo colaborativos. É importante ter noção das vantagens e desvantagens de assistir a um vídeo 360o, conseguir retirar o que é a essência nestes vídeos e mantê-la, integrando também a inclusão de outros utilizadores. Na escolha das atividades colaborativas a aplicar, é imprescindível analisar o estado em que os sistemas colaborativos se encontram hoje em dia e posteriormente afunilar a pesquisa para a colaboração em ambientes virtuais e em vídeos. Dentro de todos os métodos analisados só os adaptáveis a ambientes imersivos e a vídeos são escolhidos e desenvolvidos neste projeto. Com base numa pesquisa aprofundada sobre o assunto, é criado um sistema de colaboração em vídeos 360o. O software permite que os utilizadores assistam em simultâneo a um vídeo enquanto comunicam de uma forma verbal e não verbal para se expressarem e partilharem a experiência do momento. Este trabalho tem em mente que parte das ideias implementadas possam ser reutilizáveis para outros projetos de experiências imersivas

Human Visual Navigation: Effects of Visual Context, Navigation Mode, and Gender

Abstract This thesis extends research on human visual path integration using optic flow cues. In three experiments, a large-scale path-completion task was contextualised within highly-textured authentic virtual environments. Real-world navigational experience was further simulated, through the inclusion of a large roundabout on the route. Three semi-surrounding screens provided a wide field of view. Participants were able to perform the task, but directional estimates showed characteristic errors, which can be explained with a model of distance misperception on the outbound roads of the route. Display and route layout parameters had very strong effects on performance. Gender and navigation mode were also influential. Participants consistently underestimated the final turn angle when simulated self-motion was viewed passively, on large projection screens in a driving simulator. Error increased with increasing size of the internal angle, on route layouts based on equilateral or isosceles triangles. A compressed range of responses was found. Higher overall accuracy was observed when a display with smaller desktop computer monitors was used; especially when simulated self-motion was actively controlled with a steering wheel and foot pedals, rather than viewed passively. Patterns and levels of error depended on route layout, which included triangles with non-equivalent lengths of the two outbound roads. A powerful effect on performance was exerted by the length of the "approach segment" on the route: that is, the distance travelled on the first outbound road, combined with the distance travelled between the two outbound roads on the roundabout curve. The final turn angle was generally overestimated on routes with a long approach segment (those with a long first road and a 60° or 90° internal angle), and underestimated on routes with a short approach segment (those with a short first road or the 120° internal angle). Accuracy was higher for active participants on routes with longer approach segments and on 90° angle trials, and for passive participants on routes with shorter approach segments and on 120° angle trials. Active participants treated all internal angles as 90° angles. Participants performed with lower overall accuracy when optic flow information was disrupted, through the intermittent presentation of self-motion on the small-screen display, in a sequence of static snapshots of the route. Performance was particularly impaired on routes with a long approach segment, but quite accurate on those with a short approach segment. Consistent overestimation of the final angle was observed, and error decreased with increasing size of the internal angle. Participants treated all internal angles as 120° angles. The level of available visual information did not greatly affect estimates, in general. The degree of curvature on the roundabout mainly influenced estimates by female participants in the Passive condition. Compared with males, females performed less accurately in the driving simulator, and with reduced optic flow cues; but more accurately with the small-screen display on layouts with a short approach segment, and when they had active control of the self-motion. The virtual environments evoked a sense of presence, but this had no effect on task performance, in general. The environments could be used for training navigational skills where high precision is not required

Virtual Reality in Marketing: A Framework, Review, and Research Agenda

[EN] Marketing scholars and practitioners are showing increasing interest in Extended Reality (XR) technologies (XRs), such as virtual reality (VR), augmented reality (AR), and mixed reality (MR), as very promising technological tools for producing satisfactory consumer experiences that mirror those experienced in physical stores. However, most of the studies published to date lack a certain measure of methodological rigor in their characterization of XR technologies and in the assessment techniques used to characterize the consumer experience, which limits the generalization of the results. We argue that it is necessary to define a rigorous methodological framework for the use of XRs in marketing. This article reviews the literature on XRs in marketing, and provides a conceptual framework to organize this disparate body of work.This work was supported by the Spanish Ministry of Science, Innovation and Universities funded project - ATHENEA-DPI2017-91537-EXP and by the European Commission project RHUMBO - H2020-MSCA-ITN-2018-813234Alcañiz Raya, ML.; Bigné, E.; Guixeres, J. (2019). Virtual Reality in Marketing: A Framework, Review, and Research Agenda. Frontiers in Psychology. 10:1-15. https://doi.org/10.3389/fpsyg.2019.01530S11510Alcañiz, M., Parra, E., & Chicchi Giglioli, I. A. (2018). Virtual Reality as an Emerging Methodology for Leadership Assessment and Training. Frontiers in Psychology, 9. doi:10.3389/fpsyg.2018.01658Alshaal, S. E., Michael, S., Pamporis, A., Herodotou, H., Samaras, G., & Andreou, P. (2016). Enhancing Virtual Reality Systems with Smart Wearable Devices. 2016 17th IEEE International Conference on Mobile Data Management (MDM). doi:10.1109/mdm.2016.60Ausin, J. M., Guixeres, J., Bigné, E., & Alcañiz, M. (2017). Facial Expressions to Evaluate Advertising: A Laboratory versus Living Room Study. Advances in Advertising Research VIII, 109-122. doi:10.1007/978-3-658-18731-6_9Babić Rosario, A., Sotgiu, F., De Valck, K., & Bijmolt, T. H. A. (2016). The Effect of Electronic Word of Mouth on Sales: A Meta-Analytic Review of Platform, Product, and Metric Factors. Journal of Marketing Research, 53(3), 297-318. doi:10.1509/jmr.14.0380Baños, R. M., Botella, C., Rubió, I., Quero, S., García-Palacios, A., & Alcañiz, M. (2008). Presence and Emotions in Virtual Environments: The Influence of Stereoscopy. CyberPsychology & Behavior, 11(1), 1-8. doi:10.1089/cpb.2007.9936Barlow, A. K. J., Siddiqui, N. Q., & Mannion, M. (2004). Developments in information and communication technologies for retail marketing channels. International Journal of Retail & Distribution Management, 32(3), 157-163. doi:10.1108/09590550410524948Barnes, S. J. (2011). Understanding use continuance in virtual worlds: Empirical test of a research model. Information & Management, 48(8), 313-319. doi:10.1016/j.im.2011.08.004Bayousuf, A., Al-Khalifa, H. S., & Al-Salman, A. (2018). Haptics-Based Systems Characteristics, Classification, and Applications. Encyclopedia of Information Science and Technology, Fourth Edition, 4652-4665. doi:10.4018/978-1-5225-2255-3.ch404Bearden, W. O., & Netemeyer, R. G. (1999). Handbook of Marketing Scales. doi:10.4135/9781412984379Bigné, E., Llinares, C., & Torrecilla, C. (2016). Elapsed time on first buying triggers brand choices within a category: A virtual reality-based study. Journal of Business Research, 69(4), 1423-1427. doi:10.1016/j.jbusres.2015.10.119Bonetti, F., Warnaby, G., & Quinn, L. (2017). Augmented Reality and Virtual Reality in Physical and Online Retailing: A Review, Synthesis and Research Agenda. Progress in IS, 119-132. doi:10.1007/978-3-319-64027-3_9Brady, M., Fellenz, M. R., & Brookes, R. (2008). Researching the role of information and communications technology (ICT) in contemporary marketing practices. Journal of Business & Industrial Marketing, 23(2), 108-114. doi:10.1108/08858620810850227Bressoud, E. (2013). Testing FMCG innovations: experimental real store versus virtual. Journal of Product & Brand Management, 22(4), 286-292. doi:10.1108/jpbm-05-2012-0141Brody, A. B., & Gottsman, E. J. (1999). Pocket BargainFinder: A Handheld Device for Augmented Commerce. Lecture Notes in Computer Science, 44-51. doi:10.1007/3-540-48157-5_6Bruer, J. T. (s. f.). Building bridges in neuroeducation. The Educated Brain, 43-58. doi:10.1017/cbo9780511489907.005Burke, R. R. (2017). Virtual Reality for Marketing Research. Innovative Research Methodologies in Management, 63-82. doi:10.1007/978-3-319-64400-4_3Burke, R. R. (2002). Technology and the Customer Interface: What Consumers Want in the Physical and Virtual Store. Journal of the Academy of Marketing Science, 30(4), 411-432. doi:10.1177/009207002236914Carpenter, I. D., Simmons, J. E. L., Ritchie, J. M., & Dewar, R. G. (1997). Virtual manufacturing. Manufacturing Engineer, 76(3), 113-116. doi:10.1049/me:19970309Castellanos, M. C., Ausin, J. M., Guixeres, J., & Bigné, E. (2018). Emotion in a 360-Degree vs. Traditional Format Through EDA, EEG and Facial Expressions. Advances in Advertising Research IX, 3-15. doi:10.1007/978-3-658-22681-7_1Chen, L.-D., & Tan, J. (2004). Technology Adaptation in E-commerce: European Management Journal, 22(1), 74-86. doi:10.1016/j.emj.2003.11.014Chicchi Giglioli, I. A., Pravettoni, G., Sutil Martín, D. L., Parra, E., & Raya, M. A. (2017). A Novel Integrating Virtual Reality Approach for the Assessment of the Attachment Behavioral System. Frontiers in Psychology, 8. doi:10.3389/fpsyg.2017.00959Clemente, M., Rey, B., Rodriguez-Pujadas, A., Barros-Loscertales, A., Banos, R. M., Botella, C., … Avila, C. (2013). An fMRI Study to Analyze Neural Correlates of Presence during Virtual Reality Experiences. Interacting with Computers, 26(3), 269-284. doi:10.1093/iwc/iwt037Clemente, M., Rodríguez, A., Rey, B., & Alcañiz, M. (2014). Assessment of the influence of navigation control and screen size on the sense of presence in virtual reality using EEG. Expert Systems with Applications, 41(4), 1584-1592. doi:10.1016/j.eswa.2013.08.055Daugherty, T., Li, H., & Biocca, F. (2008). Consumer learning and the effects of virtual experience relative to indirect and direct product experience. Psychology and Marketing, 25(7), 568-586. doi:10.1002/mar.20225Dellarocas, C., Katona, Z., & Rand, W. (2013). Media, Aggregators, and the Link Economy: Strategic Hyperlink Formation in Content Networks. Management Science, 59(10), 2360-2379. doi:10.1287/mnsc.2013.1710DONNA L. HOFFMAN THOMAS P. NOVAK. (1997). A New Marketing Paradigm for Electronic Commerce. The Information Society, 13(1), 43-54. doi:10.1080/019722497129278Farah, M. F., Ramadan, Z. B., & Harb, D. H. (2019). The examination of virtual reality at the intersection of consumer experience, shopping journey and physical retailing. Journal of Retailing and Consumer Services, 48, 136-143. doi:10.1016/j.jretconser.2019.02.016Fisher, C. E., Chin, L., & Klitzman, R. (2010). Defining Neuromarketing: Practices and Professional Challenges. Harvard Review of Psychiatry, 18(4), 230-237. doi:10.3109/10673229.2010.496623Fox, J., Arena, D., & Bailenson, J. N. (2009). Virtual Reality. Journal of Media Psychology, 21(3), 95-113. doi:10.1027/1864-1105.21.3.95Fusaro, M., Tieri, G., & Aglioti, S. M. (2016). Seeing pain and pleasure on self and others: behavioral and psychophysiological reactivity in immersive virtual reality. Journal of Neurophysiology, 116(6), 2656-2662. doi:10.1152/jn.00489.2016Grewal, D., Roggeveen, A. L., & Nordfält, J. (2017). The Future of Retailing. Journal of Retailing, 93(1), 1-6. doi:10.1016/j.jretai.2016.12.008Gummesson, E. (1987). The new marketing—Developing long-term interactive relationships. Long Range Planning, 20(4), 10-20. doi:10.1016/0024-6301(87)90151-8Higuera-Trujillo, J. L., López-Tarruella Maldonado, J., & Llinares Millán, C. (2017). Psychological and physiological human responses to simulated and real environments: A comparison between Photographs, 360° Panoramas, and Virtual Reality. Applied Ergonomics, 65, 398-409. doi:10.1016/j.apergo.2017.05.006Hoffman, D. L., & Novak, T. P. (1996). Marketing in Hypermedia Computer-Mediated Environments: Conceptual Foundations. Journal of Marketing, 60(3), 50-68. doi:10.1177/002224299606000304Homburg, C., Jozić, D., & Kuehnl, C. (2015). Customer experience management: toward implementing an evolving marketing concept. Journal of the Academy of Marketing Science, 45(3), 377-401. doi:10.1007/s11747-015-0460-7Huang, Y. C., Backman, K. F., Backman, S. J., & Chang, L. L. (2015). Exploring the Implications of Virtual Reality Technology in Tourism Marketing: An Integrated Research Framework. International Journal of Tourism Research, 18(2), 116-128. doi:10.1002/jtr.2038Hunt, S. D. (1983). General Theories and the Fundamental Explananda of Marketing. Journal of Marketing, 47(4), 9-17. doi:10.1177/002224298304700402IJsselsteijn, W., Ridder, H. de, Freeman, J., Avons, S. E., & Bouwhuis, D. (2001). Effects of Stereoscopic Presentation, Image Motion, and Screen Size on Subjective and Objective Corroborative Measures of Presence. Presence: Teleoperators and Virtual Environments, 10(3), 298-311. doi:10.1162/105474601300343621Ischer, M., Baron, N., Mermoud, C., Cayeux, I., Porcherot, C., Sander, D., & Delplanque, S. (2014). How incorporation of scents could enhance immersive virtual experiences. Frontiers in Psychology, 5. doi:10.3389/fpsyg.2014.00736Jaeger, S. R., & Porcherot, C. (2017). Consumption context in consumer research: methodological perspectives. Current Opinion in Food Science, 15, 30-37. doi:10.1016/j.cofs.2017.05.001Jerald, J. (2017). Human-centered design for immersive interactions. 2017 IEEE Virtual Reality (VR). doi:10.1109/vr.2017.7892361Jones, K., & Biasiotto, M. (1999). Internet retailing: current hype or future reality? The International Review of Retail, Distribution and Consumer Research, 9(1), 69-79. doi:10.1080/095939699342688Kalantari, M., & Rauschnabel, P. (2017). Exploring the Early Adopters of Augmented Reality Smart Glasses: The Case of Microsoft HoloLens. Progress in IS, 229-245. doi:10.1007/978-3-319-64027-3_16Kannan, P. K., & Li, H. «Alice». (2017). Digital marketing: A framework, review and research agenda. International Journal of Research in Marketing, 34(1), 22-45. doi:10.1016/j.ijresmar.2016.11.006Kaplan, A. M., & Haenlein, M. (2009). Consumer Use and Business Potential of Virtual Worlds: The Case of «Second Life». International Journal on Media Management, 11(3-4), 93-101. doi:10.1080/14241270903047008Kaplan, A. M., & Haenlein, M. (2009). The fairyland of Second Life: Virtual social worlds and how to use them. Business Horizons, 52(6), 563-572. doi:10.1016/j.bushor.2009.07.002Stanney, K., Kennedy, R., Harm, D., Compton, D., Lanham, D., & Drexler, J. (2003). Con.gural Scoring of Simulator Sickness, Cybersickness and Space Adaptation Syndrome. Virtual and Adaptive Environments, 247-278. doi:10.1201/9781410608888.ch12Kenning, P. H., & Plassmann, H. (2008). How Neuroscience Can Inform Consumer Research. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 16(6), 532-538. doi:10.1109/tnsre.2008.2009788Keshavarz, B., & Hecht, H. (2011). Validating an Efficient Method to Quantify Motion Sickness. Human Factors: The Journal of the Human Factors and Ergonomics Society, 53(4), 415-426. doi:10.1177/0018720811403736Klein, L. R. (1998). Evaluating the Potential of Interactive Media through a New Lens: Search versus Experience Goods. Journal of Business Research, 41(3), 195-203. doi:10.1016/s0148-2963(97)00062-3Kolesar, M. B., & Wayne Galbraith, R. (2000). A services‐marketing perspective on e‐retailing: implications for e‐retailers and directions for further research. Internet Research, 10(5), 424-438. doi:10.1108/10662240010349444Koontz, M. L., & Gibson, I. E. (2002). Mixed reality merchandising: bricks, clicks – and mix. Journal of Fashion Marketing and Management: An International Journal, 6(4), 381-395. doi:10.1108/13612020210448664Liston, P. M., Kay, A., Cromie, S., Leva, C., D’Cruz, M., Patel, H., … Aromaa, S. (2012). Evaluating the iterative development of VR/AR human factors tools for manual work. Work, 41, 2208-2215. doi:10.3233/wor-2012-0443-2208Kruijff, E., & Riecke, B. E. (2018). Navigation Interfaces for Virtual Reality and Gaming. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. doi:10.1145/3170427.3170643Lamberton, C., & Stephen, A. T. (2016). A Thematic Exploration of Digital, Social Media, and Mobile Marketing: Research Evolution from 2000 to 2015 and an Agenda for Future Inquiry. Journal of Marketing, 80(6), 146-172. doi:10.1509/jm.15.0415Latorre, J., Llorens, R., Colomer, C., & Alcañiz, M. (2018). Reliability and comparison of Kinect-based methods for estimating spatiotemporal gait parameters of healthy and post-stroke individuals. Journal of Biomechanics, 72, 268-273. doi:10.1016/j.jbiomech.2018.03.008LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436-444. doi:10.1038/nature14539Lee, K. S., & Tan, S. J. (2003). E-retailing versus physical retailing. Journal of Business Research, 56(11), 877-885. doi:10.1016/s0148-2963(01)00274-0Lee, N., Broderick, A. J., & Chamberlain, L. (2007). What is ‘neuromarketing’? A discussion and agenda for future research. International Journal of Psychophysiology, 63(2), 199-204. doi:10.1016/j.ijpsycho.2006.03.007Li, H., Daugherty, T., & Biocca, F. (2003). The Role of Virtual Experience in Consumer Learning. Journal of Consumer Psychology, 13(4), 395-407. doi:10.1207/s15327663jcp1304_07Chuan-Chuan Lin, J., & Lu, H. (2000). Towards an understanding of the behavioural intention to use a web site. International Journal of Information Management, 20(3), 197-208. doi:10.1016/s0268-4012(00)00005-0Liu, C., & Arnett, K. P. (2000). Exploring the factors associated with Web site success in the context of electronic commerce. Information & Management, 38(1), 23-33. doi:10.1016/s0378-7206(00)00049-5Lorenz, M., Busch, M., Rentzos, L., Tscheligi, M., Klimant, P., & Frohlich, P. (2015). I’m There! The influence of virtual reality and mixed reality environments combined with two different navigation methods on presence. 2015 IEEE Virtual Reality (VR). doi:10.1109/vr.2015.7223376Marín-Morales, J., Higuera-Trujillo, J. L., Greco, A., Guixeres, J., Llinares, C., Scilingo, E. P., … Valenza, G. (2018). Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors. Scientific Reports, 8(1). doi:10.1038/s41598-018-32063-4Mars, P., Chen, J. R., & Nambiar, R. (2018). Learning Algorithms. doi:10.1201/9781351073974Massara, F., Liu, S. S., & Melara, R. D. (2010). Adapting to a retail environment: Modeling consumer–environment interactions. Journal of Business Research, 63(7), 673-681. doi:10.1016/j.jbusres.2009.05.004Mathwick, C. (2002). Understanding the online consumer: A typology of online relational norms and behavior. Journal of Interactive Marketing, 16(1), 40-55. doi:10.1002/dir.10003Mazloumi Gavgani, A., Walker, F. R., Hodgson, D. M., & Nalivaiko, E. (2018). A comparative study of cybersickness during exposure to virtual reality and «classic» motion sickness: are they different? Journal of Applied Physiology, 125(6), 1670-1680. doi:10.1152/japplphysiol.00338.2018McGrath, J. L., Taekman, J. M., Dev, P., Danforth, D. R., Mohan, D., Kman, N., … Bond, W. F. (2017). Using Virtual Reality Simulation Environments to Assess Competence for Emergency Medicine Learners. Academic Emergency Medicine, 25(2), 186-195. doi:10.1111/acem.13308Meehan, M., Insko, B., Whitton, M., & Brooks, F. P. (2002). Physiological measures of presence in stressful virtual environments. ACM Transactions on Graphics, 21(3), 645-652. doi:10.1145/566654.566630Meißner, M., Pfeiffer, J., Pfeiffer, T., & Oppewal, H. (2019). Combining virtual reality and mobile eye tracking to provide a naturalistic experimental environment for shopper research. Journal of Business Research, 100, 445-458. doi:10.1016/j.jbusres.2017.09.028Menezes, P., Gouveia, N., & Patrão, B. (2017). Touching Is Believing - Adding Real Objects to Virtual Reality. Lecture Notes in Networks and Systems, 681-688. doi:10.1007/978-3-319-64352-6_64Merrilees, B. (2002). Interactivity Design as the Key to Managing Customer Relations in E-Commerce. Journal of Relationship Marketing, 1(3-4), 111-126. doi:10.1300/j366v01n03_07Nalivaiko, E., Davis, S. L., Blackmore, K. L., Vakulin, A., & Nesbitt, K. V. (2015). Cybersickness provoked by head-mounted display affects cutaneous vascular tone, heart rate and reaction time. Physiology & Behavior, 151, 583-590. doi:10.1016/j.physbeh.2015.08.043Neslin, S. A., Grewal, D., Leghorn, R., Shankar, V., Teerling, M. L., Thomas, J. S., & Verhoef, P. C. (2006). Challenges and Opportunities in Multichannel Customer Management. Journal of Service Research, 9(2), 95-112. doi:10.1177/1094670506293559Pantano, E., & Servidio, R. (2012). Modeling innovative points of sales through virtual and immersive technologies. Journal of Retailing and Consumer Services, 19(3), 279-286. doi:10.1016/j.jretconser.2012.02.002Papagiannidis, S., Pantano, E., See-To, E. W. K., & Bourlakis, M. (2013). Modelling the determinants of a simulated experience in a virtual retail store and users’ product purchasing intentions. Journal of Marketing Management, 29(13-14), 1462-1492. doi:10.1080/0267257x.2013.821150Parsons, T. D. (2015). Virtual Reality for Enhanced Ecological Validity and Experimental Control in the Clinical, Affective and Social Neurosciences. Frontiers in Human Neuroscience, 9. doi:10.3389/fnhum.2015.00660Perid, J. L. A., & Steiger, P. (1998). Making Electronic Commere Easier to Use With Novel User Interfaces. Electronic Markets, 8(3), 8-12. doi:10.1080/10196789800000032Ranasinghe, N., Nakatsu, R., Nii, H., & Gopalakrishnakone, P. (2012). Tongue Mounted Interface for Digitally Actuating the Sense of Taste. 2012 16th International Symposium on Wearable Computers. doi:10.1109/iswc.2012.16Rieuf, V., Bouchard, C., Meyrueis, V., & Omhover, J.-F. (2017). Emotional activity in early immersive design: Sketches and moodboards in virtual reality. Design Studies, 48, 43-75. doi:10.1016/j.destud.2016.11.001Schnall, S., Hedge, C., & Weaver, R. (2012). The Immersive Virtual Environment of the digital fulldome: Considerations of relevant psychological processes. International Journal of Human-Computer Studies, 70(8), 561-575. doi:10.1016/j.ijhcs.2012.04.001Scholz, J., & Smith, A. N. (2016). Augmented reality: Designing immersive experiences that maximize consumer engagement. Business Horizons, 59(2), 149-161. doi:10.1016/j.bushor.2015.10.003Seibert, J., & Shafer, D. M. (2017). Control mapping in virtual reality: effects on spatial presence and controller naturalness. Virtual Reality, 22(1), 79-88. doi:10.1007/s10055-017-0316-1Skarbez, R., Brooks, Jr., F. P., & Whitton, M. C. (2018). A Survey of Presence and Related Concepts. ACM Computing Surveys, 50(6), 1-39. doi:10.1145/3134301Slater, M., & Sanchez-Vives, M. V. (2016). Enhancing Our Lives with Immersive Virtual Reality. Frontiers in Robotics and AI, 3. doi:10.3389/frobt.2016.00074Stone, R. J. (1995). The reality of virtual reality. World Class Design to Manufacture, 2(4), 11-17. doi:10.1108/09642369310091106Szymanski, D. M., & Hise, R. T. (2000). E-satisfaction: an initial examination. Journal of Retailing, 76(3), 309-322. doi:10.1016/s0022-4359(00)00035-xTeo, W.-P., Muthalib, M., Yamin, S., Hendy, A. M., Bramstedt, K., Kotsopoulos, E., … Ayaz, H. (2016). Does a Combination of Virtual Reality, Neuromodulation and Neuroimaging Provide a Comprehensive Platform for Neurorehabilitation? – A Narrative Review of the Literature. Frontiers in Human Neuroscience, 10. doi:10.3389/fnhum.2016.00284Tikkanen, H., Hietanen, J., Henttonen, T., & Rokka, J. (2009). Exploring virtual worlds: success factors in virtual world marketing. Management Decision, 47(8), 1357-1381. doi:10.1108/00251740910984596Usoh, M., Catena, E., Arman, S., & Slater, M. (2000). Using Presence Questionnaires in Reality. Presence: Teleoperators and Virtual Environments, 9(5), 497-503. doi:10.1162/105474600566989Van Herpen, E., Pieters, R., & Zeelenberg, M. (2009). When demand accelerates demand: Trailing the bandwagon☆. Journal of Consumer Psychology, 19(3), 302-312. doi:10.1016/j.jcps.2009.01.001Van Herpen, E., van den Broek, E., van Trijp, H. C. M., & Yu, T. (2016). Can a virtual supermarket bring realism into the lab? Comparing shopping behavior using virtual and pictorial store representations to behavior in a physical store. Appetite, 107, 196-207. doi:10.1016/j.appet.2016.07.033Van Kerrebroeck, H., Brengman, M., & Willems, K. (2017). When brands come to life: experimental research on the vividness effect of Virtual Reality in transformational marketing communications. Virtual Reality, 21(4), 177-191. doi:10.1007/s10055-017-0306-3Vargo, S. L., & Lusch, R. F. (2007). Service-dominant logic: continuing the evolution. Journal of the Academy of Marketing Science, 36(1), 1-10. doi:10.1007/s11747-007-0069-6Varma, V., & Nathan-Roberts, D. (2017). Gestural Interaction with Three-Dimensional Interfaces; Current Research and Recommendations. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 61(1), 537-541. doi:10.1177/1541931213601618Verhoef, P. C., Kannan, P. K., & Inman, J. J. (2015). From Multi-Channel Retailing to Omni-Channel Retailing. Journal of Retailing, 91(2), 174-181. doi:10.1016/j.jretai.2015.02.005Verhulst, A., Normand, J.-M., Lombart, C., & Moreau, G. (2017). A study on the use of an immersive virtual reality store to investigate consumer perceptions and purchase behavior toward non-standard fruits and vegetables. 2017 IEEE Virtual Reality (VR). doi:10.1109/vr.2017.7892231Vrechopoulos, A., Apostolou, K., & Koutsiouris, V. (2009)

Presence, what is it good for? Exploring the benefits of virtual reality at evoking empathy towards the marginalized

2020 Fall.Includes bibliographical references.This study examines the relationship between physical presence and empathy across three technology modalities: 1) virtual reality head-mount displays, 2) desktop virtual reality, and 3) text narratives with photographs displayed on a computer screen. Additionally, it examines if public support for a novel public health intervention increases when participants engage in a perspective-taking exercise designed to evoke empathy. Last, the study explores whether the benefits of empathy arousal, specifically the reduction of stereotypes toward the marginalized, depend on the technology modality used in the perspective-taking exercise. Prior studies have consistently found a positive correlation between physical presence and fear and anxiety, especially studies that have used virtual reality head-mount displays to induce presence. However, few studies have examined the relationship between physical presence and empathy. Although some studies have found a positive correlation between physical presence and empathy, these studies are few, lack comprehensive and consistent measurement, and commonly do not test the superiority of virtual reality head-mount displays at evoking empathy against more traditional technology modalities. Last, studies using virtual reality head-mount displays have found inconsistent results in how empathy affects public support and stereotypes. A 1x4 lab experiment (N = 199) was carried out to fill in these research gaps. Results include the follow: 1) physical presence was higher in the virtual reality head-mount display condition compared to the desktop virtual-reality condition and the text narrative and photograph condition; 2) physical presence was positively correlated with all four dimensions of empathy—perspective taking, fantasy, personal distress, and empathic concern; however, the relationship between presence and empathic concern was moderated by participants' mental health; 3) the amount of empathy participants experienced did not differ by experimental condition; however, cognitive empathy was lower in the control condition compared to each experimental condition; 4) public support was positively correlated with three of the four dimensions of empathy including perspective taking, fantasy, and empathic concern; 5) perceptions of stereotypes of people who inject drugs were higher in the control condition compared to the desktop virtual-reality condition and text narrative condition, but not the virtual reality head-mount display condition. Overall, this study adds to a growing body of literature exploring the benefits of virtual-reality perspective-taking exercises in three important ways. First, this study strengthens the assertion that virtual-reality head-mount displays produce more physical presence compared to desktop virtual reality and text narratives with photographs. Second, aligned with prior research, this study provides evidence of a positive correlation between physical presence and empathy arousal. However, in this study, empathy arousal appears to be increasing presence, which is a different causal pathway then the study predicted.Last, this study found that the virtual-reality head-mount display condition was the only experimental condition that did not significantly reduce stereotypes. Together, these results suggest both potential advantages and disadvantages for using virtual reality in perspective-taking exercises

Spatial Interaction for Immersive Mixed-Reality Visualizations

Growing amounts of data, both in personal and professional settings, have caused an increased interest in data visualization and visual analytics. Especially for inherently three-dimensional data, immersive technologies such as virtual and augmented reality and advanced, natural interaction techniques have been shown to facilitate data analysis. Furthermore, in such use cases, the physical environment often plays an important role, both by directly influencing the data and by serving as context for the analysis. Therefore, there has been a trend to bring data visualization into new, immersive environments and to make use of the physical surroundings, leading to a surge in mixed-reality visualization research. One of the resulting challenges, however, is the design of user interaction for these often complex systems. In my thesis, I address this challenge by investigating interaction for immersive mixed-reality visualizations regarding three core research questions: 1) What are promising types of immersive mixed-reality visualizations, and how can advanced interaction concepts be applied to them? 2) How does spatial interaction benefit these visualizations and how should such interactions be designed? 3) How can spatial interaction in these immersive environments be analyzed and evaluated? To address the first question, I examine how various visualizations such as 3D node-link diagrams and volume visualizations can be adapted for immersive mixed-reality settings and how they stand to benefit from advanced interaction concepts. For the second question, I study how spatial interaction in particular can help to explore data in mixed reality. There, I look into spatial device interaction in comparison to touch input, the use of additional mobile devices as input controllers, and the potential of transparent interaction panels. Finally, to address the third question, I present my research on how user interaction in immersive mixed-reality environments can be analyzed directly in the original, real-world locations, and how this can provide new insights. Overall, with my research, I contribute interaction and visualization concepts, software prototypes, and findings from several user studies on how spatial interaction techniques can support the exploration of immersive mixed-reality visualizations.Zunehmende Datenmengen, sowohl im privaten als auch im beruflichen Umfeld, führen zu einem zunehmenden Interesse an Datenvisualisierung und visueller Analyse. Insbesondere bei inhärent dreidimensionalen Daten haben sich immersive Technologien wie Virtual und Augmented Reality sowie moderne, natürliche Interaktionstechniken als hilfreich für die Datenanalyse erwiesen. Darüber hinaus spielt in solchen Anwendungsfällen die physische Umgebung oft eine wichtige Rolle, da sie sowohl die Daten direkt beeinflusst als auch als Kontext für die Analyse dient. Daher gibt es einen Trend, die Datenvisualisierung in neue, immersive Umgebungen zu bringen und die physische Umgebung zu nutzen, was zu einem Anstieg der Forschung im Bereich Mixed-Reality-Visualisierung geführt hat. Eine der daraus resultierenden Herausforderungen ist jedoch die Gestaltung der Benutzerinteraktion für diese oft komplexen Systeme. In meiner Dissertation beschäftige ich mich mit dieser Herausforderung, indem ich die Interaktion für immersive Mixed-Reality-Visualisierungen im Hinblick auf drei zentrale Forschungsfragen untersuche: 1) Was sind vielversprechende Arten von immersiven Mixed-Reality-Visualisierungen, und wie können fortschrittliche Interaktionskonzepte auf sie angewendet werden? 2) Wie profitieren diese Visualisierungen von räumlicher Interaktion und wie sollten solche Interaktionen gestaltet werden? 3) Wie kann räumliche Interaktion in diesen immersiven Umgebungen analysiert und ausgewertet werden? Um die erste Frage zu beantworten, untersuche ich, wie verschiedene Visualisierungen wie 3D-Node-Link-Diagramme oder Volumenvisualisierungen für immersive Mixed-Reality-Umgebungen angepasst werden können und wie sie von fortgeschrittenen Interaktionskonzepten profitieren. Für die zweite Frage untersuche ich, wie insbesondere die räumliche Interaktion bei der Exploration von Daten in Mixed Reality helfen kann. Dabei betrachte ich die Interaktion mit räumlichen Geräten im Vergleich zur Touch-Eingabe, die Verwendung zusätzlicher mobiler Geräte als Controller und das Potenzial transparenter Interaktionspanels. Um die dritte Frage zu beantworten, stelle ich schließlich meine Forschung darüber vor, wie Benutzerinteraktion in immersiver Mixed-Reality direkt in der realen Umgebung analysiert werden kann und wie dies neue Erkenntnisse liefern kann. Insgesamt trage ich mit meiner Forschung durch Interaktions- und Visualisierungskonzepte, Software-Prototypen und Ergebnisse aus mehreren Nutzerstudien zu der Frage bei, wie räumliche Interaktionstechniken die Erkundung von immersiven Mixed-Reality-Visualisierungen unterstützen können

Remote Visual Observation of Real Places Through Virtual Reality Headsets

Virtual Reality has always represented a fascinating yet powerful opportunity that has attracted studies and technology developments, especially since the latest release on the market of powerful high-resolution and wide field-of-view VR headsets. While the great potential of such VR systems is common and accepted knowledge, issues remain related to how to design systems and setups capable of fully exploiting the latest hardware advances. The aim of the proposed research is to study and understand how to increase the perceived level of realism and sense of presence when remotely observing real places through VR headset displays. Hence, to produce a set of guidelines that give directions to system designers about how to optimize the display-camera setup to enhance performance, focusing on remote visual observation of real places. The outcome of this investigation represents unique knowledge that is believed to be very beneficial for better VR headset designs towards improved remote observation systems. To achieve the proposed goal, this thesis presents a thorough investigation of existing literature and previous researches, which is carried out systematically to identify the most important factors ruling realism, depth perception, comfort, and sense of presence in VR headset observation. Once identified, these factors are further discussed and assessed through a series of experiments and usability studies, based on a predefined set of research questions. More specifically, the role of familiarity with the observed place, the role of the environment characteristics shown to the viewer, and the role of the display used for the remote observation of the virtual environment are further investigated. To gain more insights, two usability studies are proposed with the aim of defining guidelines and best practices. The main outcomes from the two studies demonstrate that test users can experience an enhanced realistic observation when natural features, higher resolution displays, natural illumination, and high image contrast are used in Mobile VR. In terms of comfort, simple scene layouts and relaxing environments are considered ideal to reduce visual fatigue and eye strain. Furthermore, sense of presence increases when observed environments induce strong emotions, and depth perception improves in VR when several monocular cues such as lights and shadows are combined with binocular depth cues. Based on these results, this investigation then presents a focused evaluation on the outcomes and introduces an innovative eye-adapted High Dynamic Range (HDR) approach, which the author believes to be of great improvement in the context of remote observation when combined with eye-tracked VR headsets. Within this purpose, a third user study is proposed to compare static HDR and eye-adapted HDR observation in VR, to assess that the latter can improve realism, depth perception, sense of presence, and in certain cases even comfort. Results from this last study confirmed the author expectations, proving that eye-adapted HDR and eye tracking should be used to achieve best visual performances for remote observation in modern VR systems