The Effect of Augmented Reality on Spatial Visualization Ability of Elementary School Student

The invention of Augmented Reality (AR) has provided a platform for individuals to see virtual and real objects simultaneously in a real-life setting. As compared to other technologies being implemented in education setting, it may contribute a new method to educate. This study investigated the possible effect of AR technology on students’ spatial visualization ability. AR-Science Magic Book Learning System (AR-SMB) is a learning tool based on the AR technology which was developed in this study to facilitate students in learning science concept, hence enhancing their spatial visualization ability. The type of data collection methodology used is the quantitative approach in which pre-test and post-test design were implemented and the participant comprised of 34 fifth-grade students. According to the results, it was found that the scores of the Mental Rotation Test (MRT) post-test were significantly greater than the pre-test, thus AR technology can be considered to be beneficial in enhancing students’ spatial visualization ability. There is a huge difference in terms of the scores of MRT between the pre-test and post-test which concludes that the treatment given can significantly improve and contribute towards their spatial visualization ability. The findings of this research enable the educators to incorporate AR learning into their teaching process in order for students to understand the rotation and transformation of objects that are related to each other. As a result, this study has shown a significant implication for the understanding of AR’s effect in enhancing spatial visualization ability among primary school students

Evaluating Semi-Natural Travel and Viewing Techniques in Virtual Reality

With seated virtual reality (VR), the use cases based on seating conditions need to be considered while designing the travel and viewing techniques. The most natural method in seated VR, for viewing interactions is the standard 360-degree rotation, for which a swivel chair that spins around the vertical axis is commonly used. However, the VR users will not have the affordances of a swivel chair or the physical space to turn around, all the time. This limits their VR usage based on the availability of certain physical setups. Moreover, for prolonged usage, users might prefer to have convenient viewing interactions by sitting on a couch, not rotating physically all the way around. Our research addresses these scenarios by studying new and existing semi-natural travel and viewing techniques that can be used when full 360-degree rotation is not feasible or is not preferred. Two new techniques, guided head rotation and user-controlled resetting were developed and were compared with existing techniques in three controlled experiments. Standard 360- degree rotation and three joystick-control based viewing techniques (discrete rotation, continuous rotation and continuous rotation with reduced fov) were the existing techniques compared in our experiments. Since the new techniques and some of the existing techniques involve some rotation manipulations that are not natural, they could disorient the users during a virtual experience. So, two VR puzzle games were designed to study the effects of the techniques on spatial awareness of the users. Convenience, simulator sickness, comfort and preferences for home entertainment were the other factors investigated in the experiments. From the experiments, we found out that the results were based on 3D gaming experience of the participants. Participants who played 3D games one or more hours per week had higher tolerance towards the new techniques that had rotational manipulations compared to the participants who did not play any 3D game. Among the joystick rotation techniques, discrete rotation was rated the best by users in terms of simulator sickness. In addition to these experiments, we also present a case study that demonstrates the application of guided head rotation in an experiment that studied natural hand interaction with virtual objects under constrained physical conditions

Expanding the bounds of seated virtual workspaces

Mixed Reality (MR), Augmented Reality (AR) and Virtual Reality (VR) headsets can improve upon existing physical multi-display environments by rendering large, ergonomic virtual display spaces whenever and wherever they are needed. However, given the physical and ergonomic limitations of neck movement, users may need assistance to view these display spaces comfortably. Through two studies, we developed new ways of minimising the physical effort and discomfort of viewing such display spaces. We first explored how the mapping between gaze angle and display position could be manipulated, helping users view wider display spaces than currently possible within an acceptable and comfortable range of neck movement. We then compared our implicit control of display position based on head orientation against explicit user control, finding significant benefits in terms of user preference, workload and comfort for implicit control. Our novel techniques create new opportunities for productive work by leveraging MR headsets to create interactive wide virtual workspaces with improved comfort and usability. These workspaces are flexible and can be used on-the-go, e.g., to improve remote working or make better use of commuter journeys

Validation of a low-cost virtual reality system for training street-crossing. A comparative study in healthy, neglected and non-neglected stroke individuals

Unilateral spatial neglect is a common consequence of stroke that directly affects the performance of activities of daily living. This impairment is traditionally assessed with paper-and-pencil tests that can lack correspondence to real life and are easily compensated. Virtual reality can immerse patients in more ecological scenarios, thus providing therapists with new tools to assess and train the effects of this impairment in simulated real tasks. This paper presents the clinical validation and convergent validity of a low-cost virtual reality system for training street-crossing in stroke patients with and without neglect. The performance of neglect patients was significantly worse than the performance of non-neglect and healthy participants. In addition, several correlations between the scores in the system and in the traditional scales were detected.This study was funded in part by Ministerio de Educacion y Ciencia Spain, Projects Consolider-C (SEJ2006-14301/PSIC), "CIBER of Physiopathology of Obesity and Nutrition, an initiative of ISCIII" and the Excellence Research Program PROMETEO (Generalitat Valenciana. Conselleria de Educacion, 2008-157).Navarro, MD.; Llorens Rodríguez, R.; Noé, E.; Ferri, J.; Alcañiz Raya, ML. (2013). Validation of a low-cost virtual reality system for training street-crossing. A comparative study in healthy, neglected and non-neglected stroke individuals. Neuropsychological Rehabilitation. 23(4):597-618. https://doi.org/10.1080/09602011.2013.806269S597618234Allegri, R. F. (2000). Atención y negligencia: bases neurológicas, evaluación y trastornos. Revista de Neurología, 30(05), 491. doi:10.33588/rn.3005.99645Appelros, P., Karlsson, G. M., Seiger, Åke, & Nydevik, I. (2002). Neglect and Anosognosia After First-Ever Stroke: Incidence and Relationship to Disability. Journal of Rehabilitation Medicine, 34(5), 215-220. doi:10.1080/165019702760279206Baheux, K., Yoshizawa, M., & Yoshida, Y. (2007). Simulating hemispatial neglect with virtual reality. Journal of NeuroEngineering and Rehabilitation, 4(1). doi:10.1186/1743-0003-4-27Boian, R. F., Burdea, G. C., Deutsch, J. E. and Winter, S. H. Street crossing using a virtual environment mobility simulator.Paper presented at 3rd Annual International Workshop on Virtual Reality. Lausanne, Switzerland.Broeren, J., Samuelsson, H., Stibrant-Sunnerhagen, K., Blomstrand, C., & Rydmark, M. (2007). Neglect assessment as an application of virtual reality. Acta Neurologica Scandinavica, 116(3), 157-163. doi:10.1111/j.1600-0404.2007.00821.xBuxbaum, L. J., Ferraro, M. K., Veramonti, T., Farne, A., Whyte, J., Ladavas, E., … Coslett, H. B. (2004). Hemispatial neglect: Subtypes, neuroanatomy, and disability. Neurology, 62(5), 749-756. doi:10.1212/01.wnl.0000113730.73031.f4Buxbaum, L. J., Palermo, M. A., Mastrogiovanni, D., Read, M. S., Rosenberg-Pitonyak, E., Rizzo, A. A., & Coslett, H. B. (2008). Assessment of spatial attention and neglect with a virtual wheelchair navigation task. Journal of Clinical and Experimental Neuropsychology, 30(6), 650-660. doi:10.1080/13803390701625821Castiello, U., Lusher, D., Burton, C., Glover, S., & Disler, P. (2004). Improving left hemispatial neglect using virtual reality. Neurology, 62(11), 1958-1962. doi:10.1212/01.wnl.0000128183.63917.02Conners, C. K., Epstein, J. N., Angold, A., & Klaric, J. (2003). Journal of Abnormal Child Psychology, 31(5), 555-562. doi:10.1023/a:1025457300409Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). «Mini-mental state». Journal of Psychiatric Research, 12(3), 189-198. doi:10.1016/0022-3956(75)90026-6Fordell, H., Bodin, K., Bucht, G., & Malm, J. (2011). A virtual reality test battery for assessment and screening of spatial neglect. Acta Neurologica Scandinavica, 123(3), 167-174. doi:10.1111/j.1600-0404.2010.01390.xGupta, V., Knott, B. A., Kodgi, S., & Lathan, C. E. (2000). Using the «VREye» System for the Assessment of Unilateral Visual Neglect: Two Case Reports. Presence: Teleoperators and Virtual Environments, 9(3), 268-286. doi:10.1162/105474600566790Hartman-Maeir, A., & Katz, N. (1995). Validity of the Behavioral Inattention Test (BIT): Relationships With Functional Tasks. American Journal of Occupational Therapy, 49(6), 507-516. doi:10.5014/ajot.49.6.507Jannink, M. J. A., Aznar, M., de Kort, A. C., van de Vis, W., Veltink, P., & van der Kooij, H. (2009). Assessment of visuospatial neglect in stroke patients using virtual reality: a pilot study. International Journal of Rehabilitation Research, 32(4), 280-286. doi:10.1097/mrr.0b013e3283013b1cJehkonen, M., Laihosalo, M., & Kettunen, J. (2006). Anosognosia after stroke: assessment, occurrence, subtypes and impact on functional outcome reviewed. Acta Neurologica Scandinavica, 114(5), 293-306. doi:10.1111/j.1600-0404.2006.00723.xKatz, N., Ring, H., Naveh, Y., Kizony, R., Feintuch, U., & Weiss, P. L. (2005). Interactive virtual environment training for safe street crossing of right hemisphere stroke patients with Unilateral Spatial Neglect. Disability and Rehabilitation, 27(20), 1235-1244. doi:10.1080/09638280500076079Kim, D. Y., Ku, J., Chang, W. H., Park, T. H., Lim, J. Y., Han, K., … Kim, S. I. (2010). Assessment of post-stroke extrapersonal neglect using a three-dimensional immersive virtual street crossing program. Acta Neurologica Scandinavica, 121(3), 171-177. doi:10.1111/j.1600-0404.2009.01194.xKim, J., Kim, K., Kim, D. Y., Chang, W. H., Park, C.-I., Ohn, S. H., … Kim, S. I. (2007). Virtual Environment Training System for Rehabilitation of Stroke Patients with Unilateral Neglect: Crossing the Virtual Street. CyberPsychology & Behavior, 10(1), 7-15. doi:10.1089/cpb.2006.9998Kim, K., Kim, J., Ku, J., Kim, D. Y., Chang, W. H., Shin, D. I., … Kim, S. I. (2004). A Virtual Reality Assessment and Training System for Unilateral Neglect. CyberPsychology & Behavior, 7(6), 742-749. doi:10.1089/cpb.2004.7.742Kim, Y. M., Chun, M. H., Yun, G. J., Song, Y. J., & Young, H. E. (2011). The Effect of Virtual Reality Training on Unilateral Spatial Neglect in Stroke Patients. Annals of Rehabilitation Medicine, 35(3), 309. doi:10.5535/arm.2011.35.3.309Krakauer, J. W. (2006). Motor learning: its relevance to stroke recovery and neurorehabilitation. Current Opinion in Neurology, 19(1), 84-90. doi:10.1097/01.wco.0000200544.29915.ccMcComas, J., MacKay, M., & Pivik, J. (2002). Effectiveness of Virtual Reality for Teaching Pedestrian Safety. CyberPsychology & Behavior, 5(3), 185-190. doi:10.1089/109493102760147150Myers, R. L., & Bierig, T. A. (2000). Virtual Reality and Left Hemineglect: A Technology for Assessment and Therapy. CyberPsychology & Behavior, 3(3), 465-468. doi:10.1089/10949310050078922Peskine, A., Rosso, C., Box, N., Galland, A., Caron, E., Rautureau, G., … Pradat-Diehl, P. (2010). Virtual reality assessment for visuospatial neglect: importance of a dynamic task. Journal of Neurology, Neurosurgery & Psychiatry, 82(12), 1407-1409. doi:10.1136/jnnp.2010.217513Romero, M., Sánchez, A., Marín, C., Navarro, M. D., Ferri, J., & Noé, E. (2012). Utilidad clínica de la versión en castellano del Mississippi Aphasia Screening Test (MASTsp): validación en pacientes con ictus. Neurología, 27(4), 216-224. doi:10.1016/j.nrl.2011.06.006Rose, F. D., Brooks, B. M., & Rizzo, A. A. (2005). Virtual Reality in Brain Damage Rehabilitation: Review. CyberPsychology & Behavior, 8(3), 241-262. doi:10.1089/cpb.2005.8.241Schwebel, D. C., & McClure, L. A. (2010). Using virtual reality to train children in safe street-crossing skills. Injury Prevention, 16(1), e1-e1. doi:10.1136/ip.2009.025288Simpson, G., Johnston, L., & Richardson, M. (2003). An investigation of road crossing in a virtual environment. Accident Analysis & Prevention, 35(5), 787-796. doi:10.1016/s0001-4575(02)00081-7Smith, J., Hebert, D., & Reid, D. (2007). Exploring the effects of virtual reality on unilateral neglect caused by stroke: Four case studies. Technology and Disability, 19(1), 29-40. doi:10.3233/tad-2007-19104Sugarman, H., Weisel-Eichler, A., Burstin, A. and Brown, R.Use of novel virtual reality system for the assessment and treatment of unilateral spatial neglect: A feasibility study. Paper presented at International Conference on Virtual Rehabilitation. Zürich.Tanaka, T., Sugihara, S., Nara, H., Ino, S., & Ifukube, T. (2005). Journal of NeuroEngineering and Rehabilitation, 2(1), 31. doi:10.1186/1743-0003-2-31Thomson, J. A., Tolmie, A. K., Foot, H. C., Whelan, K. M., Sarvary, P., & Morrison, S. (2005). Influence of Virtual Reality Training on the Roadside Crossing Judgments of Child Pedestrians. Journal of Experimental Psychology: Applied, 11(3), 175-186. doi:10.1037/1076-898x.11.3.175Weiss, P. L. (Tamar), Naveh, Y., & Katz, N. (2003). Design and testing of a virtual environment to train stroke patients with unilateral spatial neglect to cross a street safely. Occupational Therapy International, 10(1), 39-55. doi:10.1002/oti.176Witmer, B. G., & Singer, M. J. (1998). Measuring Presence in Virtual Environments: A Presence Questionnaire. Presence: Teleoperators and Virtual Environments, 7(3), 225-240. doi:10.1162/105474698565686Wu, H., Ashmead, D. H. and Bodenheimer, B.Using immersive virtual reality to evaluate pedestrian street crossing decisions at a roundabout. Paper presented at 6th Symposium on appied perception in Graphics and Visualization. Chania

Augmenting low-fidelity flight simulation training devices via amplified head rotations

Due to economic and operational constraints, there is an increasing demand from aviation operators and training manufacturers to extract maximum training usage from the lower fidelity suite of flight simulators. It is possible to augment low-fidelity flight simulators to achieve equivalent performance compared to high-fidelity setups but at reduced cost and greater mobility. In particular for visual manoeuvres, the virtual reality technique of head-tracking amplification for virtual view control enables full field-of-regard access even with limited field-of-view displays. This research quantified the effects of this technique on piloting performance, workload and simulator sickness by applying it to a fixed-base, low-fidelity, low-cost flight simulator. In two separate simulator trials, participants had to land a simulated aircraft from a visual traffic circuit pattern whilst scanning for airborne traffic. Initially, a single augmented display was compared to the common triple display setup in front of the pilot. Starting from the base leg, pilots exhibited tighter turns closer to the desired ground track and were more actively conducting visual scans using the augmented display. This was followed up by a second experiment to quantify the scalability of augmentation towards larger displays and field of views. Task complexity was increased by starting the traffic pattern from the downwind leg. Triple displays in front of the pilot yielded the best compromise delivering flight performance and traffic detection scores just below the triple projectors but without an increase in track deviations and the pilots were also less prone to simulator sickness symptoms. This research demonstrated that head augmentation yields clear benefits of quick user adaptation, low-cost, ease of systems integration, together with the capability to negate the impact of display sizes yet without incurring significant penalties in workload and incurring simulator sickness. The impact of this research is that it facilitates future flight training solutions using this augmentation technique to meet budgetary and mobility requirements. This enables deployment of simulators in large numbers to deliver expanded mission rehearsal previously unattainable within this class of low-fidelity simulators, and with no restrictions for transfer to other training media

Auditory Induced Vection: Exploring Angular Acceleration Of Sound Sources

Vection designa a terminologia para self-motion illusions. Um exemplo comum para esta sensação é quando se está sentado num comboio parado e, ao lado do mesmo, outro comboio igualmente parado começa a marcha, dando a sensação que é o comboio do observador que se move.Apesar de esta sensação estar maioritariamente ligada ao estímulo visual, estudos demonstraram que é possível induzir vection através do sistema auditivo.Grande parte dos estudos relacionados utilizaram reprodução binaural, devido à sua eficácia na indução desta ilusão de movimento. Neste estudo propomos estudar os efeitos da aceleração angular na indução de vection auditivo, através de um sistema multi-canal de 8 colunas dispostas em círculo.Vection effect is the body movement sensation, when there is no movement occurring. The main example given for this vection sensation is when someone is sitting in a stationary train and another train starts moving alongside of the stationary train where the perceiver is, providing an illusion of movement. Although this sensation is mostly associated with the visual system, studies demonstrated that brain has a movement-sensitive area in the auditory cortex and that it is possible to induce auditory vection.Related studies uses binaural reproduction, which has been shown to be effective on AIV. However, in this project, we aim to test factors of angular acceleration reproduced by an 8 speaker array, circularly disposed

SOVEREIGN: An Autonomous Neural System for Incrementally Learning Planned Action Sequences to Navigate Towards a Rewarded Goal

How do reactive and planned behaviors interact in real time? How are sequences of such behaviors released at appropriate times during autonomous navigation to realize valued goals? Controllers for both animals and mobile robots, or animats, need reactive mechanisms for exploration, and learned plans to reach goal objects once an environment becomes familiar. The SOVEREIGN (Self-Organizing, Vision, Expectation, Recognition, Emotion, Intelligent, Goaloriented Navigation) animat model embodies these capabilities, and is tested in a 3D virtual reality environment. SOVEREIGN includes several interacting subsystems which model complementary properties of cortical What and Where processing streams and which clarify similarities between mechanisms for navigation and arm movement control. As the animat explores an environment, visual inputs are processed by networks that are sensitive to visual form and motion in the What and Where streams, respectively. Position-invariant and sizeinvariant recognition categories are learned by real-time incremental learning in the What stream. Estimates of target position relative to the animat are computed in the Where stream, and can activate approach movements toward the target. Motion cues from animat locomotion can elicit head-orienting movements to bring a new target into view. Approach and orienting movements are alternately performed during animat navigation. Cumulative estimates of each movement are derived from interacting proprioceptive and visual cues. Movement sequences are stored within a motor working memory. Sequences of visual categories are stored in a sensory working memory. These working memories trigger learning of sensory and motor sequence categories, or plans, which together control planned movements. Predictively effective chunk combinations are selectively enhanced via reinforcement learning when the animat is rewarded. Selected planning chunks effect a gradual transition from variable reactive exploratory movements to efficient goal-oriented planned movement sequences. Volitional signals gate interactions between model subsystems and the release of overt behaviors. The model can control different motor sequences under different motivational states and learns more efficient sequences to rewarded goals as exploration proceeds.Riverside Reserach Institute; Defense Advanced Research Projects Agency (N00014-92-J-4015); Air Force Office of Scientific Research (F49620-92-J-0225); National Science Foundation (IRI 90-24877, SBE-0345378); Office of Naval Research (N00014-92-J-1309, N00014-91-J-4100, N00014-01-1-0624, N00014-01-1-0624); Pacific Sierra Research (PSR 91-6075-2