Leveraging eXtented Reality & Human-Computer Interaction for User Experi- ence in 360◦ Video

EXtended Reality systems have resurged as a medium for work and entertainment. While 360o video has been characterized as less immersive than computer-generated VR, its realism, ease of use and affordability mean it is in widespread commercial use. Based on the prevalence and potential of the 360o video format, this research is focused on improving and augmenting the user experience of watching 360o video. By leveraging knowledge from Extented Reality (XR) systems and Human-Computer Interaction (HCI), this research addresses two issues affecting user experience in 360o video: Attention Guidance and Visually Induced Motion Sickness (VIMS). This research work relies on the construction of multiple artifacts to answer the de- fined research questions: (1) IVRUX, a tool for analysis of immersive VR narrative expe- riences; (2) Cue Control, a tool for creation of spatial audio soundtracks for 360o video, as well as enabling the collection and analysis of captured metrics emerging from the user experience; and (3) VIMS mitigation pipeline, a linear sequence of modules (including optical flow and visual SLAM among others) that control parameters for visual modi- fications such as a restricted Field of View (FoV). These artifacts are accompanied by evaluation studies targeting the defined research questions. Through Cue Control, this research shows that non-diegetic music can be spatialized to act as orientation for users. A partial spatialization of music was deemed ineffective when used for orientation. Addi- tionally, our results also demonstrate that diegetic sounds are used for notification rather than orientation. Through VIMS mitigation pipeline, this research shows that dynamic restricted FoV is statistically significant in mitigating VIMS, while mantaining desired levels of Presence. Both Cue Control and the VIMS mitigation pipeline emerged from a Research through Design (RtD) approach, where the IVRUX artifact is the product of de- sign knowledge and gave direction to research. The research presented in this thesis is of interest to practitioners and researchers working on 360o video and helps delineate future directions in making 360o video a rich design space for interaction and narrative.Sistemas de Realidade EXtendida ressurgiram como um meio de comunicação para o tra- balho e entretenimento. Enquanto que o vídeo 360o tem sido caracterizado como sendo menos imersivo que a Realidade Virtual gerada por computador, o seu realismo, facili- dade de uso e acessibilidade significa que tem uso comercial generalizado. Baseado na prevalência e potencial do formato de vídeo 360o, esta pesquisa está focada em melhorar e aumentar a experiência de utilizador ao ver vídeos 360o. Impulsionado por conhecimento de sistemas de Realidade eXtendida (XR) e Interacção Humano-Computador (HCI), esta pesquisa aborda dois problemas que afetam a experiência de utilizador em vídeo 360o: Orientação de Atenção e Enjoo de Movimento Induzido Visualmente (VIMS). Este trabalho de pesquisa é apoiado na construção de múltiplos artefactos para res- ponder as perguntas de pesquisa definidas: (1) IVRUX, uma ferramenta para análise de experiências narrativas imersivas em VR; (2) Cue Control, uma ferramenta para a criação de bandas sonoras de áudio espacial, enquanto permite a recolha e análise de métricas capturadas emergentes da experiencia de utilizador; e (3) canal para a mitigação de VIMS, uma sequência linear de módulos (incluindo fluxo ótico e SLAM visual entre outros) que controla parâmetros para modificações visuais como o campo de visão restringido. Estes artefactos estão acompanhados por estudos de avaliação direcionados para às perguntas de pesquisa definidas. Através do Cue Control, esta pesquisa mostra que música não- diegética pode ser espacializada para servir como orientação para os utilizadores. Uma espacialização parcial da música foi considerada ineficaz quando usada para a orientação. Adicionalmente, os nossos resultados demonstram que sons diegéticos são usados para notificação em vez de orientação. Através do canal para a mitigação de VIMS, esta pesquisa mostra que o campo de visão restrito e dinâmico é estatisticamente significante ao mitigar VIMS, enquanto mantem níveis desejados de Presença. Ambos Cue Control e o canal para a mitigação de VIMS emergiram de uma abordagem de Pesquisa através do Design (RtD), onde o artefacto IVRUX é o produto de conhecimento de design e deu direcção à pesquisa. A pesquisa apresentada nesta tese é de interesse para profissionais e investigadores tra- balhando em vídeo 360o e ajuda a delinear futuras direções em tornar o vídeo 360o um espaço de design rico para a interação e narrativa

USSR Space Life Sciences Digest, issue 21

This is the twenty-first issue of NASA's USSR Space Life Sciences Digest. It contains abstracts of 37 papers published in Russian language periodicals or books or presented at conferences and of a Soviet monograph on animal ontogeny in weightlessness. Selected abstracts are illustrated with figures and tables from the original. A book review of a work on adaptation to stress is also included. The abstracts in this issue have been identified as relevant to 25 areas of space biology and medicine. These areas are: adaptation, biological rhythms, body fluids, botany, cardiovascular and respiratory systems, cytology, developmental biology, endocrinology, enzymology, equipment and instrumentation, exobiology, gravitational biology, habitability and environmental effects, hematology, human performance, life support systems, mathematical modeling, metabolism, microbiology, musculoskeletal system, neurophysiology, operational medicine, perception, psychology, and reproductive system

THE ROLE OF HEAD MOVEMENTS IN SIMULATOR SICKNESS GENERATED BY A VIRTUAL ENVIRONMENT

Virtual environments (VEs) are being used in a variety of applications, including training, rehabilitation and clinical treatment. To effectively utilize VEs in these situations it is important to try to understand some of the effects of VE exposure. The purpose of this study was to investigate head and body movements in virtual and real environments during building clearing and the relationship between these movements and simulator sickness. The data for the current study were drawn from a larger team training study which investigated the use of VEs for training building clearing. The goal of the first part of this study was to compare head movements made in a real world (RW) environment to head movements made in a VE (Analysis I). The goal of second part of this study was to examine the relationship between head movements and simulator sickness in a VE (Analysis II). The first analysis used two independent samples t-tests to examine the differences between head movements made in a VE and head movements made in a RW environment. The t-tests showed that subjects in the VE moved their heads less, t(23.438)=12.690, p\u3c0.01, and less often, t(46)=8.682, p\u3c0.05, than subjects in the RW. In the second analysis, a 3 x 20 ANOVA found a significant difference between groups with low, med, and high simulator sickness scores, F(2,21)=4.221, p\u3c0.05, ήp2= 0.287, where subjects who reported being the most sick tended to restrict their head movements more than the other two groups. For VEs to progress as a useful tool, whether for training, therapy, etc., it will be necessary to identify the variable(s) that cause people to become motion sick and restrict their head movement during VE exposure. Future studies should seek to investigate more continuous measures of sickness, perhaps psychophysiological measures, and possible effects of a negative transfer of training due to the restriction of head movements in VEs

Biosignalų požymių regos diskomfortui vertinti išskyrimas ir tyrimas

Comfortable stereoscopic perception continues to be an essential area of research. The growing interest in virtual reality content and increasing market for head-mounted displays (HMDs) still cause issues of balancing depth perception and comfortable viewing. Stereoscopic views are stimulating binocular cues – one type of several available human visual depth cues which becomes conflicting cues when stereoscopic displays are used. Depth perception by binocular cues is based on matching of image features from one retina with corresponding features from the second retina. It is known that our eyes can tolerate small amounts of retinal defocus, which is also known as Depth of Focus. When magnitudes are larger, a problem of visual discomfort arises. The research object of the doctoral dissertation is a visual discomfort level. This work aimed at the objective evaluation of visual discomfort, based on physiological signals. Different levels of disparity and the number of details in stereoscopic views in some cases make it difficult to find the focus point for comfortable depth perception quickly. During this investigation, a tendency for differences in single sensor-based electroencephalographic EEG signal activity at specific frequencies was found. Additionally, changes in eye tracker collected gaze signals were also found. A dataset of EEG and gaze signal records from 28 control subjects was collected and used for further evaluation. The dissertation consists of an introduction, three chapters and general conclusions. The first chapter reveals the fundamental knowledge ways of measuring visual discomfort based on objective and subjective methods. In the second chapter theoretical research results are presented. This research was aimed to investigate methods which use physiological signals to detect changes on the level of sense of presence. Results of the experimental research are presented in the third chapter. This research aimed to find differences in collected physiological signals when a level of visual discomfort changes. An experiment with 28 control subjects was conducted to collect these signals. The results of the thesis were published in six scientific publications – three in peer-reviewed scientific papers, three in conference proceedings. Additionally, the results of the research were presented in 8 conferences.Dissertatio

USSR Space Life Sciences Digest, Issue 18

This is the 18th issue of NASA's USSR Life Sciences Digest. It contains abstracts of 50 papers published in Russian language periodicals or presented at conferences and of 8 new Soviet monographs. Selected abstracts are illustrated with figures and tables from the original. A review of a recent Aviation Medicine Handbook is also included. The abstracts in this issue have been identified as relevant to 37 areas of space biology and medicine. These areas are: adaptation, aviation medicine, biological rhythms, biospherics, body fluids, cardiovascular and respiratory systems, cytology, developmental biology, endocrinology, enzymology, equipment and instrumentation, exobiology, gastrointestinal system, genetics, gravitational biology, group dynamics, habitability and environmental effects, hematology, human performance, immunology, life support systems, man-machine systems, mathematical modeling, metabolism, microbiology, musculoskeletal system, neurophysiology, nutrition, operational medicine, perception, personnel selection, psychology, radiobiology, reproductive biology, space biology and medicine, and space industrialization

Aerospace medicine and biology: A cumulative index to a continuing bibliography (supplement 319)

This publication is a cumulative index to the abstracts contained in Supplements 307 through 318 of Aerospace Medicine and Biology: A Continuing Bibliography. Seven indexes are included -- subject, personal author, corporate source, foreign technology, contract number, report number and accession number