Development and usability analysis of a mixed reality GPS navigator application for the microsoft hololens

The present work aims to perform a comparative usability analysis between two Human- Computer Interaction systems (HCI) for global geolocation (GPS) navigators. The intent is to compare the conventional use of a navigation application on a mobile device, such as a smartphone attached to the dashboard of a vehicle, to an implementation in Mixed Reality (MR) powered by the Head Mounted Display (HMD) Microsoft HoloLens. By connecting the MR device to a local network routed by an ordinary cellular phone, which is connected to a mobile data network, it is possible to ubiquitously acquire the phone’s geolocation data, its magnetometer deviation and a route graph of a navigation Application Programming Interface (API) from its current location to a destination entered by the user. Thus, a series of three-dimensional holograms are created at runtime, geolocated and placed around the user, guiding him through a path indicated on the floor, pertinent to the streets around him that lead to the desired destination. Apart from that, arrows are projected on the way at each crucial point of the path, where some maneuver must be performed, e.g., turning right or taking an exit at a roundabout. In a user experiment, performance and usability were assessed. Results show that users deemed the MR solution to offer a higher visibility both to the oncoming traffic and the suggested route, when compared to the conventional interface, being less attention demanding. EEG readings for most participants also exposed a significantly more demanding focus level for the handheld device. Additionally, an easiness to learn and use was indicated for our system, being almost on par with the already known and highly used application tested.O presente trabalho visa realizar uma análise comparativa de usabilidade entre dois sistemas de interação humano-computador para navegadores de geolocalização global (GPS). Foi almejado comparar o uso convencional do sistema, através de um dispositivo móvel tal qual um smartphone afixado ao painel de um veículo, com uma nova implementação em Realidade Mista potencializada pelo HMD Microsoft HoloLens. Conectando o dispositivo de realidade mista (MR) a uma rede local roteada por um aparelho celular convencional, este conectado a uma rede de dados móvel, foi possível receber ubiquamente os dados de sua geolocalização, de seu magnetômetro e um grafo de rota de uma API de navegação de alta disponibilidade partindo do presente local até um destino inserido pelo usuário. Com isso, é criada em tempo de execução uma série de hologramas tridimensionais geolocalizados ao redor do usuário, guiando-o através de um caminho indicado em seu chão, pertinente às ruas a sua volta que o levarão ao destino desejado. Também são projetadas flechas em seu caminho em cada ponto crucial de seu trajeto, onde deve-se realizar alguma manobra, e.g., dobrar à direita ou tomar uma saída de uma rotatória. Em um experimento realizado com usuários reais, seu desempenho e usabilidade foram aferidos. Resultados mostram que os usuários estimaram que a solução em MR oferecia uma visibilidade maior tanto ao tráfego passante quanto à rota sugerida, em comparação à interface convencional, requerindo menos atenção. Leituras de eletroencefalografia (EEG) na maioria dos participantes indicaram uma demanda significativamente maior de atenção focada no uso do dispositivo móvel. Uma grande facilidade de aprendizado e de uso também foi apontada para nosso sistema, estando quase a par da aplicação móvel altamente conhecida e usada

ReRide:A Platform to Explore Interaction with Personal Data Before, During, and After Motorcycle Commuting

Part 7: DemonstrationsInternational audienceThe motorcycle could soon be the new frontier for the exploration of human interaction with advanced digital technology. In this paper we present a demo of a system designed and implemented to explore the design of personal informatics tools for motorbike commuting and help us conduct in-situ evaluation of such tools. We present the system architecture and demonstrate the capabilities of the system by presenting a case instantiation in the form of an interactive soft-and-hardware prototype that collects rider’s posture data, visualizes the data on the motorbike dashboard in real-time, and pushes the data to the cloud server for later retrieval

Designing Tactile Interfaces for Abstract Interpersonal Communication, Pedestrian Navigation and Motorcyclists Navigation

The tactile medium of communication with users is appropriate for displaying information in situations where auditory and visual mediums are saturated. There are situations where a subject's ability to receive information through either of these channels is severely restricted by the environment they are in or through any physical impairments that the subject may have. In this project, we have focused on two groups of users who need sustained visual and auditory focus in their task: Soldiers on the battle field and motorcyclists. Soldiers on the battle field use their visual and auditory capabilities to maintain awareness of their environment to guard themselves from enemy assault. One of the major challenges to coordination in a hazardous environment is maintaining communication between team members while mitigating cognitive load. Compromise in communication between team members may result in mistakes that can adversely affect the outcome of a mission. We have built two vibrotactile displays, Tactor I and Tactor II, each with nine actuators arranged in a three-by-three matrix with differing contact areas that can represent a total of 511 shapes. We used two dimensions of tactile medium, shapes and waveforms, to represent verb phrases and evaluated ability of users to perceive verb phrases the tactile code. We evaluated the effectiveness of communicating verb phrases while the users were performing two tasks simultaneously. The results showed that performing additional visual task did not affect the accuracy or the time taken to perceive tactile codes. Another challenge in coordinating Soldiers on a battle field is navigating them to respective assembly areas. We have developed HaptiGo, a lightweight haptic vest that provides pedestrians both navigational intelligence and obstacle detection capabilities. HaptiGo consists of optimally-placed vibro-tactile sensors that utilize natural and small form factor interaction cues, thus emulating the sensation of being passively guided towards the intended direction. We evaluated HaptiGo and found that it was able to successfully navigate users with timely alerts of incoming obstacles without increasing cognitive load, thereby increasing their environmental awareness. Additionally, we show that users are able to respond to directional information without training. The needs of motorcyclists are di erent from those of Soldiers. Motorcyclists' need to maintain visual and auditory situational awareness at all times is crucial since they are highly exposed on the road. Route guidance systems, such as the Garmin, have been well tested on automobilists, but remain much less safe for use by motorcyclists. Audio/visual routing systems decrease motorcyclists' situational awareness and vehicle control, and thus increase the chances of an accident. To enable motorcyclists to take advantage of route guidance while maintaining situational awareness, we created HaptiMoto, a wearable haptic route guidance system. HaptiMoto uses tactile signals to encode the distance and direction of approaching turns, thus avoiding interference with audio/visual awareness. Evaluations show that HaptiMoto is intuitive for motorcyclists, and a safer alternative to existing solutions

Helmet-Mounted Display System Based on IoT

Many people enjoy motorcycle riding and there are thousands of people who have lost their lives due to road accidents. This is mainly due to the delay in the state of emergency that must be provided to the victims. The helmet-mounted display system that uses the Internet of Things (IoT) reduces accidents and informs its contacts in emergencies so the helmet module contains sensors to determine the passenger\u27s pulse rate, alcohol content, and vibration intensity. The pulse rate sensor is used to determine whether the rider has worn the helmet and which will be connected to the rider\u27s start of his trip on the road. That\u27s why we implemented a prototype proposal using the IoT to connect all devices and make it easier for the user to reduce road accidents by displaying all their needs in full on the helmet screen. So, in the implementation of our proposal, we made several systems connected with Raspberry Pi 4 which are Global Positioning System (GPS) applications, camera systems, and sensors that display all output data in the background, after that will transmit all these data from Raspberry Pi 4 to Raspberry Pi 3 through User Datagram Protocol (UDP), which Raspberry Pi 3 connected with Digital Light Processing )DLP) projector to display all background data as a hologram to the user giving him safety on the road without any distractions

Impact of Perceptual Speed Calming Curve Countermeasures On Drivers’ Anticipation & Mitigation Ability – A Driving Simulator Study

A potential factor for curve accidents are anticipatory skills. Horizontal curves have been recognized as a significant safety issue for many years. This study investigates the impact and effectiveness of three curve based perceptual speed calming countermeasures (advanced curve warning signs, chevron sign, and heads-up display(HUD) sign) on drivers’ hazard anticipation and mitigation behavior across both left and right-winding curves, and sharp (radius 200m) and flat (radius 500m) curves. Experimental results show that the speed and lateral control in the horizontal curves differed with respect to curve radii, direction, and the type of countermeasure presented. These differences in behavior are probably due to curve-related disparities, the type of perceptual countermeasure, and the presence of hazard at the apex of the curve. HUD is found to be effective at not only reducing the drivers’ speed in the curve, but also improve the latent hazard anticipation ability of the driver at the apex of the curve. Flat and sharp curves with indications of a safety problem were virtually developed in the simulator as representative as possible without upsetting the simulator’s fidelity. 48 participants were recruited for this study between the age range of 18 and 34, and driving experience range was from 0.25 to 17.75 years

Extending head-up displays

Drivers consume an increasing amount of information while driving. The information is accessed on the in-car displays but also on personal devices such as the smartphone. Head-up displays are designed for a safe uptake of additional visual information while driving but their benefits are limited by the small display space. This motivates academia and industry to advance the head-up to the so-called windshield display. A windshield display will provide an extended display space, which largely or entirely covers the driver’s visual field through the windshield, as well as 3D and depth perception. Technologically, they are not yet feasible, but, thanks to steady advancements they will become available in the future. Extending a small 2D to a large 3D space requires a rethinking of the entire user interface. The windshield display opens up new opportunities for the type and amount of information, as well as for the way it is presented – ranging up to full augmented reality but it also raises concerns about a distracted driver. The core question of this thesis is whether such an extension is reasonable and desirable – meaning if there are convincing arguments and use cases which justify the potential risk of distraction. This thesis presents our research about the risks and benefits of the transition from a head-up to a windshield display. Thus, we explore the potentials and examine the safety risks and benefits as well as the drivers’ satisfaction of various display aspects. We developed a design space that shows how the new size and depth possibilities create new, or interrelate with existing, design factors. New design opportunities arise and suggest a redesign of existing functionality but also the integration of new content. We researched the information content that could be displayed on a windshield display and asked drivers what content they need and personally desire. We thereby obtained an extensive list of use cases and applications. We approached the question of where such content should be displayed, given the large 3D space. To enable the design of safe interfaces, we first examined the driver’s visual perception across the windshield and identified locations that promote information recognition, particularly in the new peripheral area. Simultaneously, we examined the different ways of placing and stabilizing the content. We compared the traditional screen-fixed with world-fixed (augmented reality) and head-stabilized placement methods in terms of user satisfaction, understandability and safety. The gained knowledge about the locations that support information uptake and about the best ways of placing content was merged into a layout concept that subdivides the driver’s view into several information areas. We also incorporated the drivers’ preferences into this design process and compared their personalized layouts with our vision-based layout concept. We assessed the safety of both layout versions and present a revised concept. We close this thesis by reflecting on other trends that may interrelate with the windshield display, namely autonomous driving and augmented reality consumer devices. We look at recent advancements in realizing windshield displays and endeavor a prediction of future developments in this area

A Survey of Driving Research Simulators Around the World.

The literature review is part of the EPSRC funded project "Driver performance in the EPSRC driving simulator: a validation study". The aim of the project is to validate this simulator, located at the Department of Psychology, University of Leeds, and thereby to indicate the strengths and weaknesses of the existing configuration. It will provide guidance on how the simulator can be modified and overcome any deficiencies that are detected and also provide "benchmarks" against which other simulators can be compared. The literature review will describe the technical characteristics of the most well-known driving simulators around the world, their special features and their application areas until today. The simulators will be described and compared according to their cost (low, medium and high) and also contact addresses and photographs of the simulators will be provided by the end of the paper. In the process of gathering this information, it became apparent that there are mainly two types of papers published - either in journals or in proceedings from conferences: those describing only the technical characteristics of a specific simulator and those referring only to the applications of a specific simulator. For the first type of papers, the level of detail, format and content varies significantly where for the second one it has been proven extremely difficult to find any information about the technical characteristics of the simulator where the study had been carried out. A number of details provided in this paper are part of personal communication, or personal visits to those particular driving simulator centres or from the World Wide Web. It should also be noted here that most of the researchers contacted here offered very detail technical characteristics and application areas of their driving simulators and the author is grateful to them