In this workshop we discuss the application of using mid-air haptics to provide directions for navigation to users in large indoor spaces. We propose a feed-forward approach from objects and locations that enable a physical way of thinking, communication and general accessibility

Christopher Barlow, CB

Jaz Marshall-Porter, J M-P

Tychonas Michailidis, TM

English

Solent Electronic Archive

3D mid-air audio-haptic navigation
for digital signage
Tychonas Michailidis
tychonas.michailidis@solent.ac.uk
Solent University
Southampton, United Kingdom
Christopher Barlow
christopher.barlow@solent.ac.uk
Solent University
Southampton, United Kingdom
Jaz Marshall-Porter
2marsj63@solent.ac.uk
Solent University
Southampton, United Kingdom
ABSTRACT
In this workshopwe discuss the application of usingmid-air haptics to provide directions for navigation
to users in large indoor spaces. We propose a feed-forward approach from objects and locations that
enable a physical way of thinking, communication and general accessibility.
CCS CONCEPTS
•Human-centered computing→Haptic devices;Accessibility technologies; Sound-based input
/ output .
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee
provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the
full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored.
Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior
specific permission and/or a fee. Request permissions from permissions@acm.org.
CHI ’19, May 04–09, 2019, Glasgow, UK
© 2019 Copyright held by the owner/author(s). Publication rights licensed to ACM.
ACM ISBN -. . . $-
https://doi.org/-
3D mid-air audio-haptic navigation for digital signage CHI ’19, May 04–09, 2019, Glasgow, UK
KEYWORDS
Haptic feedback, accessibility, haptic map, binaural, audio-haptic
ACM Reference Format:
Tychonas Michailidis, Christopher Barlow, and Jaz Marshall-Porter. 2019. 3D mid-air audio-haptic navigation
for digital signage. In CHI ’19: ACM CHI Conference on Human Factors in Computing Systems, June 03–05, 2019,
Glasgow, UK. ACM, New York, NY, USA, 3 pages. https://doi.org/-
INTRODUCTION
Digital signage (DS) is a promising growing market across multiple industries looking to enhance
customer satisfaction. Customer experience is challenged and changed through such platforms with
the level of user engagement and data collection to varied depending on the sector [1]. How DS is
utilized depends on the technology, content, location and target audience. The information provided
to the user is mainly visual with aural feedback often on ‘mute’, particularly in high traffic area
that is harder for users to hear and engage. We believe that a feed-forward haptic approach [3]
from virtual objects and locations will enable visual and hearing impaired user to explore further the
potentials of DS otherwise limited or restricted. In this workshop, we propose a multi-modal interface
of audio-haptic integration for providing location-based information for people who may face barriers
in engagement and interaction due to disability.
Figure 1: Virtual object moving in circular
motion
Figure 2: Virtual object moving in vertical
plane
WORK IN PROGRESS
Our work is based on earlier research by [2, 4] and looks at how on-screen objects and points can
provide directions for their physical location and state in a 3D environment. For example, when asking
information about a particular shop in a shopping mall, mid-air haptics can provide information about
the current state such as, closed or open, which floor or if is busy at the moment as well as directions,
where to turn or where is the next available DS. Similar, in hospitals, DS can provide information and
direction about departments, nearest food point or pharmacy.
We believe the perception of haptics can be enhanced through binaural audio. However, due to the
limitation of using headphones we are currently exploring how ultrasonic directional speakers can be
incorporated. We developed a prototype system where objects on screen provide information about
their virtual location through mid-air haptics on the palm using the Ultrahaptics STRATOS device. A
sound object (sphere for example) moves in a circular motion (Fig. 1) with the sensation of circular
motion also presented on the hand. The feeling of speed is proportional between the virtual object
and hand. We have examined how users experience movement through mid-air haptics such as left
and right (Fig. 2), front and back, diagonal and the ability to identity the randomly triggered virtual
3D mid-air audio-haptic navigation for digital signage CHI ’19, May 04–09, 2019, Glasgow, UK
locations. We also experiment how directions between two static point on a predetermined may be
presented in mid-air haptics.
We are facing challenges when we start looking how to represent more complex information about
the state of objects or locations and in particular how to express meaningful information to users
without the need of learning or adapting period.
REFERENCES
[1] Christine Bauer, Marion Garaus, Christine Strauss, and Udo Wagner. 2018. Research Directions for Digital Signage Systems
in Retail. Procedia Computer Science 141 (2018), 503–506. https://doi.org/10.1016/j.procs.2018.10.135
[2] J. Bullock, T Michailidis, and M. Poyade. 2016. Towards a Live Interface for Direct Manipulation of Spatial Audio. In
Proceedings of the International Conference on Live Interfaces. REFRAME Books, Sussex, 134–141.
[3] Leithinger Daniel and Zheng Clement. 2018. Haptic Aura: Augmenting Physical Objects Through Mid-Air Haptics. In
Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA ’18). Montreal QC, Canada.
[4] Cagatay Goncu and Armin Kroll. 2018. Accessible Haptic Objects for People with Vision Impairment. In Extended Abstracts
of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA ’18). Montreal QC, Canada.


3D mid-air audio-haptic navigation for digital signage

http://ssudl.solent.ac.uk/4036/1/3D_mid_air_audio_haptic_interaction_for_digital_signage-Michailidis_Barlow_Marshall-Porter.pdf

3D mid-air audio-haptic navigation for digital signage

Abstract

Similar works

Full text

Available Versions

Solent Electronic Archive