EarRumble: Discreet Hands- and Eyes-Free Input by Voluntary Tensor Tympani Muscle Contraction

We explore how discreet input can be provided using the tensor tympani -a small muscle in the middle ear that some people can voluntarily contract to induce a dull rumbling sound.We investigate the prevalence and ability to control the muscle through an online questionnaire (N=192) in which 43.2% of respondents reported the ability to ear rumble. Data collected from participants (N=16) shows how in-ear barometry can be used to detect voluntary tensor tympani contraction in the sealed ear canal. This data was used to train a classifer based on three simple ear rumble gestures which achieved 95% accuracy. Finally, we evaluate the use of ear rumbling for interaction, grounded in three manual, dual-task application scenarios (N=8). This highlights the applicability of EarRumble as a low-efort and discreet eyes-and hands-free interaction technique that users found magical and almost telepathic.</p

EarRumble: Discreet Hands- and Eyes-Free Input by Voluntary Tensor Tympani Muscle Contraction

We explore how discreet input can be provided using the tensor tympani -a small muscle in the middle ear that some people can voluntarily contract to induce a dull rumbling sound.We investigate the prevalence and ability to control the muscle through an online questionnaire (N=192) in which 43.2% of respondents reported the ability to ear rumble. Data collected from participants (N=16) shows how in-ear barometry can be used to detect voluntary tensor tympani contraction in the sealed ear canal. This data was used to train a classifer based on three simple ear rumble gestures which achieved 95% accuracy. Finally, we evaluate the use of ear rumbling for interaction, grounded in three manual, dual-task application scenarios (N=8). This highlights the applicability of EarRumble as a low-efort and discreet eyes-and hands-free interaction technique that users found magical and almost telepathic.</p

Oceanus.

v. 26, no. 4 (1983

Security and privacy problems in voice assistant applications: A survey

Voice assistant applications have become omniscient nowadays. Two models that provide the two most important functions for real-life applications (i.e., Google Home, Amazon Alexa, Siri, etc.) are Automatic Speech Recognition (ASR) models and Speaker Identification (SI) models. According to recent studies, security and privacy threats have also emerged with the rapid development of the Internet of Things (IoT). The security issues researched include attack techniques toward machine learning models and other hardware components widely used in voice assistant applications. The privacy issues include technical-wise information stealing and policy-wise privacy breaches. The voice assistant application takes a steadily growing market share every year, but their privacy and security issues never stopped causing huge economic losses and endangering users' personal sensitive information. Thus, it is important to have a comprehensive survey to outline the categorization of the current research regarding the security and privacy problems of voice assistant applications. This paper concludes and assesses five kinds of security attacks and three types of privacy threats in the papers published in the top-tier conferences of cyber security and voice domain

Workshop on Smart Sensors - Instrumentation and Measurement: Program

On 18-19 February, the School of Engineering successfully ran a two-day workshop on Smart Sensors - Instrumentation and Measurement. Associate Professor Rainer Künnemeyer organised the event on behalf of the IEEE Instrumentation and Measurement Society, New Zealand Chapter. Over 60 delegates attended and appreciated the 34 presentations which covered a wide range of topics related to sensors, sensor networks and instrumentation. There was substantial interest and support from local industry and crown research institutes

Integrating passive ubiquitous surfaces into human-computer interaction

Mobile technologies enable people to interact with computers ubiquitously. This dissertation investigates how ordinary, ubiquitous surfaces can be integrated into human-computer interaction to extend the interaction space beyond the edge of the display. It turns out that acoustic and tactile features generated during an interaction can be combined to identify input events, the user, and the surface. In addition, it is shown that a heterogeneous distribution of different surfaces is particularly suitable for realizing versatile interaction modalities. However, privacy concerns must be considered when selecting sensors, and context can be crucial in determining whether and what interaction to perform.Mobile Technologien ermöglichen den Menschen eine allgegenwärtige Interaktion mit Computern. Diese Dissertation untersucht, wie gewöhnliche, allgegenwärtige Oberflächen in die Mensch-Computer-Interaktion integriert werden können, um den Interaktionsraum über den Rand des Displays hinaus zu erweitern. Es stellt sich heraus, dass akustische und taktile Merkmale, die während einer Interaktion erzeugt werden, kombiniert werden können, um Eingabeereignisse, den Benutzer und die Oberfläche zu identifizieren. Darüber hinaus wird gezeigt, dass eine heterogene Verteilung verschiedener Oberflächen besonders geeignet ist, um vielfältige Interaktionsmodalitäten zu realisieren. Bei der Auswahl der Sensoren müssen jedoch Datenschutzaspekte berücksichtigt werden, und der Kontext kann entscheidend dafür sein, ob und welche Interaktion durchgeführt werden soll

Data Driven Approach to Thermal Comfort Model Design

Apart from the dominant environmental factors such as relative humidity, radiant, and ambient temperatures, studies have confirmed that thermal comfort significantly depends on internal personal parameters such as metabolic rate, age, and health status. This study reviews the sensitivity of the Predicted Mean Vote (PMV) thermal comfort model relative to its environmental and personal parameters of a group of people in a space. PMV model equations adapted in ASHRAE Standard 55–Thermal Environmental Conditions for Human Occupancy, are used in this investigation to conduct a parametric study by generating and analyzing multi-dimensional comfort zone plots. It has been found that personal parameters such as metabolic rate and clothing have the highest impact. Current and newly emerging advancements in state of the art wearable technology have made it possible to continuously acquired biometric information. This work proposes to access and exploit this data to build a new innovative thermal comfort model. Relying on various supervised machine-learning methods, a thermal comfort model has been produced and compared to a general model to show its superior performance. Finally, the study represents an architecture to employ new thermal comfort model in inexpensive, responsive and extensible smart home service. Advisor: Fadi Alsalee

Know Thyself: Improving Interoceptive Ability Through Ambient Biofeedback in the Workplace

Interoception, the perception of the body’s internal state, is intimately connected to self-regulation and wellbeing. Grounded in the affective science literature, we design an ambient biofeedback system called Soni-Phy and a lab study to investigate whether, when and how an unobtrusive biofeedback system can be used to improve interoceptive sensibility and accuracy by amplifying a users’ internal state. This research has practical significance for the design and improvement of assistive technologies for the workplace