Exploring the Front Touch Interface for Virtual Reality Headsets

In this paper, we propose a new interface for virtual reality headset: a touchpad in front of the headset. To demonstrate the feasibility of the front touch interface, we built a prototype device, explored VR UI design space expansion, and performed various user studies. We started with preliminary tests to see how intuitively and accurately people can interact with the front touchpad. Then, we further experimented various user interfaces such as a binary selection, a typical menu layout, and a keyboard. Two-Finger and Drag-n-Tap were also explored to find the appropriate selection technique. As a low-cost, light-weight, and in low power budget technology, a touch sensor can make an ideal interface for mobile headset. Also, front touch area can be large enough to allow wide range of interaction types such as multi-finger interactions. With this novel front touch interface, we paved a way to new virtual reality interaction methods

Kehollistuneet vuorovaikutuskoreografiat. Kinesteettinen lähestymistapa älykkäiden ympäristöjen suunnitteluun

Research investigates interaction design through application of the concept of choreography. Special attention is paid to assess what kind of influences technological designs have on the user’s body and movements. Choreographic approach to interaction design emphasizes the felt experience of movement as content to interaction design and offers methods for conducting multi-level choreographic analysis. The concept of kinesthesia, which refers to the felt sensation of movement, is regarded as the foundational concept for both understanding and realizing the choreographic analysis. Choreographic method is applied in studying a future vision of intelligent information and communication environments. Intelligent environment refers to development where objects in everyday environments become connected and form a communicating-actuating network that possess abilities to collect information on the environment and of its users, and enables processing of this information for serving the user’s needs. The research data consists of two visions on intelligent environments in video format, introduced by Microsoft. Visions are analyzed through choreographic analysis with intention to investigate interactions between the user, the intelligent environment and the computer system. Micro level choreography analysis focuses on how the user experiences choreographies as movement continuums. Also local level choreographies that address the broader interaction context will be analyzed. Task based analysis focuses on two functions, first, sending and fetching digital information and, second, real time re-modelling of data and visualizations. Phenomenological methodology that enabled embodiment of the choreographies through dancing was applied in the analysis. Dancing aimed at internalizing the choreographies and enabled the analysis of felt sensation of movement. Key finding of the study is that choreographic analysis and hermeneutics of the body work well to be utilized in tandem in conducting a case study research on intelligent ICT environments. Dancing is considered as choreographic practice that provides understanding on the unfolding of interactions in space, time and movement. Furthermore, dancing integrates the designer’s explicit technological information to the design context and highlights the kinesthetic dimension of interaction. Presented methods provide relevant support for defining technological systems in intelligent ICT environments that are grounded in the embodied experience of interaction. I suggest that ‘dancing as choreographic practice’ is to be applied in user-centered design of intelligent information and communication environments.Tutkimus tarkastelee vuorovaikutussuunnittelua koreografian käsitteen kautta. Koreografinen lähestymistapa tarkastelee teknologian kokonaisvaltaista ohjausvaikutusta käyttäjän liikkeeseen teknologian käyttötilanteessa. Koreografinen suunnitteluote korostaa liikkeen kokemuksen huomioimisen tärkeyttä vuorovaikutussuunnittelussa ja tarjoaa menetelmiä monitasoisen vuorovaikutusanalyysin toteuttamiseen. Kinestesian käsite, jolla tarkoitetaan liikkeen kokemista kehossa, nousee yhdeksi koreografisen lähestymistavan keskeisistä käsitteistä. Sovellan koreografista menetelmää tulevaisuuden älykästä informaatio- ja kommunikaatioympäristöä kuvaavan vision tutkimiseen. Älykkäällä ympäristöllä viittaan kehityskulkuun, jossa jokapäiväisissä ympäristöissämme läsnä oleva teknologia verkottuu, kykenee keräämään ja jakamaan tietoa ympäristöstä ja käyttäjistä sekä mahdollistaa tiedon jalostuksen käyttäjän tarpeita palvelevalla tavalla. Aineistona on käytetty Microsoftin teknologiavisioita, joissa esitetyt kuvaukset älykkäistä ympäristöistä sekä esimerkit käyttäjän ja teknologian välisistä liikkeellisistä vuorovaikutuksista nousevat analyysin kohteeksi. Analyysissa keskitytään ensinnäkin käyttäjän toteuttamien mikroliikkeiden jatkumon kokemuksen analyysiin. Toiseksi analysoidaan yksilön kokemusta paikallisen tason koreografioissa. Tällä analyysitasolla huomiota kiinnitetään teknologista vuorovaikutusta laajemman vuorovaikutustapahtuman kontekstiin jolloin mm. sosiaaliset tapahtumat ja tilan vaikutus vuorovaikutukseen tulevat huomioiduksi. Analyysi toteutetaan tehtäväperusteisena ja analyysi käsittää kaksi toimintoa: tiedostojen jakaminen ja vastaanottaminen sekä datan ja visualisointien muokkaus. Toteutin tutkimuksen nojaten fenomenologiseen metodologiaan, joka mahdollisti koreografioiden henkilökohtaisen omaksumisen tanssin eli tutkimuksen kohteena olevien vuorovaikutustapojen kehollisen harjoittamisen kautta. Teknologiavisioissa esitetyn liikemateriaalin perusteella jäsentyi koreografia, jonka tanssiminen mahdollisti liiketiedon sisäistämisen ja vuorovaikutusten kehollisesti koettujen ulottuvuuksien arvioinnin. Tutkimus osoitti koreografisen analyysin ja osittain tanssimalla toteutetun ruumiin hermeneuttisen lähestymistavan soveltuvan hyvin sovellettavaksi yhdessä älykästä ympäristöä käsittelevässä tapaustutkimuksessa. Tutkimuksen johtopäätöksenä koreografisen menetelmän ja vuorovaikutusten kehollisen harjoittamisen todetaan auttavan suunnittelijaa tilassa, ajassa ja liikkeessä tapahtuvien vuorovaikutusten jäsentämisessä, ja arvioimaan miten teknologisen järjestelmän suunnitteluratkaisut vaikuttavat käyttäjän kehoon ja liikkeeseen vuorovaikutustapahtumassa. Esitän ’tanssimista koreografisena käytäntönä’ sovellettavaksi älykkäiden ympäristöjen käyttäjäkeskeisen suunnittelun menetelmänä

Context-awareness for mobile sensing: a survey and future directions

The evolution of smartphones together with increasing computational power have empowered developers to create innovative context-aware applications for recognizing user related social and cognitive activities in any situation and at any location. The existence and awareness of the context provides the capability of being conscious of physical environments or situations around mobile device users. This allows network services to respond proactively and intelligently based on such awareness. The key idea behind context-aware applications is to encourage users to collect, analyze and share local sensory knowledge in the purpose for a large scale community use by creating a smart network. The desired network is capable of making autonomous logical decisions to actuate environmental objects, and also assist individuals. However, many open challenges remain, which are mostly arisen due to the middleware services provided in mobile devices have limited resources in terms of power, memory and bandwidth. Thus, it becomes critically important to study how the drawbacks can be elaborated and resolved, and at the same time better understand the opportunities for the research community to contribute to the context-awareness. To this end, this paper surveys the literature over the period of 1991-2014 from the emerging concepts to applications of context-awareness in mobile platforms by providing up-to-date research and future research directions. Moreover, it points out the challenges faced in this regard and enlighten them by proposing possible solutions

Exploring user-defined gestures for alternate interaction space for smartphones and smartwatches

2016 Spring.Includes bibliographical references.In smartphones and smartwatches, the input space is limited due to their small form factor. Although many studies have highlighted the possibility of expanding the interaction space for these devices, limited work has been conducted on exploring end-user preferences for gestures in the proposed interaction spaces. In this dissertation, I present the results of two elicitation studies that explore end-user preferences for creating gestures in the proposed alternate interaction spaces for smartphones and smartwatches. Using the data collected from the two elicitation studies, I present gestures preferred by end-users for common tasks that can be performed using smartphones and smartwatches. I also present the end-user mental models for interaction in proposed interaction spaces for these devices, and highlight common user motivations and preferences for suggested gestures. Based on the findings, I present design implications for incorporating the proposed alternate interaction spaces for smartphones and smartwatches

Integrating passive ubiquitous surfaces into human-computer interaction

Mobile technologies enable people to interact with computers ubiquitously. This dissertation investigates how ordinary, ubiquitous surfaces can be integrated into human-computer interaction to extend the interaction space beyond the edge of the display. It turns out that acoustic and tactile features generated during an interaction can be combined to identify input events, the user, and the surface. In addition, it is shown that a heterogeneous distribution of different surfaces is particularly suitable for realizing versatile interaction modalities. However, privacy concerns must be considered when selecting sensors, and context can be crucial in determining whether and what interaction to perform.Mobile Technologien ermöglichen den Menschen eine allgegenwärtige Interaktion mit Computern. Diese Dissertation untersucht, wie gewöhnliche, allgegenwärtige Oberflächen in die Mensch-Computer-Interaktion integriert werden können, um den Interaktionsraum über den Rand des Displays hinaus zu erweitern. Es stellt sich heraus, dass akustische und taktile Merkmale, die während einer Interaktion erzeugt werden, kombiniert werden können, um Eingabeereignisse, den Benutzer und die Oberfläche zu identifizieren. Darüber hinaus wird gezeigt, dass eine heterogene Verteilung verschiedener Oberflächen besonders geeignet ist, um vielfältige Interaktionsmodalitäten zu realisieren. Bei der Auswahl der Sensoren müssen jedoch Datenschutzaspekte berücksichtigt werden, und der Kontext kann entscheidend dafür sein, ob und welche Interaktion durchgeführt werden soll

Nomadic input on mobile devices: the influence of touch input technique and walking speed on performance and offset modeling

In everyday life people use their mobile phones on-the-go with different walking speeds and with different touch input techniques. Unfortunately, much of the published research in mobile interaction does not quantify the influence of these variables. In this paper, we analyze the influence of walking speed, gait pattern and input techniques on commonly used performance parameters like error rate, accuracy and tapping speed, and we compare the results to the static condition. We examine the influence of these factors on the machine learned offset model used to correct user input and we make design recommendations. The results show that all performance parameters degraded when the subject started to move, for all input techniques. Index finger pointing techniques demonstrated overall better performance compared to thumb-pointing techniques. The influence of gait phase on tap event likelihood and accuracy was demonstrated for all input techniques and all walking speeds. Finally, it was shown that the offset model built on static data did not perform as well as models inferred from dynamic data, which indicates the speed-specific nature of the models. Also, models identified using specific input techniques did not perform well when tested in other conditions, demonstrating the limited validity of offset models to a particular input technique. The model was therefore calibrated using data recorded with the appropriate input technique, at 75% of preferred walking speed, which is the speed to which users spontaneously slow down when they use a mobile device and which presents a tradeoff between accuracy and usability. This led to an increase in accuracy compared to models built on static data. The error rate was reduced between 0.05% and 5.3% for landscape-based methods and between 5.3% and 11.9% for portrait-based methods