Extending mobile touchscreen interaction

Touchscreens have become a de facto interface for mobile devices, and are penetrating further beyond their core application domain of smartphones. This work presents a design space for extending touchscreen interaction, to which new solutions may be mapped. Specific touchscreen enhancements in the domains of manual input, visual output and haptic feedback are explored and quantitative and experiental findings reported. Particular areas covered are unintentional interaction, screen locking, stereoscopic displays and picoprojection. In addition, the novel interaction approaches of finger identification and onscreen physical guides are also explored. The use of touchscreens in the domains of car dashboards and smart handbags are evaluated as domain specific use cases. This work draws together solutions from the broad area of mobile touchscreen interaction. Fruitful directions for future research are identified, and information is provided for future researchers addressing those topics.Kosketusnäytöistä on muodostunut mobiililaitteiden pääasiallinen käyttöliittymä, ja ne ovat levinneet alkuperäiseltä ydinsovellusalueeltaan, matkapuhelimista, myös muihin laitteisiin. Työssä tutkitaan uusia vuorovaikutuksen, visualisoinnin ja käyttöliittymäpalautteen keinoja, jotka laajentavat perinteistä kosketusnäytön avulla tapahtuvaa vuorovaikutusta. Näihin liittyen väitöskirjassa esitetään sekä kvantitatiivisia tuloksia että uutta kartoittavia löydöksiä. Erityisesti työ tarkastelee tahatonta kosketusnäytön käyttöä, kosketusnäytön lukitusta, stereoskooppisia kosketusnäyttöjä ja pikoprojektoreiden hyödyntämistä. Lisäksi kartoitetaan uusia vuorovaikutustapoja, jotka liittyvät sormien identifioimiseen vuorovaikutuksen yhteydessä, ja fyysisiin, liikettä ohjaaviin rakenteisiin kosketusnäytöllä. Kosketusnäytön käyttöä autossa sekä osana älykästä käsilaukkua tarkastellaan esimerkkeinä käyttökonteksteista. Väitöskirjassa esitetään vuorovaikutussuunnittelun viitekehys, joka laajentaa kosketusnäyttöjen kautta tapahtuvaa vuorovaikutusta mobiililaitteen kanssa, ja johon työssä esitellyt, uudet vuorovaikutustavat voidaan sijoittaa. Väitöskirja yhdistää kosketusnäyttöihin liittyviä käyttöliittymäsuunnittelun ratkaisuja laajalta alueelta. Työ esittelee potentiaalisia suuntaviivoja tulevaisuuden tutkimuksille ja tuo uutta tutkimustietoa, jota mobiililaitteiden vuorovaikutuksen tutkijat ja käyttöliittymäsuunnittelijat voivat hyödyntää

Extending mobile touchscreen interaction

Touchscreens have become a de facto interface for mobile devices, and are penetrating further beyond their core application domain of smartphones. This work presents a design space for extending touchscreen interaction, to which new solutions may be mapped. Specific touchscreen enhancements in the domains of manual input, visual output and haptic feedback are explored and quantitative and experiental findings reported. Particular areas covered are unintentional interaction, screen locking, stereoscopic displays and picoprojection. In addition, the novel interaction approaches of finger identification and onscreen physical guides are also explored. The use of touchscreens in the domains of car dashboards and smart handbags are evaluated as domain specific use cases. This work draws together solutions from the broad area of mobile touchscreen interaction. Fruitful directions for future research are identified, and information is provided for future researchers addressing those topics.Kosketusnäytöistä on muodostunut mobiililaitteiden pääasiallinen käyttöliittymä, ja ne ovat levinneet alkuperäiseltä ydinsovellusalueeltaan, matkapuhelimista, myös muihin laitteisiin. Työssä tutkitaan uusia vuorovaikutuksen, visualisoinnin ja käyttöliittymäpalautteen keinoja, jotka laajentavat perinteistä kosketusnäytön avulla tapahtuvaa vuorovaikutusta. Näihin liittyen väitöskirjassa esitetään sekä kvantitatiivisia tuloksia että uutta kartoittavia löydöksiä. Erityisesti työ tarkastelee tahatonta kosketusnäytön käyttöä, kosketusnäytön lukitusta, stereoskooppisia kosketusnäyttöjä ja pikoprojektoreiden hyödyntämistä. Lisäksi kartoitetaan uusia vuorovaikutustapoja, jotka liittyvät sormien identifioimiseen vuorovaikutuksen yhteydessä, ja fyysisiin, liikettä ohjaaviin rakenteisiin kosketusnäytöllä. Kosketusnäytön käyttöä autossa sekä osana älykästä käsilaukkua tarkastellaan esimerkkeinä käyttökonteksteista. Väitöskirjassa esitetään vuorovaikutussuunnittelun viitekehys, joka laajentaa kosketusnäyttöjen kautta tapahtuvaa vuorovaikutusta mobiililaitteen kanssa, ja johon työssä esitellyt, uudet vuorovaikutustavat voidaan sijoittaa. Väitöskirja yhdistää kosketusnäyttöihin liittyviä käyttöliittymäsuunnittelun ratkaisuja laajalta alueelta. Työ esittelee potentiaalisia suuntaviivoja tulevaisuuden tutkimuksille ja tuo uutta tutkimustietoa, jota mobiililaitteiden vuorovaikutuksen tutkijat ja käyttöliittymäsuunnittelijat voivat hyödyntää

Designing for behavioural change: reducing the social impacts of product use through design

This thesis investigates the feasibility of applying design-led approaches to influence user behaviour to reduce the negative social impacts of products during use. A review of the literature revealed a distinct lack of design-led research in this area. Three promising approaches from other disciplines, however, were found; ecofeedback, behaviour steering and intelligence. The majority of product examples identified did not use a singular approach, but combined two or more approaches. Most of the examples were concepts and focused on the end result. Few commented on the research and development processes undertaken to generate the final design. These limitations reinforced the need for case studies detailing these processes. To this end, two design studies were carried out; a preliminary study using a range of products and a further, more in-depth study on the use of mobile phones. The results of these studies led to the development of a framework of attributes for 'behaviour changing' devices. In response to these findings, two design resources were developed; a detailed design project to reduce the social impacts of mobile phone use in public and a short film on texting whilst on the move. Evaluation by design professionals provided analysis of the effectiveness of these resources and wider reflections on designer's perceived responsibilities for use and the ethics of designing for behavioural change. Collectively, the findings indicated that resources for designing behavioural change should; be explorative not prescriptive, focus on problem solving, be tailored to meet the needs of the intended recipient and ideally be applied in the early 'ideation' stages of the design process. Additionally, the findings indicated that designer's involvement in, and responsibility for, lifecycle impacts must be extended beyond point-of-purchase. Designers, however, are reportedly often unable to influence product development at a strategic level. Prior work, therefore, is needed to engage those at a senior level. Furthermore, the findings strongly indicate that 'behaviour changing' devices must be prototyped and subjected to rigorous consumer testing not only to establish their effectiveness but also to determine their acceptability

Sustainable Solutions for Wearable Technologies:Mapping the Product Development Life Cycle

Wearable technologies involve the integration of technology into clothing or accessories to bring new functionalities for people on the move. Many examples of wearables are emerging, from simple fitness tracking watches to electronics deeply embedded into garments for multi-touch sensing and control for personal music players. Without careful development, wearables can have a negative impact on the environment due to increased production of electronic components, increased e-waste from abandoned devices, and increased energy usage. We examine environmental sustainability issues through a review of recent research and cases across three broad areas including the fashion industry, information and communications technology (ICT), and wearable technologies. In the analysis, we examine stages in the product life cycle and identify the unique issues for each sector, including the extraction of materials, production process, distribution of products, use, and disposal of products that have reached the end of their life. The findings are gathered as implications for design so that researchers, educators, designers, developers, and product managers will gain an overview of the issues related to environmental sustainability. Related examples of products and prototypes are provided to enable informed choices during the design and development of wearables that are more environmentally sustainable

Smart Glasses Design-Exploring user perception of wearable computing

As technology is growing rapidly and integrating itself to all aspects of people’s life, designers and developers try to provide a more pleasant experience of technology to people. One of the technology trends which aims to make life easier is wearable computing. Wearables aim to assist people to be in control of their life by augmenting the real life with extra information constantly and ubiquitously. One of the growing trends of wearable computing is Head Mounted Displays (HMD), as the head is a great gateway to receive audio, visual and haptic information. Also due to the Google Glass project, wearables in form of glasses gained much more attention during last years. However, because of the early stages of the technology adaptation, there is still much to explore on social acceptancy, key use cases and design directions of glasses as a type of wearable computing. This thesis has two stages. In the first stage, the aim is to explore the different use cases of a wearable eye tracker concept in different context and study the user’s perception of such a device. To accomplish this objective a user study with (n=12) participants were conducted using the experience sampling methods (ESM) and employing a mock-up of a smart-glasses as a design probe. In the second stage the focus is to design different alternatives for a wearable eye tracker concept and evaluate the concepts by conducting focus groups (n=14) to understand the user perceptions toward different industrial design concepts of such a system

Designing for behavioural change : reducing the social impacts of product use through design

This thesis investigates the feasibility of applying design-led approaches to influence user behaviour to reduce the negative social impacts of products during use. A review of the literature revealed a distinct lack of design-led research in this area. Three promising approaches from other disciplines, however, were found; ecofeedback, behaviour steering and intelligence. The majority of product examples identified did not use a singular approach, but combined two or more approaches. Most of the examples were concepts and focused on the end result. Few commented on the research and development processes undertaken to generate the final design. These limitations reinforced the need for case studies detailing these processes. To this end, two design studies were carried out; a preliminary study using a range of products and a further, more in-depth study on the use of mobile phones. The results of these studies led to the development of a framework of attributes for 'behaviour changing' devices. In response to these findings, two design resources were developed; a detailed design project to reduce the social impacts of mobile phone use in public and a short film on texting whilst on the move. Evaluation by design professionals provided analysis of the effectiveness of these resources and wider reflections on designer's perceived responsibilities for use and the ethics of designing for behavioural change. Collectively, the findings indicated that resources for designing behavioural change should; be explorative not prescriptive, focus on problem solving, be tailored to meet the needs of the intended recipient and ideally be applied in the early 'ideation' stages of the design process. Additionally, the findings indicated that designer's involvement in, and responsibility for, lifecycle impacts must be extended beyond point-of-purchase. Designers, however, are reportedly often unable to influence product development at a strategic level. Prior work, therefore, is needed to engage those at a senior level. Furthermore, the findings strongly indicate that 'behaviour changing' devices must be prototyped and subjected to rigorous consumer testing not only to establish their effectiveness but also to determine their acceptability.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Investigating the design of Smart Objects in the domain of forgetfulness

PhDWhen we forget things, we feel anxious which can impact our day negatively. Some individuals believe they are forgetful, so emphatically, it disrupts their day. There has been little discussion about perceived forgetfulness in design and HCI, combined with few studied smart objects to aid with memory. However, embedded systems, radio frequency identification (RFID) and HCI research provides inspiration towards creating a solution. Challenges of creating a day-to-day smart object that can enhance a user’s lifestyle are explored and recommended design guidelines for creating a smart object in a specific domain are the focus of this thesis. Using an experience-centred approach, ‘Message Bag’ and ‘Tag Along’ are two purpose built object-based memory aids that have emerged as a result of investigating the design processes for smart objects. The work examines smart objects in the context of forgetting what items to pack in a bag. A solution presented is a device consisting of an RFID system involving (a) pre-tagging essential items; (b) scanning those tagged items and; (c) viewing a corresponding light illuminate, to communicate to the user. Although the conceptual model is simple, success depends on a combination of technical design, usability and aesthetics. These scanning interactions result in a person feeling more confident as suggested through autoethnography reporting, real-world, third person engagements - single user walkouts, conference demos, professional critiques, and residential weekends with potential users (focus group) studies conducted. My work involved extensive autobiographical research and design-led enquiries. Testing was undertaken with investigative prototypes, followed by field testing high-fidelity prototypes. This involved an in-the-wild comparative study involving six users over several months. Results show that people feel more confident and respondents claim no longer needing to continually check items are packed, thus ‘gaining time’, and feeling less forgetful. Although the application of RFID is not new to ubiquitous computing, this implementation, styling and system immediacy is novel. This thesis presents the development of ten prototypes as well as design guidelines. The research provides a solid base for further exploration, and includes discovery of the importance of a user’s style universe and extreme ease-of-use. I conclude with the presentation of early positive results including; (i) the unique form factor becomes a reminder itself and; (ii) usability coupled with the intuitive nature of the system is shown to be essential. We found that when you are creating a smart object, usability and an intuitive nature is even more important than in a standard system. When dealing within the domain of forgetfulness, this is paramount.This research was funded by the Engineering and Physical Sciences Research Council (EPSRC) through the Media and Arts Technology Doctoral Training Centre from the School of Electronic Engineering and Computer Science at Queen Mary University of London