Cruiser and PhoTable: Exploring Tabletop User Interface Software for Digital Photograph Sharing and Story Capture

Digital photography has not only changed the nature of photography and the photographic process, but also the manner in which we share photographs and tell stories about them. Some traditional methods, such as the family photo album or passing around piles of recently developed snapshots, are lost to us without requiring the digital photos to be printed. The current, purely digital, methods of sharing do not provide the same experience as printed photographs, and they do not provide effective face-to-face social interaction around photographs, as experienced during storytelling. Research has found that people are often dissatisfied with sharing photographs in digital form. The recent emergence of the tabletop interface as a viable multi-user direct-touch interactive large horizontal display has provided the hardware that has the potential to improve our collocated activities such as digital photograph sharing. However, while some software to communicate with various tabletop hardware technologies exists, software aspects of tabletop user interfaces are still at an early stage and require careful consideration in order to provide an effective, multi-user immersive interface that arbitrates the social interaction between users, without the necessary computer-human interaction interfering with the social dialogue. This thesis presents PhoTable, a social interface allowing people to effectively share, and tell stories about, recently taken, unsorted digital photographs around an interactive tabletop. In addition, the computer-arbitrated digital interaction allows PhoTable to capture the stories told, and associate them as audio metadata to the appropriate photographs. By leveraging the tabletop interface and providing a highly usable and natural interaction we can enable users to become immersed in their social interaction, telling stories about their photographs, and allow the computer interaction to occur as a side-effect of the social interaction. Correlating the computer interaction with the corresponding audio allows PhoTable to annotate an automatically created digital photo album with audible stories, which may then be archived. These stories remain useful for future sharing -- both collocated sharing and remote (e.g. via the Internet) -- and also provide a personal memento both of the event depicted in the photograph (e.g. as a reminder) and of the enjoyable photo sharing experience at the tabletop. To provide the necessary software to realise an interface such as PhoTable, this thesis explored the development of Cruiser: an efficient, extensible and reusable software framework for developing tabletop applications. Cruiser contributes a set of programming libraries and the necessary application framework to facilitate the rapid and highly flexible development of new tabletop applications. It uses a plugin architecture that encourages code reuse, stability and easy experimentation, and leverages the dedicated computer graphics hardware and multi-core processors of modern consumer-level systems to provide a responsive and immersive interactive tabletop user interface that is agnostic to the tabletop hardware and operating platform, using efficient, native cross-platform code. Cruiser's flexibility has allowed a variety of novel interactive tabletop applications to be explored by other researchers using the framework, in addition to PhoTable. To evaluate Cruiser and PhoTable, this thesis follows recommended practices for systems evaluation. The design rationale is framed within the above scenario and vision which we explore further, and the resulting design is critically analysed based on user studies, heuristic evaluation and a reflection on how it evolved over time. The effectiveness of Cruiser was evaluated in terms of its ability to realise PhoTable, use of it by others to explore many new tabletop applications, and an analysis of performance and resource usage. Usability, learnability and effectiveness of PhoTable was assessed on three levels: careful usability evaluations of elements of the interface; informal observations of usability when Cruiser was available to the public in several exhibitions and demonstrations; and a final evaluation of PhoTable in use for storytelling, where this had the side effect of creating a digital photo album, consisting of the photographs users interacted with on the table and associated audio annotations which PhoTable automatically extracted from the interaction. We conclude that our approach to design has resulted in an effective framework for creating new tabletop interfaces. The parallel goal of exploring the potential for tabletop interaction as a new way to share digital photographs was realised in PhoTable. It is able to support the envisaged goal of an effective interface for telling stories about one's photos. As a serendipitous side-effect, PhoTable was effective in the automatic capture of the stories about individual photographs for future reminiscence and sharing. This work provides foundations for future work in creating new ways to interact at a tabletop and to the ways to capture personal stories around digital photographs for sharing and long-term preservation

Cruiser and PhoTable: Exploring Tabletop User Interface Software for Digital Photograph Sharing and Story Capture

Digital photography has not only changed the nature of photography and the photographic process, but also the manner in which we share photographs and tell stories about them. Some traditional methods, such as the family photo album or passing around piles of recently developed snapshots, are lost to us without requiring the digital photos to be printed. The current, purely digital, methods of sharing do not provide the same experience as printed photographs, and they do not provide effective face-to-face social interaction around photographs, as experienced during storytelling. Research has found that people are often dissatisfied with sharing photographs in digital form. The recent emergence of the tabletop interface as a viable multi-user direct-touch interactive large horizontal display has provided the hardware that has the potential to improve our collocated activities such as digital photograph sharing. However, while some software to communicate with various tabletop hardware technologies exists, software aspects of tabletop user interfaces are still at an early stage and require careful consideration in order to provide an effective, multi-user immersive interface that arbitrates the social interaction between users, without the necessary computer-human interaction interfering with the social dialogue. This thesis presents PhoTable, a social interface allowing people to effectively share, and tell stories about, recently taken, unsorted digital photographs around an interactive tabletop. In addition, the computer-arbitrated digital interaction allows PhoTable to capture the stories told, and associate them as audio metadata to the appropriate photographs. By leveraging the tabletop interface and providing a highly usable and natural interaction we can enable users to become immersed in their social interaction, telling stories about their photographs, and allow the computer interaction to occur as a side-effect of the social interaction. Correlating the computer interaction with the corresponding audio allows PhoTable to annotate an automatically created digital photo album with audible stories, which may then be archived. These stories remain useful for future sharing -- both collocated sharing and remote (e.g. via the Internet) -- and also provide a personal memento both of the event depicted in the photograph (e.g. as a reminder) and of the enjoyable photo sharing experience at the tabletop. To provide the necessary software to realise an interface such as PhoTable, this thesis explored the development of Cruiser: an efficient, extensible and reusable software framework for developing tabletop applications. Cruiser contributes a set of programming libraries and the necessary application framework to facilitate the rapid and highly flexible development of new tabletop applications. It uses a plugin architecture that encourages code reuse, stability and easy experimentation, and leverages the dedicated computer graphics hardware and multi-core processors of modern consumer-level systems to provide a responsive and immersive interactive tabletop user interface that is agnostic to the tabletop hardware and operating platform, using efficient, native cross-platform code. Cruiser's flexibility has allowed a variety of novel interactive tabletop applications to be explored by other researchers using the framework, in addition to PhoTable. To evaluate Cruiser and PhoTable, this thesis follows recommended practices for systems evaluation. The design rationale is framed within the above scenario and vision which we explore further, and the resulting design is critically analysed based on user studies, heuristic evaluation and a reflection on how it evolved over time. The effectiveness of Cruiser was evaluated in terms of its ability to realise PhoTable, use of it by others to explore many new tabletop applications, and an analysis of performance and resource usage. Usability, learnability and effectiveness of PhoTable was assessed on three levels: careful usability evaluations of elements of the interface; informal observations of usability when Cruiser was available to the public in several exhibitions and demonstrations; and a final evaluation of PhoTable in use for storytelling, where this had the side effect of creating a digital photo album, consisting of the photographs users interacted with on the table and associated audio annotations which PhoTable automatically extracted from the interaction. We conclude that our approach to design has resulted in an effective framework for creating new tabletop interfaces. The parallel goal of exploring the potential for tabletop interaction as a new way to share digital photographs was realised in PhoTable. It is able to support the envisaged goal of an effective interface for telling stories about one's photos. As a serendipitous side-effect, PhoTable was effective in the automatic capture of the stories about individual photographs for future reminiscence and sharing. This work provides foundations for future work in creating new ways to interact at a tabletop and to the ways to capture personal stories around digital photographs for sharing and long-term preservation

Co-present photo sharing on mobile devices

This dissertation researches current approaches to photo sharing. We have found that most current methods of photo sharing are not as compelling as traditional photo sharing - with the increasing in popularity of digital photography, consumers do not print photos as often as before and thus typically require a group display (such as a PC) to view their photographs collectively. This dissertation describes a mobile application that attempts to support traditional photo sharing activities by allowing users to share photos with other co-present users by synchronizing the display on multiple mobile devices. Various floor control policies (software locks that determine when someone can control the displays) were implemented. The behaviour of groups of users was studied to determine how people would use this application for sharing photos and how various floor control policies affect this behaviour

Intuitive learnability of touch gestures for technology-naïve older adults

Touch-based interactions, if intuitive and natural, should be highly learnable. However, the learnability of touch gestures as a computer interaction modality cannot be taken for granted and should be evaluated empirically. This is especially true when technology-naïve older adults are concerned, given the psychological and physical constraints associated with this age range. To investigate this issue, we conducted a study with 17 technology-naïve older adults, whose experience with technology was mostly limited to making calls with mobile phones. Specifically, the participants were presented with three simple digital games on an interactive tabletop surface and asked to play the games on their own with minimal instruction or help. The first two games required the use of a drag gesture whereas the third game required the use of a rotate gesture. The main research question was whether the older adults could learn the gestures effectively and efficiently. A set of variables such as task duration and gesture accuracy were measured. Results showed that the learnability of a drag gesture was relatively high and that the participants could transfer this skill across the games. In contrast, the learnability of a rotate gesture was low and most of the participants failed to demonstrate any improvement over the tasks of the game. These findings partially corroborate those of earlier work. Implications for future work are drawn, especially exploring the potential of social interactions between older adults for enhancing the learning effects

The effect of dyadic interactions on learning rotate gesture for technology-naïve older adults

Older adults having limited experience with modern computing technology may find it difficult to learn touch gestures, especially the more complex rotate gesture. Social interactions, as implied by social constructivism, are assumed to be powerful in enabling older adults to acquire the skill of touch gestures. The social effect can be reinforced with the motivational effect of digital games. To verify the assumption, we conducted empirical studies with 59 older adults, who were divided into two groups: 17 Singles and 21 Dyads. They were asked to play a set of digital games on a multi-touch tabletop. Results show that on average Dyads have spent significantly longer time in the games and have performed a significantly higher number of correct rotate gestures than Singles. Future work focuses on analyzing the emotional aspect of social interactions and identifying further applications of social gaming to other ageing issue

Intuitive learnability of touch gestures for technology-naïve older adults

Touch-based interactions, if intuitive and natural, should be highly learnable. However, the learnability of touch gestures as a computer interaction modality cannot be taken for granted and should be evaluated empirically. This is especially true when technology-naïve older adults are concerned, given the psychological and physical constraints associated with this age range. To investigate this issue, we conducted a study with 17 technology-naïve older adults, whose experience with technology was mostly limited to making calls with mobile phones. Specifically, the participants were presented with three simple digital games on an interactive tabletop surface and asked to play the games on their own with minimal instruction or help. The first two games required the use of a drag gesture whereas the third game required the use of a rotate gesture. The main research question was whether the older adults could learn the gestures effectively and efficiently. A set of variables such as task duration and gesture accuracy were measured. Results showed that the learnability of a drag gesture was relatively high and that the participants could transfer this skill across the games. In contrast, the learnability of a rotate gesture was low and most of the participants failed to demonstrate any improvement over the tasks of the game. These findings partially corroborate those of earlier work. Implications for future work are drawn, especially exploring the potential of social interactions between older adults for enhancing the learning effects

Information technology for active ageing: A review of theory and practice

Active Ageing aims to foster a physically, mentally and socially active lifestyle as a person ages. It is a complex, multi-faceted problem that involves a variety of different actors, such as policy makers, doctors, care givers, family members, friends and, of course, older adults. This review aims to understand the role of a new actor, which increasingly plays the role of enabler and facilitator, i.e., that of the technology provider. The review specifically focuses on Information Technology (IT), with a particular emphasis on software applications, and on how IT can prevent decline, compensate for lost capabilities, aid care, and enhance existing capabilities. The analysis confirms the crucial role of IT in Active Ageing, shows that Active Ageing requires a multidisciplinary approach, and identifies the need for better integration of hardware, software, the environment and the involved actors