Examining the role of smart TVs and VR HMDs in synchronous at-a-distance media consumption

This article examines synchronous at-a-distance media consumption from two perspectives: How it can be facilitated using existing consumer displays (through TVs combined with smartphones), and imminently available consumer displays (through virtual reality (VR) HMDs combined with RGBD sensing). First, we discuss results from an initial evaluation of a synchronous shared at-a-distance smart TV system, CastAway. Through week-long in-home deployments with five couples, we gain formative insights into the adoption and usage of at-a-distance media consumption and how couples communicated during said consumption. We then examine how the imminent availability and potential adoption of consumer VR HMDs could affect preferences toward how synchronous at-a-distance media consumption is conducted, in a laboratory study of 12 pairs, by enhancing media immersion and supporting embodied telepresence for communication. Finally, we discuss the implications these studies have for the near-future of consumer synchronous at-a-distance media consumption. When combined, these studies begin to explore a design space regarding the varying ways in which at-a-distance media consumption can be supported and experienced (through music, TV content, augmenting existing TV content for immersion, and immersive VR content), what factors might influence usage and adoption and the implications for supporting communication and telepresence during media consumption

Supporting collocated and at-a-distance experiences with TV and VR displays

Televisions (TVs) and VR Head-Mounted Displays (VR HMDs) are used in shared and social spaces in the home. This thesis posits that these displays do not sufficiently reflect the collocated, social contexts in which they reside, nor do they sufficiently support shared experiences at-a-distance. This thesis explores how the role of TVs and VR HMDs can go beyond presenting a single entertainment experience, instead supporting social and shared use in both collocated and at-a-distance contexts. For collocated TV, this thesis demonstrates that the TV can be augmented to facilitate multi-user interaction, support shared and independent activities and multi-user use through multi-view display technology, and provide awareness of the multi-screen activity of those in the room, allowing the TV to reflect the social context in which it resides. For at-a-distance TV, existing smart TVs are shown to be capable of supporting synchronous at-a-distance activity, broadening the scope of media consumption beyond the four walls of the home. For VR HMDs, collocated proximate persons can be seamlessly brought into mixed reality VR experiences based on engagement, improving VR HMD usability. Applied to at-a-distance interactions, these shared mixed reality VR experiences can enable more immersive social experiences that approximate viewing together as if in person, compared to at-a-distance TV. Through an examination of TVs and VR HMDs, this thesis demonstrates that consumer display technology can better support users to interact, and share experiences and activities, with those they are close to

Augmenting TV Viewing using Acoustically Transparent Auditory Headsets

This paper explores how acoustically transparent auditory headsets can improve TV viewing by intermixing headset and TV audio, facilitating personal, private auditory enhancements and augmentations of TV content whilst minimizing occlusion of the sounds of reality. We evaluate the impact of synchronously mirroring select audio channels from the 5.1 mix (dialogue, environmental sounds, and the full mix), and selectively augmenting TV viewing with additional speech (e.g. Audio Description, Directors Commentary, and Alternate Language). For TV content, auditory headsets enable better spatialization and more immersive, enjoyable viewing; the intermixing of TV and headset audio creates unique listening experiences; and private augmentations offer new ways to (re)watch content with others. Finally, we reflect on how these headsets might facilitate more immersive augmented TV viewing experiences within reach of consumers

Many-screen viewing: collaborative consumption of television media across multiple devices

The landscape of television is changing. Modern Internet enabled sets are now capable computing devices offering new forms of connectivity and interaction to viewers. One development enabled by this transition is the distribution of auxiliary content to a portable computing device, such as a mobile phone or tablet, working in concert with the television. These configurations are enabled by second screen applications that provide relevant content in synchronisation with the programme on a nearby television set. This thesis extends the notion of second screen to arrangements that incorporate multiple mobile devices working with the television, utilised by collocated groups of participants. Herein these arrangements are referred to as ‘many-screen’ television. Two many-screen applications were developed for the augmentation of sports programming in preparation of this thesis; the Olympic Companion and MarathOn Multiscreen Applications. Both of these applications were informed by background literature on second screen television and wider issues in HCI multiscreen research. In addition, the design of both applications was inspired by the needs of traditional and online broadcasters, through an internship with BBC Research and Development and involvement in a YouTube sponsored project. Both the applications were evaluated by collocated groups of users in formative user studies. These studies centred on how users share and organise what to watch, incorporate activity within the traditionally passive television viewing experience and the integration of user-generated video content in a many-screen system. The primary contribution of this thesis is a series of industry validated guidelines for the design of many-screen applications. The guidelines highlight issues around user awareness devices, content and other user’s actions, the balance between communal and private viewing and the appropriation of user-generated content in many-screen watching

Many-screen viewing: collaborative consumption of television media across multiple devices

The landscape of television is changing. Modern Internet enabled sets are now capable computing devices offering new forms of connectivity and interaction to viewers. One development enabled by this transition is the distribution of auxiliary content to a portable computing device, such as a mobile phone or tablet, working in concert with the television. These configurations are enabled by second screen applications that provide relevant content in synchronisation with the programme on a nearby television set. This thesis extends the notion of second screen to arrangements that incorporate multiple mobile devices working with the television, utilised by collocated groups of participants. Herein these arrangements are referred to as ‘many-screen’ television. Two many-screen applications were developed for the augmentation of sports programming in preparation of this thesis; the Olympic Companion and MarathOn Multiscreen Applications. Both of these applications were informed by background literature on second screen television and wider issues in HCI multiscreen research. In addition, the design of both applications was inspired by the needs of traditional and online broadcasters, through an internship with BBC Research and Development and involvement in a YouTube sponsored project. Both the applications were evaluated by collocated groups of users in formative user studies. These studies centred on how users share and organise what to watch, incorporate activity within the traditionally passive television viewing experience and the integration of user-generated video content in a many-screen system. The primary contribution of this thesis is a series of industry validated guidelines for the design of many-screen applications. The guidelines highlight issues around user awareness devices, content and other user’s actions, the balance between communal and private viewing and the appropriation of user-generated content in many-screen watching

Assessing Social Text Placement in Mixed Reality TV

TV experiences are often social, be it at-a-distance (through text) or in-person (through speech). Mixed Reality (MR) headsets offer new opportunities to enhance social communication during TV viewing by placing social artifacts (e.g. text) anywhere the viewer wishes, rather than being constrained to a smartphone or TV display. In this paper, we use VR as a test-bed to evaluate different text locations for MR TV specifically. We introduce the concepts of wall messages, below-screen messages, and egocentric messages in addition to state-of-the-art on-screen messages (i.e., subtitles) and controller messages (i.e., reading text messages on the mobile device) to convey messages to users during TV viewing experiences. Our results suggest that a) future MR systems that aim to improve viewers’ experience need to consider the integration of a communication channel that does not interfere with viewers’ primary task, that is watching TV, and b) independent of the location of text messages, users prefer to be in full control of them, especially when reading and responding to them. Our findings pave the way for further investigations towards social at-a-distance communication in Mixed Reality

Politics at Home: Second Screen Behaviours and Motivations During TV Debates

The use of peripheral devices or second screens to access social media and other content is now a common activity during televised political debates. Based on a study conducted during the 2015 UK General Election debates, this paper explores attitudes and practices around such usage. Through the use of home observations and semistructured interviews of 18 participants, we focus on the motivations that the participants had for using second screens, capturing both fulfilled and unfulfilled needs. Based on the results, we suggest future directions for research that may further support online political discourse and we identify the potential need to rethink the implied hierarchy of the phrase second screens

User-centered design of an interactive social service concept for elderly people

The population is greying rapidly. Technologies are booming to maintain independence and wellbeing of the elderly people. Many designs and researches are particularly focused on physiological and safety needs of the elderly people. Though technologies have capabilities to affect the social aspects of the elderly people in a positive way, there are fewer researches commenced to date. The main purpose of this thesis work is to find out the needs of the elderly people and design appropriate technological solution for the elderly people addressing those needs using User Centered Design Approach. Various data collection methods such as semi-structured thematic interviews, observation and diary method were utilized to collect user needs. Then user data were consolidated using affinity diagram and the needs were classified using Maslow’s Hierarchy of Needs. Based on the user studies and the literature review of existing technologies, the need for social technology was figured out and the design phase involved the development of Social TV prototype. The design process was iterative in terms of creating scenarios and storyboards as well as User Environment Design to attain simplicity in design. Then the mid-fidelity prototype of social TV named ElderTV was developed to demonstrate the concept. The evaluation of the prototype was conducted utilizing sociability heuristics for social TV where the designed prototype was compared against each heuristics rules and these rules served as design guidelines during the design phase of the prototype. The resulted social TV concept for elderly people is designed to address elderly peoples’ needs to strengthen the existing social ties. The concept is expected to extend TV viewing activity of the elderly people into shared experience by allowing them to communicate with a circle of friends and families. The prototype is intended to illustrate how elderly people can share feeling of togetherness while watching television and alleviate the loneliness and isolation of the elderly