Eyes-Off Physically Grounded Mobile Interaction

This thesis explores the possibilities, challenges and future scope for eyes-off, physically grounded mobile interaction. We argue that for interactions with digital content in physical spaces, our focus should not be constantly and solely on the device we are using, but fused with an experience of the places themselves, and the people who inhabit them. Through the design, development and evaluation of a series ofnovel prototypes we show the benefits of a more eyes-off mobile interaction style.Consequently, we are able to outline several important design recommendations for future devices in this area.The four key contributing chapters of this thesis each investigate separate elements within this design space. We begin by evaluating the need for screen-primary feedback during content discovery, showing how a more exploratory experience can be supported via a less-visual interaction style. We then demonstrate how tactilefeedback can improve the experience and the accuracy of the approach. In our novel tactile hierarchy design we add a further layer of haptic interaction, and show how people can be supported in finding and filtering content types, eyes-off. We then turn to explore interactions that shape the ways people interact with aphysical space. Our novel group and solo navigation prototypes use haptic feedbackfor a new approach to pedestrian navigation. We demonstrate how variations inthis feedback can support exploration, giving users autonomy in their navigationbehaviour, but with an underlying reassurance that they will reach the goal.Our final contributing chapter turns to consider how these advanced interactionsmight be provided for people who do not have the expensive mobile devices that areusually required. We extend an existing telephone-based information service to support remote back-of-device inputs on low-end mobiles. We conclude by establishingthe current boundaries of these techniques, and suggesting where their usage couldlead in the future

Improving Operator Recognition and Prediction of Emergent Swarm Behaviors

Robot swarms are typically defined as large teams of coordinating robots that interact with each other on a local scale. The control laws that dictate these interactions are often designed to produce emergent global behaviors useful for robot teams, such as aggregating at a single location or moving between locations as a group. These behaviors are called emergent because they arise from the local rules governing each robot as they interact with neighbors and the environment. No single robot is aware of the global behavior yet they all take part in it, which allows for a robustness that is difficult to achieve with explicitly-defined global plans. Now that hardware and algorithms for swarms have progressed enough to allow for their use outside the laboratory, new research is focused on how operators can control them. Recent work has introduced new paradigms for imparting an operator's intent on the swarm, yet little work has focused on how to better visualize the swarm to improve operator prediction and control of swarm states. The goal of this dissertation is to investigate how to present the limited data from a swarm to an operator so as to maximize their understanding of the current behavior and swarm state in general. This dissertation develops--through user studies--new methods of displaying the state of a swarm that improve a user's ability to recognize, predict, and control emergent behaviors. The general conclusion is that how summary information about the swarm is displayed has a significant impact on the ability of users to interact with the swarm, and that future work should focus on the properties unique to swarms when developing visualizations for human-swarm interaction tasks

Agency is molecular: moved by being moved to moving or co-constitution in intra-active knowledge production

This practice-based PhD aims to intertwine theoretical research and artistic practice on the basis of knowledge production by conceptually thinking through motion, with movement informing the methodological counterpart in performative research settings. I argue that movement and the concept of motion, in their immanent potential for in/determinancy, transport possibilities of transversality that have been neglected in western Modernity. Both offer the means of moving beyond the bifurcated exceptionalism of Modernity's epistemology. The project interrogates its own positioning from within by affirming embodied ways of knowing, which are marginalised within the rationalised epistemes in European Universalisms (Wallerstein). In doing so it also takes a stand against appropriation. From a feminist position, new materialism's situatedness (Haraway) and relational objectivity (Barad) are particularly suitable tools for a shift from within. The apparatus definitions of Agential Realism gather insights through agential cuts that provide a transient exteriority-within, allowing modifying the bounds of knowing from within. The primary chapters examine the impact of practicing through theory and coalesce into a final experiment that reverses the process. Applied to the path of thoughts, movement's induction of changes to matter initiates an essential process of creating space for delinking (Mignolo/Walsh) and unlearning (Singh). The foundation of both practice- and theory-based approaches is Barad's notion of intra-active doing-being, which provides an understanding of agential intertwinement by approaching matter through and with interferences. In experiments, electronic devices were set to receive techno-sound-reverberations as diffractional concerns (noise), that transposed mattering (meaning) from co-constitutional forms. These 'voices', enacted in material-discursive experiments of various entangled engagements in different molecular matterings (body-mind, nature-culture, non-human-human, other-self) are typically ignored, denied, or misunderstood by the notorious bifurcation of the western metaphysical matrix (Jackson). Listening to matter’s iterative performativity (Barad) disclosed uneven levels of capacity (Wilderson) within such non-interrogated generalisations as the flattening to 'we' of the Anthropocene discourse. This awareness of interferential reverberations demands a multidirectional pluriverse of capabilities, which compromises any one-world (Law) exceptionality

Interiority, identity and the limits of knowledge in documentary film

In the cinema, as Marian Keane has noted, “the medium of film - and specifically the camera - takes the nature of human interiority as its fundamental subject." Keane is writing about fiction film, where scripted dialogue, actor performance and codifications presented by mise en scene, framing, camera movement, editing patterns, lighting and music, typically offer cues to characters’ states of mind and emotions. But these resources are not always readily available, or deemed appropriate, across the heterogeneous terrain of non-fiction film. Any confrontation with the “limits on the expressibility of human interiority” presents a particular hermeneutic dilemma for documentary. This piece focuses on a number of films that take interiority as their key problematic by staging inquiries into the possibility of, and constraints on, gaining access to the inner life of the other. My argument begins with examples that pursue traces of a subject assumed to be always already other than the audience: that of the child viewed by adults, or the blind person seen by the sighted. I then turn to the role of the documentary interview in two flims by Errol Morris. The final third of my inquiry centres on an analysis of Carol Morley’s Dreams of a Life, an assemblage of recollections and anecdotes about a woman who lay dead in her bedsit for three years. Intended as a memorial of sorts, the film can also be understood as a self-reflexive inquiry into the means by which documentary might lay claim to this absent other, and the ultimate restrictions on such a project

Transnational Science Fiction at the End of the World: Consensus, Conflict and the Politics of Climate Change

This article considers the significance of transnational production, aesthetic, and narrative strategies in recent forms of "apocalyptic" science fiction cinema. As the article explores, a more transnational mode of science fiction offers the opportunity for popular genre cinema to engage with pressing environmental questions, the contexts of climate politics, and particularly the historical and present role of science fiction in confronting, or sometimes avoiding, these issues

Soundwalking in contested space

Soundwalking is an expanding creative discipline with its origins in situationist practices and soundscape studies. Beyond its application as a creative medium soundwalking has far reaching potential for artistic research in a range of different disciplines. My thesis, informed by over two decades of leading art walks and composing soundwalks, interrogates my own soundwalking practice, through which I am investigating contested space. I consider findings from six of my soundwalks composed between 2013 and 2018 and guide the reader through my process and the methods of aleatoric composition, temporal shift, synchrony, and ordeal that, in combination, distinguish them from those of fellow practitioners and researchers. Alongside writers and theorists such as Tim Edensor, Brandon LaBelle, and Frauke Behrendt, social geographer Doreen Massey provides a firm theoretical foundation through her conception of space as 'the product of interrelations' and imaginable as 'a simultaneity of stories so far' (Massey, 2005, p. 9). While Massey adopts a generally progressive tone in her articulation of space, in recognition of the human potential that can be realised through spatial encounters, I place emphasis upon its contested nature, as a product of the unequal power relations that arise out of the everyday interactions of human beings. My contribution to knowledge is both thematic and methodological, through my core concern of human-contested space, the specific combination of methods that I apply within my practice as research, and in the ways these methods encourage deeper appreciation and understanding. My research journey traces a path through contested urban and rural space and exposes the lived realities of human experience when utopian or hubristic visions falter or fail. My findings are directed towards researchers investigating contested space, be it from artistic, social-historical, or environmental perspectives

Browse-to-search

This demonstration presents a novel interactive online shopping application based on visual search technologies. When users want to buy something on a shopping site, they usually have the requirement of looking for related information from other web sites. Therefore users need to switch between the web page being browsed and other websites that provide search results. The proposed application enables users to naturally search products of interest when they browse a web page, and make their even causal purchase intent easily satisfied. The interactive shopping experience is characterized by: 1) in session - it allows users to specify the purchase intent in the browsing session, instead of leaving the current page and navigating to other websites; 2) in context - -the browsed web page provides implicit context information which helps infer user purchase preferences; 3) in focus - users easily specify their search interest using gesture on touch devices and do not need to formulate queries in search box; 4) natural-gesture inputs and visual-based search provides users a natural shopping experience. The system is evaluated against a data set consisting of several millions commercial product images. © 2012 Authors

Intent-Recognition-Based Traded Control for Telerobotic Assembly over High-Latency Telemetry

As we deploy robotic manipulation systems into unstructured real-world environments, the tasks which those robots are expected to perform grow very quickly in complexity. These tasks require a greater number of possible actions, more variable environmental conditions, and larger varieties of objects and materials which need to be manipulated. This in turn leads to a greater number of ways in which elements of a task can fail. When the cost of task failure is high, such as in the case of surgery or on-orbit robotic interventions, effective and efficient task recovery is essential. Despite ever-advancing capabilities, however, the current and near future state-of-the-art in fully autonomous robotic manipulation is still insufficient for many tasks in these critical applications. Thus, successful application of robotic manipulation in many application domains still necessitates a human operator to directly teleoperate the robots over some communications infrastructure. However, any such infrastructure always incurs some unavoidable round-trip telemetry latency depending on the distances involved and the type of remote environment. While direct teleoperation is appropriate when a human operator is physically close to the robots being controlled, there are still many applications in which such proximity is infeasible. In applications which require a robot to be far from its human operator, this latency can approach the speed of the relevant task dynamics, and performing the task with direct telemanipulation can become increasingly difficult, if not impossible. For example, round-trip delays for ground-controlled on-orbit robotic manipulation can reach multiple seconds depending on the infrastructure used and the location of the remote robot. The goal of this thesis is to advance the state-of-the art in semi-autonomous telemanipulation under multi-second round-trip communications latency between a human operator and remote robot in order to enable more telerobotic applications. We propose a new intent-recognition-based traded control (IRTC) approach which automatically infers operator intent and executes task elements which the human operator would otherwise be unable to perform. What makes our approach more powerful than the current approaches is that we prioritize preserving the operator's direct manual interaction with the remote environment while only trading control over to an autonomous subsystem when the operator-local intent recognition system automatically determines what the operator is trying to accomplish. This enables operators to perform unstructured and a priori unplanned actions in order to quickly recover from critical task failures. Furthermore, this thesis also describes a methodology for introducing and improving semi-autonomous control in critical applications. Specifically, this thesis reports (1) the demonstration of a prototype system for IRTC-based grasp assistance in the context of transatlantic telemetry delays, (2) the development of a systems framework for IRTC in semi-autonomous telemanipulation, and (3) an evaluation of the usability and efficacy of that framework with an increasingly complex assembly task. The results from our human subjects experiments show that, when incorporated with sufficient lower-level capabilities, IRTC is a promising approach to extend the reach and capabilities of on-orbit telerobotics and future in-space operations