Media Space: an analysis of spatial practices in planar pictorial media.

The thesis analyses the visual space displayed in pictures, film, television and digital interactive media. The argument is developed that depictions are informed by the objectives of the artefact as much as by any simple visual correspondence to the observed world. The simple concept of ‘realism’ is therefore anatomised and a more pragmatic theory proposed which resolves some of the traditional controversies concerning the relation between depiction and vision. This is then applied to the special problems of digital interactive media. An introductory chapter outlines the topic area and the main argument and provides an initial definition of terms. To provide a foundation for the ensuing arguments, a brief account is given of two existing and contrasted approaches to the notion of space: that of perception science which gives priority to acultural aspects, and that of visual culture which emphasises aspects which are culturally contingent. An existing approach to spatial perception (that of JJ Gibson originating in the 1940s and 50s) is applied to spatial depiction in order to explore the differences between seeing and picturing, and also to emphasise the many different cues for spatial perception beyond those commonly considered (such as binocularity and linear perspective). At this stage a simple framework of depiction is introduced which identifies five components or phases: the objectives of the picture, the idea chosen to embody the objectives, the model (essentially, the visual ‘subject matter’), the characteristics of the view and finally the substantive picture or depiction itself. This framework draws attention to the way in which each of the five phases presents an opportunity for decision-making about representation. The framework is used and refined throughout the thesis. Since pictures are considered in some everyday sense to be ‘realistic’ (otherwise, in terms of this thesis, they would not count as depictions), the nature of realism is considered at some length. The apparently unitary concept is broken down into several different types of realism and it is argued that, like the different spatial cues, each lends itself to particular objectives intended for the artefact. From these several types, two approaches to realism are identified, one prioritising the creation of a true illusion (that the picture is in fact a scene) and the other (of which there are innumerably more examples both across cultures and over historical time) one which evokes aspects of vision without aiming to exactly imitate the optical stimulus of the scene. Various reasons for the latter approach, and the variety of spatial practices to which it leads, are discussed. In addition to analysing traditional pictures, computer graphics images are discussed in conjunction with the claims for realism offered by their authors. In the process, informational and affective aspects of picture-making are distinguished, a distinction which it is argued is useful and too seldom made. Discussion of still pictures identifies the evocation of movement (and other aspects of time) as one of the principal motives for departing from attempts at straightforward optical matching. The discussion proceeds to the subject of film where, perhaps surprisingly now that the depiction of movement is possible, the lack of straightforward imitation of the optical is noteworthy again. This is especially true of the relationship between shots rather than within them; the reasons for this are analysed. This reinforces the argument that the spatial form of the fiction film, like that of other kinds of depiction, arises from its objectives, presenting realism once again as a contingent concept. The separation of depiction into two broad classes – one which aims to negate its own mediation, to seem transparent to what it depicts, and one which presents the fact of depiction ostensively to the viewer – is carried through from still pictures, via film, into a discussion of factual television and finally of digital interactive media. The example of factual television is chosen to emphasise how, despite the similarities between the technologies of film and television, spatial practices within some television genres contrast strongly with those of the mainstream fiction film. By considering historic examples, it is shown that many of the spatial practices now familiar in factual television were gradually expunged from the classical film when the latter became centred on the concerns of narrative fiction. By situating the spaces of interactive media in the context of other kinds of pictorial space, questions are addressed concerning the transferability of spatial usages from traditional media to those which are interactive. During the thesis the spatial practices of still-picture-making, film and television are characterised as ‘mature’ and ‘expressive’ (terms which are defined in the text). By contrast the spatial practices of digital interactive media are seen to be immature and inexpressive. It is argued that this is to some degree inevitable given the context in which interactive media artefacts are made and experienced – the lack of a shared ‘language’ or languages in any new media. Some of the difficult spatial problems which digital interactive media need to overcome are identified, especially where, as is currently normal, interaction is based on the relation between a pointer and visible objects within a depiction. The range of existing practice in digital interactive media is classified in a seven-part taxonomy, which again makes use of the objective-idea-model-view-picture framework, and again draws out the difference between self-concealing approaches to depiction and those which offer awareness of depiction as a significant component of the experience. The analysis indicates promising lines of enquiry for the future and emphasises the need for further innovation. Finally the main arguments are summarised and the thesis concludes with a short discussion of the implications for design arising from the key concepts identified – expressivity and maturity, pragmatism and realism

Introduction to the special issue on creative evaluation

This special issue presents revised versions of papers presented at a London symposium organised by the Lansdown Centre for Electronic Arts in January 2009. The articles describe a range of approaches to the theme of evaluation in creative work, focused on the changes brought about by digital interactive technologies. They deal with specific innovative techniques and new applications of techniques taken from other disciplines, and discuss key issues which arise in relation to monitoring, describing, measuring, analysing and evaluating the use and reception of creative work. They include accounts of complex multi-disciplinary team works, individual personal projects, and reflections on extensive periods of engagement with the issues

Book review. Cartographies of Time: a history of the timeline

A review of 'Cartographies of Time: a history of the timeline' by Daniel Rosenberg and Anthony Grafton. Princeton, NJ: Princeton Architectural Press, 2010. (272pp. ISBN: 9781568987637)

Mapping the unseen: making sense of the subjective image.

It used to be thought that photography, as a kind of automatic mapping, could provide an objective view of the world. Now we are aware of the power of framing and other interventions between what is 'out there' and what is captured in depiction. Perhaps even perception, let alone depiction, shares this subjectivity? The Sapir-Whorf hypothesis holds that different cultures actually see the world in different ways, as evidenced and influenced by concepts in their languages – though this idea has been derided, for example by Pinker. A key difficulty is that the word subjectivity is bandied about without care for its different meanings and without distinguishing the many forms it takes in the graphic image. If into this muddle we introduce the idea of interactivity, still greater confusion easily follows. The chapter brings some order to different kinds and levels of subjectivity by documenting how they are reflected in forms of graphical mapping. In the process, it becomes clear how significant is the change in media technologies from those bound by the conventional rectangles of the page and screen to media which are interactive, pervasive, multimodal, physical and social

Time machines.

The chapter is concerned with the use of computers to represent historical time visually, typically as ‘timelines’. Research into the sophisticated practice and theory of early modern paper timelines in the eighteenth century reveals the weakness of current practice, especially on the Web. Behind the work of the early pioneers lay a vision of mechanising knowledge. At that time, this proved a productive metaphor, but in our own time the mechanistic properties of computers have tended to encourage an approach to visualising history that excludes all but the crudest aspects. Solutions are needed which use computing in ways that do justice to the demands of historiography

Just in time: defining historical chronographics

The paper is historical in two respects, both concerned with visual representations of past time. Its first purpose is to enquire how visual representations of historical time can be used to bring out patterns in a museum collection. A case study is presented of the visualisation of data with sufficient subtlety to be useful to historians and curators. Such a visual analytics approach raises questions about the proper representation of time and of objects and events within it. It is argued that such chronographics can support both an externalised, objectivising point of view from ‘outside’ time and one which is immersive and gives a sense of the historic moment. These modes are set in their own historical context through original historical research, highlighting the shift to an Enlightenment view of time as a uniform container for events. This in turn prompts new ways of thinking about chronological visualisation, in particular the separation of the ‘ideal’ image of time from contingent, temporary rendered views

Interaction and Expressivity in Video Games: Harnessing the Rhetoric of Film

The film-maker uses the camera and editing creatively, not simply to present the action of the film but also to set up a particular relation between the action and the viewer. In 3D video games with action controlled by the player, the pseudo camera is usually less creatively controlled and has less effect on the player’s appreciation of and engagement with the game. This paper discusses methods of controlling games by easy and intuitive interfaces and use of an automated virtual camera to increase the appeal of games for users

The sweet smell of success: Enhancing multimedia applications with olfaction

This is the Post-Print version of the Article. The official published version can be accessed from the link below - Copyright @ 2012 ACMOlfaction, or smell, is one of the last challenges which multimedia applications have to conquer. As far as computerized smell is concerned, there are several difficulties to overcome, particularly those associated with the ambient nature of smell. In this article, we present results from an empirical study exploring users' perception of olfaction-enhanced multimedia displays. Findings show that olfaction significantly adds to the user multimedia experience. Moreover, use of olfaction leads to an increased sense of reality and relevance. Our results also show that users are tolerant of the interference and distortion effects caused by olfactory effect in multimedia

Moving tales, exploring narrative strategies for scalable locative audio drama.

This paper reports on a recent collaboration between the Lansdown Centre for Electronic Arts at Middlesex University and the BBC Radio Drama Department, which was designed to investigate the narrative possibilities of locative media in a drama context. The locative drama Scratch is the first outcome of an ongoing research project, Locating Drama, whose aim is to investigate and develop narrative strategies that take full advantage of the current generation of GPS enabled portable computing devices for audio drama. In particular, we are exploring content and modes of interaction, which, while based on location awareness are not in any way site-specific allowing users to experience the drama in a location of their choice. We will refer to this approach as translocational as it allows the translation of locative media experiences to a wide variety of spaces. The translocational approach is of particular interest to broadcasters as it is more scalable than a site-specific paradigm, opening the possibility of downloadable location-aware podcasts featuring professionally authored content for a wide audience