Instrumental genesis through interdisciplinary collaboration -- reflections on the emergence of a visualisation framework for video annotation data

Instrumental genesis through interdisciplinary collaboration-reflections on the emergence of a visualisation framework for video annotation data XML This paper presents, discusses and reflects on the development of a visualization framework for the analysis of the temporal dynamics of audiovisual expressivity. The main focus lies on the instrumental genesis process (Rabardel 1995; Longchamp 2012)-a concept trying to express and analyze the co-evolution of instruments and the practices they make possible-underlying this development. It is described through the collaboration and communication processes between computer science scholars and humanities scholars in finding new ways of visualizing complex datasets for exploration and presentation in the realm of film-studies research. It draws on the outcome and concrete usage of the visualizations in publications and presentations of a research group, the AdAproject, that investigates the audiovisual rhetorics of affect in audiovisual media on the financial crisis (2007-). These film analyses are based on theoretical assumptions on the process of film-viewing, the relation of the viewer's perception and the temporally unfolding audiovisual images, and a methodical approach that draws on 'steps' in the research process such as segmentation, description and qualification, called eMAEX (Kappelhoff et al. 2011-2016) to reconstruct these experiential figurations (Bakels et al. 2020a, 2020b). The main focus of this paper is the process of iterative development of visualizations as interactive interfaces generated with the open-source software Advene, that were an integral part of the research process. In this regard, the timeline visualization is not only of interest for visual argumentation in (digital) humanities publications, but also for the creation of annotations as well as the exploration of this data. In the first part of the paper we describe this interdisciplinary collaboration as instrumental genesis on a general level-as an evolving and iterative process. In the second part we focus on the specific challenge of designing a visualization framework for the temporal dynamics of audiovisual aesthetics. Lastly we zoom out by reflecting on experiences and insights that might be of interest for the wider digital humanities community

Telling interactive stories: A practice-based investigation into new media interactive storytelling

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.Telling Interactive Stories is a practice-based thesis, which theoretically and practically probes the field of digital fictional interactive storytelling. The submission takes the form of the interactive cinema installation Crossed Lines together with a written element of the thesis which interrogates historical, contextual, theoretical, technical and critical aspects of the field of interactive narrative using new media. Crossed Lines is an original fictional interactive AV piece, amalgamating multiform plots, a multi-screen viewing environment, an interactive interface and an interactive story navigation form. The installation tells the stories of nine characters in a way that the viewer can constantly explore and switch between all nine forms, using a telephone keypad and handset as an interface, and can simultaneously observe all characters’ presence between the nine remote locations. Several research methodologies are utilised to analyse and evaluate the installation. Quantitative methodologies include the use of user tracking systems where the computational output of the installation provides measurements and timings of user choices and behaviours. Qualitative methodologies include theoretical and visual analysis, and in depth analysis of user responses using interviews, questionnaires, video recordings and cuttingedge eye-tracking technologies

Social shaping of digital publishing: exploring the interplay between culture and technology

The processes and forms of electronic publishing have been changing since the advent of the Web. In recent years, the open access movement has been a major driver of scholarly communication, and change is also evident in other fields such as e-government and e-learning. Whilst many changes are driven by technological advances, an altered social reality is also pushing the boundaries of digital publishing. With 23 articles and 10 posters, Elpub 2012 focuses on the social shaping of digital publishing and explores the interplay between culture and technology. This book contains the proceedings of the conference, consisting of 11 accepted full articles and 12 articles accepted as extended abstracts. The articles are presented in groups, and cover the topics: digital scholarship and publishing; special archives; libraries and repositories; digital texts and readings; and future solutions and innovations. Offering an overview of the current situation and exploring the trends of the future, this book will be of interest to all those whose work involves digital publishing

Beyond South Seas: Making History in Networked Digital Technologies

In this paper, I discuss some of the more salient intellectual and technological dimensions of work over the past year, focused on developing an open source knowledge creation, management and publication system. In key respects, our work seeks to anticipate developments in national collaborative e-research infrastructure over the next five or so years. Especially in view of recent statements on innovation policy by the Australian government, we can expect the next five or so years will see significant advances in the development of online knowledge repositories for not only more complex kinds of quantitative research data, but also for qualitative data in rich and diverse media forms that will offer new possibilities for humanities research. We will also see improved or new middleware, allowing Australian research communities in the humanities collaboratively to create, share and interrogate new knowledge of cultural and social phenomena. However, if humanities researchers are to exploit these and other possible advances in digital research infrastructure, then what they will also need are ‘tools’ enabling the creation, reception and use of knowledge that these infrastructural advances can put into intellectual circulation. They will need the means of using networked digital technologies as primary media for research, and to publish their findings as complex multimedia artifacts

NET WORKING: Work Patterns and Workforce Policies for the New Media Industry

This report, based on a study of a group of highly accomplished professionals in New York City, is one of the first to take up labor market issues in the new media industry. It describes the challenges faced by professionals and employers alike in this important and dynamic sector, and identifies strategies for success in a project oriented environment with highly complex skill demands and rapidly changing technology. Our findings suggest three central issues

The Right Place at the Right Time: Creative Spaces in Libraries

Purpose This essay explores the recent trend in libraries: that of the establishment of spaces specifically set aside for creative work. The rise of these dedicated creative spaces is owed to a confluence of factors that happen to be finding their expression together in recent years. This essay examines the history of these spaces and explores the factors that gave rise to them and will fuel them moving forward. Design/Methodology/Approach A viewpoint piece, this essay combines historical research and historical/comparative analyses to examine the ways by which libraries have supported creative work in the past and how they may continue to do so into the 21st century. Findings The key threads brought together include a societal recognition of the value of creativity and related skills and attributes; the philosophies, values, and missions of libraries in both their longstanding forms and in recent evolutions; the rise of participatory culture as a result of inexpensive technologies; improved means to build community and share results of efforts; and library experience and historical practice in matters related to creativity. The chapter concludes with advice for those interested in the establishment of such spaces, grounding those reflections in the author’s experiences in developing a new creative space at Virginia Commonwealth University. Originality/value While a number of pieces have been written that discuss the practicalities of developing certain kinds of creative spaces, very little has been written that situates these spaces in larger social and library professional contexts; this essay begins to fill that gap

Stories of family in working‐class graduates’ early careers

How do young graduates view the role of immediate families in influencing/supporting them as they start their working lives and how do those reflections affect how they think of themselves as graduates? Social, political and economic changes have led to many young people being dependent on family for longer, but how does this play out in their reflections? This article addresses these questions by reporting upon findings from qualitative research with 14 young people from working‐class backgrounds, who were part of a larger study of recent graduates. Figured Worlds theory illuminates data, with a consideration of the role that family plays in the ‘space of authoring’ and understanding of ‘positionality’. Findings capture vivid stories of the enabling but also limiting role of family. In our analysis of data, we borrow the words ‘salience’ from Holland and her co‐authors and ‘distinction’ from Bourdieu, which help capture different depictions of family. Both articulations of ‘salience’ and a search for ‘distinction’ emerge in how graduates’ stories respond to family. We argue for a greater appreciation of the differing family resources of working‐class graduates, and reject an emphasis on what they may lack, compared to their peers, which has tended to be the case in some media and policy commentary. There are implications for educators to foster student reflexivity about family sensitively, and to be aware of how family backgrounds may influence graduate career paths and students’ awareness of wider inequalities

A Generic Software Library for Creating Multimedia Browse/Search Applications

PhDThis thesis surveys the field of browse/search interactions. The results of this study form the basis of a specification of a representation scheme and a library of access functions which facilitate the creation of information-rich multimedia applications. Evidence is provided for the hypothesis that browsing and searching are the extreme ends of a continuum of data access methods and that many browse/search interactions contain a mixture of both with the ratio varying as the interaction proceeds. These observations motivate the integration of browsing and search facilities so that applications can be built which exhibit both types of information access. This work is tailored to the area of consumer multimedia with a review of the constraints that this imposes on the authoring process and the applications themselves forming part of this work. The specification of the functionality of the function library, together with its implementation and testing are described in detail. The library has been evaluated by constructing a number of prototype applications which demonstrate the utility and scope of the library