The perception of emotion in artificial agents

Given recent technological developments in robotics, artificial intelligence and virtual reality, it is perhaps unsurprising that the arrival of emotionally expressive and reactive artificial agents is imminent. However, if such agents are to become integrated into our social milieu, it is imperative to establish an understanding of whether and how humans perceive emotion in artificial agents. In this review, we incorporate recent findings from social robotics, virtual reality, psychology, and neuroscience to examine how people recognize and respond to emotions displayed by artificial agents. First, we review how people perceive emotions expressed by an artificial agent, such as facial and bodily expressions and vocal tone. Second, we evaluate the similarities and differences in the consequences of perceived emotions in artificial compared to human agents. Besides accurately recognizing the emotional state of an artificial agent, it is critical to understand how humans respond to those emotions. Does interacting with an angry robot induce the same responses in people as interacting with an angry person? Similarly, does watching a robot rejoice when it wins a game elicit similar feelings of elation in the human observer? Here we provide an overview of the current state of emotion expression and perception in social robotics, as well as a clear articulation of the challenges and guiding principles to be addressed as we move ever closer to truly emotional artificial agents

Expressive Copying Behavior for Social Agents: A Perceptual Analysis

n/

Embodied conversations: Performance and the design of a robotic dancing partner

This paper reports insights gained from an exploration of performance-based techniques to improve the design of relationships between people and responsive machines. It draws on the Emergent Objects project and specifically addresses notions of embodiment as employed in the field of performance as a means to prototype and develop a robotic agent, SpiderCrab, designed to promote expressive interaction of device and human dancer, in order to achieve ‘performative merging’. The significance of the work is to bring further knowledge of embodiment to bear on the development of human-technological interaction in general. In doing so, it draws on discursive and interpretive methods of research widely used in the field of performance but not yet obviously aligned with some orthodox paradigms and practices within design research. It also posits the design outcome as an ‘objectile’ in the sense that a continuous and potentially divergent iteration of prototypes is envisaged, rather than a singular final product. The focus on performative merging draws in notions of complexity and user experience. Keywords: Embodiment; Performance; Tacit Knowledge; Practice-As-Research; Habitus.</p

Deep Tracking: Seeing Beyond Seeing Using Recurrent Neural Networks

This paper presents to the best of our knowledge the first end-to-end object tracking approach which directly maps from raw sensor input to object tracks in sensor space without requiring any feature engineering or system identification in the form of plant or sensor models. Specifically, our system accepts a stream of raw sensor data at one end and, in real-time, produces an estimate of the entire environment state at the output including even occluded objects. We achieve this by framing the problem as a deep learning task and exploit sequence models in the form of recurrent neural networks to learn a mapping from sensor measurements to object tracks. In particular, we propose a learning method based on a form of input dropout which allows learning in an unsupervised manner, only based on raw, occluded sensor data without access to ground-truth annotations. We demonstrate our approach using a synthetic dataset designed to mimic the task of tracking objects in 2D laser data -- as commonly encountered in robotics applications -- and show that it learns to track many dynamic objects despite occlusions and the presence of sensor noise.Comment: Published in The Thirtieth AAAI Conference on Artificial Intelligence (AAAI-16), Video: https://youtu.be/cdeWCpfUGWc, Code: http://mrg.robots.ox.ac.uk/mrg_people/peter-ondruska

Synchrony and copying in conversational interactions

Proceedings of the 3rd Nordic Symposium on Multimodal Communication. Editors: Patrizia Paggio, Elisabeth Ahlsén, Jens Allwood, Kristiina Jokinen, Costanza Navarretta. NEALT Proceedings Series, Vol. 15 (2011), 18–24. © 2011 The editors and contributors. Published by Northern European Association for Language Technology (NEALT) http://omilia.uio.no/nealt . Electronically published at Tartu University Library (Estonia) http://hdl.handle.net/10062/22532

Designing a programming-based approach for modelling scientific phenomena

We describe an iteratively designed sequence of activities involving the modelling of 1- dimensional collisions between moving objects based on programming in ToonTalk. Students aged 13-14 in two settings (London and Cyprus) investigated a number of collision situations, classified into six classes based on the relative velocities and masses of the colliding objects. We describe iterations of the system in which students engaged in a repeating cycle of activity for each collision class: prediction of object behaviour from given collision conditions, observation of a relevant video clip, building a model to represent the phenomena, testing, validating and refining their model, and publishing it – together with comments – on our web-based collaboration system, WebReports. Students were encouraged to consider the limitations of their current model, with the aim that they would eventually appreciate the benefit of constructing a general model that would work for all collision classes, rather than a different model for each class. We describe how our intention to engage students with the underlying concepts of conservation, closed systems and system states was instantiated in the activity design, and how the modelling activities afforded an alternative representational framework to traditional algebraic description

The Digital Technology Boomerang: New Intellectual Property Rights Threaten Global “Open Science”

There is a serious threat that ill-considered government support for expanding legal means of controlling access to information for the purpose of extracting private economic rents is resulting in the 'over- fencing of the public knowledge commons' in science and engineering. Such a new 'tragedy of the commons' would bring adverse long-run consequences for future welfare gains through technological progress, and re-distributional effects further disadvantaging the present economically less advanced countries of the world. Radical legal innovations in intellectual property protection that seriously jeopardize the effective conduct of open, collaborative science have been introduced by the little noticed European Database Directive of March 1996. This initiative forms an emblematic and substantively significant aspect of the broader set of transformations in intellectual property rights institutions that have been initiated in response to the economic ramifications of rapid progress in digital information technologies. The EC Directive poses numerous contentious issues in law and economics that will create ambiguities for business and non-profit activities in this area for years to come. The terms on which those issues are resolved will materially affect the costs and organizational feasibility of scientific projects that are of global reach and importance, especially those that depend heavily upon the collection, management and analysis of large volumes of observational data that cannot be regenerated. This paper sets out the economic case for the effectiveness of open, collaborative research, and the forces behind the recent, countervailing rush to strengthen and expand the scope of intellectual property rights protection. Focusing upon innovations in copyright law and the sui generis protection of hitherto unprotected content, it documents the genesis and analyzes the economic implications of the EC's Database Directive, and related legislative proposals (H.R. 3125, H.R. 354 and H.R. 1858) in the US. Several modest remedial proposals are advanced to mitigate the adverse impact of 'the digital technology boomerang' upon open science.intellectual property rights, copyright, sui generis protection of expressive material, economics of information-goods, open science, 'fair use,' scientific databases

Tragedy of the Public Knowledge 'Commons'? Global Science, Intellectual Property and the Digital Technology Boomerang

Radical legal innovations in intellectual property protection have been introduced by the little noticed European Database Directive of March 1996. This initiative, part of the larger institutional transformations initiated in response to the economic ramifications of rapid progress in digital information technologies, poses numerous contentious issues in law and economics. These are likely to create ambiguities for business and non-profit activities in this area for years to come, and the terms on which those issues are resolved will materially affect the costs and organizational feasibility of scientific projects that are of global reach and significance. This is the case especially in fields such as geology, oceanography and climatology, which depend heavily upon the collection, management and analysis of large volumes of observational data that cannot be regenerated. More generally the conduct of open, collaborative science - along with many of the benefits that flow from it for the developed and the developing economies alike - may be seriously jeopardized by the consequences of the new database protections. This raises the spectre of a new and different "tragedy of the commons," one created by continuing the unbalanced pressure to extract greater economic rents by means of controlling access to information. "Over-fencing," which is to say, the erection of artificial cost barriers to the production of reliable public knowledge by means of reliable public knowledge, threatens the future of "the public knowledge commons" that historically has proved critically important for rapid advance in science and technology. The paper sets out the economic case for the effectiveness of open, collaborative research, and the forces behind the recent, countervailing rush to strengthen and expand the scope of intellectual property rights protection. Focusing upon innovations in copyright law and the sui generis protection of hitherto unprotected content, it documents the genesis and analyzes the economic implications of the EC''s Database Directive, and related legislative proposals (H.R. 3125, H.R. 354 and H.R. 1858) in the US. The discussion concludes by advancing a number of modest remedial proposals that are intended to promote greater efforts to arrive at satisfactory policy solutions for this aspect of "the digital dilemma."economics of technology ;