Emotions in context: examining pervasive affective sensing systems, applications, and analyses

Pervasive sensing has opened up new opportunities for measuring our feelings and understanding our behavior by monitoring our affective states while mobile. This review paper surveys pervasive affect sensing by examining and considering three major elements of affective pervasive systems, namely; “sensing”, “analysis”, and “application”. Sensing investigates the different sensing modalities that are used in existing real-time affective applications, Analysis explores different approaches to emotion recognition and visualization based on different types of collected data, and Application investigates different leading areas of affective applications. For each of the three aspects, the paper includes an extensive survey of the literature and finally outlines some of challenges and future research opportunities of affective sensing in the context of pervasive computing

Meaning in Architecture: Affordances, Atmosphere and Mood

Abstract: Meaning in Architecture: Affordances, Atmosphere and Mood, began as a public forum about human awareness of building, specifically speaking to the significance of affordances, embodied simulation theory, atmosphere and mood. It is herewith presented in copy form for broader distribution. An exchange between scientists and architects, this symposium was the inaugural Interface event of ANFA (the Academy of Neuroscience for Architecture, Salk Institute) held 17 April 2018 in the Regnier Forum of APDesign, Kansas State University. The authors for Meaning in Architecture: Affordances, Atmosphere and Mood will escort you to the intersection of deep brain function, as studied by neuroscientists, and our built-environment the expertise of architects. Unmistakably, these subjects are no longer separate matters of analysis, rather a collective pursuit to discover the physiological framework when confronted with our natural and built environment. Or to borrow from Dr. Rooney’s “Introduction:” What benefit, if any, is there to gain by combining the efforts of architecture and neuroscience? The former profession lays claim to thousands of years of physically manifesting civilization, while the latter, whose own enlightenment is taking shape, has greatly expanded our conceptualization of how our minds operate. Did the ancient Greeks suffer from a lack of neuroscientific knowledge when building the Parthenon? Did early neuroscientist need to know about architecture in order to discover the relationship between lesions and motor activity? No. Although that answer is true, it seems to remove a very common element amongst both professions. The element of environments. Regardless of your position as an architect, a neuroscientist or as a lay philosopher, humans live in the world and that world is predominantly built by humans. Any study of neuroscience inevitably must ground its findings in our world if it is to say anything useful, and any built architecture must come forth through the use of imagination held together by the neurons firing across regions in the brain. Speaking to our body, brain, and environments agenda, Dr. Michael Arbib, a neuroscientist studying buildings and their design, discusses in “The Architecture-Neuroscience Conversation and the Action-Perception Cycle,” the makeup of our brain and its relevant purposes, specifically the significance of the hippocampus. With knowledge stretching beyond cognitive generalities, architects and neuroscientists alike can begin to join design intentions to the human’s subconscious need to create place and memory through cognitive mapping. Through “Place, Peripheral Vision, and Space Perception: a pilot study in VR.” Dr. Colin Ellard and Robert Condia demonstrate the consequences of our peripheral and central vision. Investigated were measured human physiological responses, using biofeedback technology for subjects in virtual reality settings of 2 urban squares one classical and one in glass modernism. The lesson learnt is that central vision has little to do with perceiving where we are in space. Similarly, Dr. Brent Chamberlain’s “The Physio-Affective Built Environment” explores the exchange of the body and space in a direct application to our urban environment in a real-world experiment. Exposing our bodies to different environmental characteristics allow for real time biological results when crossing a street or turning a corner; an action we perform in our daily lives without consideration for its effect on our physiology. Our contract with space is this, the environment (built and otherwise) directly effects how we feel at any particular moment and place in time. Necessarily, our conversation begins by exploring the brain and body’s physiological response to constructed environments. To wit. recent advances in the biological sciences confirm how we construct and imagine space, while opening new doors to understanding perception holistically within our experience of architecture and urban design. Architecture embodies our natural tendencies and potentials for actions, what we now know as affordances of space. Interestingly, what you expect of a place has much to do with what it will afford you. Comments \u27\u27This collection of research uncovers key findings--for one, that central, focused vision has little to do with how we experience the ambience of a city square, that peripheral vision is more suited to the richness of architectural experience and that expectation and imaginative perception condition what our surroundings might afford us. These findings confirm what the very best architects have long known through their embodied knowledge honed in many years of practice--making it available to young architects who are just entering the field. What is more--the process of this research underscores the value of interdisciplinary collaboration precisely because it brings the embodied methods and intuitions of the architect together with the biocultural constraints being discovered in neuroscience to bear on the crucial project of designing the settings in which our daily lives unfold. - Sarah Robinson, AIAhttps://newprairiepress.org/ebooks/1033/thumbnail.jp

A Review of Platforms for the Development of Agent Systems

Agent-based computing is an active field of research with the goal of building autonomous software of hardware entities. This task is often facilitated by the use of dedicated, specialized frameworks. For almost thirty years, many such agent platforms have been developed. Meanwhile, some of them have been abandoned, others continue their development and new platforms are released. This paper presents a up-to-date review of the existing agent platforms and also a historical perspective of this domain. It aims to serve as a reference point for people interested in developing agent systems. This work details the main characteristics of the included agent platforms, together with links to specific projects where they have been used. It distinguishes between the active platforms and those no longer under development or with unclear status. It also classifies the agent platforms as general purpose ones, free or commercial, and specialized ones, which can be used for particular types of applications.Comment: 40 pages, 2 figures, 9 tables, 83 reference

SALSA: A Novel Dataset for Multimodal Group Behavior Analysis

Studying free-standing conversational groups (FCGs) in unstructured social settings (e.g., cocktail party ) is gratifying due to the wealth of information available at the group (mining social networks) and individual (recognizing native behavioral and personality traits) levels. However, analyzing social scenes involving FCGs is also highly challenging due to the difficulty in extracting behavioral cues such as target locations, their speaking activity and head/body pose due to crowdedness and presence of extreme occlusions. To this end, we propose SALSA, a novel dataset facilitating multimodal and Synergetic sociAL Scene Analysis, and make two main contributions to research on automated social interaction analysis: (1) SALSA records social interactions among 18 participants in a natural, indoor environment for over 60 minutes, under the poster presentation and cocktail party contexts presenting difficulties in the form of low-resolution images, lighting variations, numerous occlusions, reverberations and interfering sound sources; (2) To alleviate these problems we facilitate multimodal analysis by recording the social interplay using four static surveillance cameras and sociometric badges worn by each participant, comprising the microphone, accelerometer, bluetooth and infrared sensors. In addition to raw data, we also provide annotations concerning individuals' personality as well as their position, head, body orientation and F-formation information over the entire event duration. Through extensive experiments with state-of-the-art approaches, we show (a) the limitations of current methods and (b) how the recorded multiple cues synergetically aid automatic analysis of social interactions. SALSA is available at http://tev.fbk.eu/salsa.Comment: 14 pages, 11 figure

Spatial and Temporal Sentiment Analysis of Twitter data

The public have used Twitter world wide for expressing opinions. This study focuses on spatio-temporal variation of georeferenced Tweets’ sentiment polarity, with a view to understanding how opinions evolve on Twitter over space and time and across communities of users. More specifically, the question this study tested is whether sentiment polarity on Twitter exhibits specific time-location patterns. The aim of the study is to investigate the spatial and temporal distribution of georeferenced Twitter sentiment polarity within the area of 1 km buffer around the Curtin Bentley campus boundary in Perth, Western Australia. Tweets posted in campus were assigned into six spatial zones and four time zones. A sentiment analysis was then conducted for each zone using the sentiment analyser tool in the Starlight Visual Information System software. The Feature Manipulation Engine was employed to convert non-spatial files into spatial and temporal feature class. The spatial and temporal distribution of Twitter sentiment polarity patterns over space and time was mapped using Geographic Information Systems (GIS). Some interesting results were identified. For example, the highest percentage of positive Tweets occurred in the social science area, while science and engineering and dormitory areas had the highest percentage of negative postings. The number of negative Tweets increases in the library and science and engineering areas as the end of the semester approaches, reaching a peak around an exam period, while the percentage of negative Tweets drops at the end of the semester in the entertainment and sport and dormitory area. This study will provide some insights into understanding students and staff ’s sentiment variation on Twitter, which could be useful for university teaching and learning management

Exploring affective design for physical controls

Physical controls such as knobs, sliders, and buttons are experiencing a revival as many computing systems progress from personal computing architectures towards ubiquitous computing architectures. We demonstrate a process for measuring and comparing visceral emotional responses of a physical control to performance results of a target acquisition task. In our user study, participants experienced mechanical and rendered friction, inertia, and detent dynamics as they turned a haptic knob towards graphical targets of two different widths and amplitudes. Together, this process and user study provide novel affect- and performance-based design guidance to developers of physical controls for emerging ubiquitous computing environments. Our work bridges extensive human factors work in mechanical systems that peaked in the 1960’s, to contemporary trends, with a goal of integrating mechatronic controls into emerging ubiquitous computing systems. Author Keywords Haptic display, physical control, design process, affect

European Handbook of Crowdsourced Geographic Information

"This book focuses on the study of the remarkable new source of geographic information that has become available in the form of user-generated content accessible over the Internet through mobile and Web applications. The exploitation, integration and application of these sources, termed volunteered geographic information (VGI) or crowdsourced geographic information (CGI), offer scientists an unprecedented opportunity to conduct research on a variety of topics at multiple scales and for diversified objectives. The Handbook is organized in five parts, addressing the fundamental questions: What motivates citizens to provide such information in the public domain, and what factors govern/predict its validity?What methods might be used to validate such information? Can VGI be framed within the larger domain of sensor networks, in which inert and static sensors are replaced or combined by intelligent and mobile humans equipped with sensing devices? What limitations are imposed on VGI by differential access to broadband Internet, mobile phones, and other communication technologies, and by concerns over privacy? How do VGI and crowdsourcing enable innovation applications to benefit human society? Chapters examine how crowdsourcing techniques and methods, and the VGI phenomenon, have motivated a multidisciplinary research community to identify both fields of applications and quality criteria depending on the use of VGI. Besides harvesting tools and storage of these data, research has paid remarkable attention to these information resources, in an age when information and participation is one of the most important drivers of development. The collection opens questions and points to new research directions in addition to the findings that each of the authors demonstrates. Despite rapid progress in VGI research, this Handbook also shows that there are technical, social, political and methodological challenges that require further studies and research.