Deep fusion of multi-channel neurophysiological signal for emotion recognition and monitoring

How to fuse multi-channel neurophysiological signals for emotion recognition is emerging as a hot research topic in community of Computational Psychophysiology. Nevertheless, prior feature engineering based approaches require extracting various domain knowledge related features at a high time cost. Moreover, traditional fusion method cannot fully utilise correlation information between different channels and frequency components. In this paper, we design a hybrid deep learning model, in which the 'Convolutional Neural Network (CNN)' is utilised for extracting task-related features, as well as mining inter-channel and inter-frequency correlation, besides, the 'Recurrent Neural Network (RNN)' is concatenated for integrating contextual information from the frame cube sequence. Experiments are carried out in a trial-level emotion recognition task, on the DEAP benchmarking dataset. Experimental results demonstrate that the proposed framework outperforms the classical methods, with regard to both of the emotional dimensions of Valence and Arousal

The Translocal Event and the Polyrhythmic Diagram

This thesis identifies and analyses the key creative protocols in translocal performance practice, and ends with suggestions for new forms of transversal live and mediated performance practice, informed by theory. It argues that ontologies of emergence in dynamic systems nourish contemporary practice in the digital arts. Feedback in self-organised, recursive systems and organisms elicit change, and change transforms. The arguments trace concepts from chaos and complexity theory to virtual multiplicity, relationality, intuition and individuation (in the work of Bergson, Deleuze, Guattari, Simondon, Massumi, and other process theorists). It then examines the intersection of methodologies in philosophy, science and art and the radical contingencies implicit in the technicity of real-time, collaborative composition. Simultaneous forces or tendencies such as perception/memory, content/ expression and instinct/intellect produce composites (experience, meaning, and intuition- respectively) that affect the sensation of interplay. The translocal event is itself a diagram - an interstice between the forces of the local and the global, between the tendencies of the individual and the collective. The translocal is a point of reference for exploring the distribution of affect, parameters of control and emergent aesthetics. Translocal interplay, enabled by digital technologies and network protocols, is ontogenetic and autopoietic; diagrammatic and synaesthetic; intuitive and transductive. KeyWorx is a software application developed for realtime, distributed, multimodal media processing. As a technological tool created by artists, KeyWorx supports this intuitive type of creative experience: a real-time, translocal “jamming” that transduces the lived experience of a “biogram,” a synaesthetic hinge-dimension. The emerging aesthetics are processual – intuitive, diagrammatic and transversal

Methods of Paradox

Despite growing scholarly interest in paradoxes, few studies have expressly engaged with the methodological mechanics of ‘doing’ paradox research. First, there are no clearly established guidelines regarding what should count as paradox in research endeavors. Second, there is uncertainty around who sees/thinks/experiences the paradox and what is relevant when it comes to the emergence, choice, interpretation and appropriation of paradoxes in empirical settings. Third, there is still confusion around where one can find evidence of paradoxes. This book chapter aims to shed some light on these methodological shortcomings. We suggest that paradox researchers can deal with these methodological challenges by 1) showing evidence of contradictory, interrelated, simultaneous and persistent paradoxical tensions in the empirical setting, 2) developing reliable and flexible protocols for paradox identification, 3) pushing for multi-level paradox studies, 4) practicing reflexivity, 5) staying close to the context, and 6) leveraging multi-modality

Methods of Paradox

Despite growing scholarly interest in paradoxes, few studies have expressly engaged with the methodological mechanics of ‘doing’ paradox research. First, there are no clearly established guidelines regarding what should count as paradox in research endeavors. Second, there is uncertainty around who sees/thinks/experiences the paradox and what is relevant when it comes to the emergence, choice, interpretation and appropriation of paradoxes in empirical settings. Third, there is still confusion around where one can find evidence of paradoxes. This book chapter aims to shed some light on these methodological shortcomings. We suggest that paradox researchers can deal with these methodological challenges by 1) showing evidence of contradictory, interrelated, simultaneous and persistent paradoxical tensions in the empirical setting, 2) developing reliable and flexible protocols for paradox identification, 3) pushing for multi-level paradox studies, 4) practicing reflexivity, 5) staying close to the context, and 6) leveraging multi-modality

Bridging the gap between emotion and joint action

Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through embodied presence in a group, and how joint action changes individual emotion. In fact, the multi-agent component is largely missing from neuroscience-based approaches to emotion, and reversely joint action research has not found a way yet to include emotion as one of the key parameters to model socio-motor interaction. In this review, we first identify the gap and then stockpile evidence showing strong entanglement between emotion and acting together from various branches of sciences. We propose an integrative approach to bridge the gap, highlight five research avenues to do so in behavioral neuroscience and digital sciences, and address some of the key challenges in the area faced by modern societies

A Review of the Travel Behavior Analysis: Its Basis and Application for Developing Cities

Travel, most often viewed in theory as derived from the demand for activity participation, has almost always been modeled on the trip-based basis, i.e., the trip is treated as the unit of analysis. Attributes of a trip (e.g., its origin and destination, mode, length) have been the subjects of analysis, but not the types of activities engaged in, their durations, sequences, and timing. This paper offers a brief review of the travel behavior analysis in order to provide a better understanding and forecasting of travel behavior. The article further offers discussions on its possible applications in urban areas of developing countries where historical accumulations of transportation and communications technologies are being introduced within a short span of time, creating the environment for travel which may not be properly accounted for using the conventional trip-based models of travel demand. In addition, the dataset from Malaysia was employed as a case of study