Deep fusion of multi-channel neurophysiological signal for emotion recognition and monitoring

How to fuse multi-channel neurophysiological signals for emotion recognition is emerging as a hot research topic in community of Computational Psychophysiology. Nevertheless, prior feature engineering based approaches require extracting various domain knowledge related features at a high time cost. Moreover, traditional fusion method cannot fully utilise correlation information between different channels and frequency components. In this paper, we design a hybrid deep learning model, in which the 'Convolutional Neural Network (CNN)' is utilised for extracting task-related features, as well as mining inter-channel and inter-frequency correlation, besides, the 'Recurrent Neural Network (RNN)' is concatenated for integrating contextual information from the frame cube sequence. Experiments are carried out in a trial-level emotion recognition task, on the DEAP benchmarking dataset. Experimental results demonstrate that the proposed framework outperforms the classical methods, with regard to both of the emotional dimensions of Valence and Arousal

An ideal model of an assistive technology assessment and delivery process

The purpose of the present work is to present some aspects of the Assistive Technology Assessment (ATA) process model compatible with the Position Paper 2012 by AAATE/EASTIN. Three aspects of the ATA process will be discussed in light of three topics of the Position Paper 2012: (i) The dimensions and the measures of the User eXperience (UX) evaluation modelled in the ATA process as a way to verify the efficient and the evidence-based practices of an AT service delivery centre; (ii) The relevance of the presence of the psychologist in the multidisciplinary team of an AT service delivery centre as necessary for a complete person-centred assistive solution empowering users to make their own choices; (iii) The new profession of the psychotechnologist, who explores users needs by seeking a proper assistive solution, leading the multidisciplinary team to observe critical issues and problems. Through the foundation of the Position Paper 2012, the 1995 HEART study, the Matching Person and Technology model, the ICF framework, and the pillars of the ATA process, this paper sets forth a concept and approach that emphasise the personal factors of the individual consumer and UX as key to positively impacting a successful outcome and AT solution

Video summarisation: A conceptual framework and survey of the state of the art

This is the post-print (final draft post-refereeing) version of the article. Copyright @ 2007 Elsevier Inc.Video summaries provide condensed and succinct representations of the content of a video stream through a combination of still images, video segments, graphical representations and textual descriptors. This paper presents a conceptual framework for video summarisation derived from the research literature and used as a means for surveying the research literature. The framework distinguishes between video summarisation techniques (the methods used to process content from a source video stream to achieve a summarisation of that stream) and video summaries (outputs of video summarisation techniques). Video summarisation techniques are considered within three broad categories: internal (analyse information sourced directly from the video stream), external (analyse information not sourced directly from the video stream) and hybrid (analyse a combination of internal and external information). Video summaries are considered as a function of the type of content they are derived from (object, event, perception or feature based) and the functionality offered to the user for their consumption (interactive or static, personalised or generic). It is argued that video summarisation would benefit from greater incorporation of external information, particularly user based information that is unobtrusively sourced, in order to overcome longstanding challenges such as the semantic gap and providing video summaries that have greater relevance to individual users

Auditory Experiences in Game Transfer Phenomena:

This study investigated gamers’ auditory experiences as after effects of playing. This was done by classifying, quantifying, and analysing 192 experiences from 155 gamers collected from online videogame forums. The gamers’ experiences were classified as: (i) auditory imagery (e.g., constantly hearing the music from the game), (ii) inner speech (e.g., completing phrases in the mind), (iii) auditory misperceptions (e.g., confusing real life sounds with videogame sounds), and (iv) multisensorial auditory experiences (e.g., hearing music while involuntary moving the fingers). Gamers heard auditory cues from the game in their heads, in their ears, but also coming from external sources. Occasionally, the vividness of the sound evoked thoughts and emotions that resulted in behaviours and copying strategies. The psychosocial implications of the gamers’ auditory experiences are discussed. This study contributes to the understanding of the effects of auditory features in videogames, and to the phenomenology of non-volitional experiences (e.g., auditory imagery, auditory hallucinations)

Acoustical properties in inhaling singing : a case-study

A highly experienced versatile female professional singer displaying no apparent vocal complaint, developed inhaling singing, an innovative approach to reverse phonation. Although there are some reports in literature that describe the characteristics of ingressive phonation and sounds, to the best of our knowledge, no reports on actual inhaling singing are available in literature. This paper reports a case study on the acoustical analysis of inhaling singing, comparing this innovative technique with traditional exhaling singing. As this is rather undiscovered territory, we have decided to address several questions: is it possible to match the same pitches using inhaling singing compared to exhaling singing? Is the harmonic structure and energy distribution similar? Is it possible to maintain the same phonation duration in both techniques? Are there differences in volume and tessitura (vocal range)? This paper, reporting on the experience of one individual, demonstrates that a tessitura can be mastered in inhaling singing. Spectral analysis reveals a similar frequency distribution in both conditions. However, in inhaling singing the energy of the harmonics is significantly lower for the first 3 overtones, while the maximum phonation time is larger, than in exhaling singing. The singer reports that less effort is required for inhaling singing in the high register. As such, inhaling singing offers new possibilities for vocal performance