Use a Spoon as a Spade?: Changes in the Upper and Lower Alpha Bands in Evaluating Alternate Object Use

Previous electrophysiological research on human creative cognition has related creative ideation to increased activity in the alpha band, an effect which mainly reflects increased general attentional demands. Research on alpha unrelated to creativity has revealed different functional roles of the upper (semantic processes) and lower (attentional processes) alpha sub-bands. At the same time, the need to dissect creative thinking into specific cognitive operations, such as, semantic processing, re-representation, or conceptual expansion has become evident. The main aim of the reported study was to test whether increased semantic processing demands linked to creating conceptual re-representations of objects required for evaluating alternate uses modulate activity in the upper and/or lower alpha sub-bands. For this purpose, we performed an alternate use evaluation task (AUeT), in which participants saw word pairs representing common uses, alternate uses, and unrelated word pairs, and evaluated whether a given use was common or uncommon (question 1), and how usable it was (question 2). Such an approach allowed us to examine the time-course of semantic processing involved in evaluating alternate uses. Additionally, the results could be contrasted with event-related potential (ERP) studies on creative language and semantic processing. We assumed that demands related to access and integration of semantic information needed to create a re-representation of objects (alternate uses) would be larger than in the case of common uses, which do not require creating a re-representation. This should be reflected in more activity in the alpha band in response to alternate than common uses, which was observed in the analysis of the upper alpha band over parieto-occipital sites. In the lower alpha band, more activity over the left than right anterior sites was observed for alternate uses, which might reflect increased attentional demands. Additionally, in the ERP analysis, alternate uses evoked larger N400 (400–500 ms) amplitudes than common uses, a pattern that extended to later time windows (500–1,000 ms). Overall, the results indicate increased semantic processing demands in alternate use evaluation, possibly linked to the creation of conceptual re-representations

A Semantic Map for Evaluating Creativity

We present a semantic map of words related with creativity. The aim is to empirically derive terms which can be used to rate processes or products of computational creativity. The words in the map are based on association studies performed by human subjects and augmented with words derived from the literature (based on human raters). The words are used in a card sorting study to investigate the way they are categorized by human subjects. The results are arranged in a heat map of word relations based on a hierarchical cluster analysis. The cluster analysis and a principal component analysis provide a set of five to six clusters of items related to each other, and as clusters related to creativity. These clusters could form a basis for scales used to rate aspects of computational creativity

Emotion Recognition in Dementia: Advancing technology for multimodal analysis of emotion expression in everyday life

This paper provides an overview of my PhD project that focuses on recognizing emotions in dementia by analyzing multi-modal expressions in autobiographical memories of older adults with dementia. The project aims for a better understanding how dementia influences emotional expressions and how dementia differs from the normal aging process. For this reason, spontaneous emotions will be elicited in autobiographical memories in two groups of older adults, one with dementia the other without, for comparison. Audio, video and physiological data will be collected at their home resulting in real-life environments. The emotional expressions can then be analyzed by extracting verbal, non-verbal, facial and gestural features from the audio, video and physiological data collected. In addition, a longitudinal study will be conducted with the older adults with dementia to investigate the longitudinal effect of dementia on emotions. A database of the emotional memories of these vulnerable groups will then be developed to contribute to the advancement of technologies for (automatic) multi-modal emotion recognition. The database will then be made available for the research community. Lastly, we will also develop visualization and statistical models to assess multi-modal patterns of emotion expression in these groups

Use a Spoon as a Spade?: Changes in the Upper and Lower Alpha Bands in Evaluating Alternate Object Use

Previous electrophysiological research on human creative cognition has related creative ideation to increased activity in the alpha band, an effect which mainly reflects increased general attentional demands. Research on alpha unrelated to creativity has revealed different functional roles of the upper (semantic processes) and lower (attentional processes) alpha sub-bands. At the same time, the need to dissect creative thinking into specific cognitive operations, such as, semantic processing, re-representation, or conceptual expansion has become evident. The main aim of the reported study was to test whether increased semantic processing demands linked to creating conceptual re-representations of objects required for evaluating alternate uses modulate activity in the upper and/or lower alpha sub-bands. For this purpose, we performed an alternate use evaluation task (AUeT), in which participants saw word pairs representing common uses, alternate uses, and unrelated word pairs, and evaluated whether a given use was common or uncommon (question 1), and how usable it was (question 2). Such an approach allowed us to examine the time-course of semantic processing involved in evaluating alternate uses. Additionally, the results could be contrasted with event-related potential (ERP) studies on creative language and semantic processing. We assumed that demands related to access and integration of semantic information needed to create a re-representation of objects (alternate uses) would be larger than in the case of common uses, which do not require creating a re-representation. This should be reflected in more activity in the alpha band in response to alternate than common uses, which was observed in the analysis of the upper alpha band over parieto-occipital sites. In the lower alpha band, more activity over the left than right anterior sites was observed for alternate uses, which might reflect increased attentional demands. Additionally, in the ERP analysis, alternate uses evoked larger N400 (400-500 ms) amplitudes than common uses, a pattern that extended to later time windows (500-1,000 ms). Overall, the results indicate increased semantic processing demands in alternate use evaluation, possibly linked to the creation of conceptual re-representations

Introducing MULAI: A Multimodal Database of Laughter during Dyadic Interactions

Although laughter has gained considerable interest from a diversity of research areas, there still is a need for laughter specific databases. We present the Multimodal Laughter during Interaction (MULAI) database to study the expressive patterns of conversational and humour related laughter. The MULAI database contains 2 hours and 14 minutes of recorded and annotated dyadic human-human interactions and includes 601 laughs, 168 speech-laughs and 538 on- or offset respirations. This database is unique in several ways; 1) it focuses on different types of social laughter including conversational- and humour related laughter, 2) it contains annotations from participants, who understand the social context, on how humourous they perceived themselves and their interlocutor during each task, and 3) it contains data rarely captured by other laughter databases including participant personality profiles and physiological responses. We use the MULAI database to explore the link between acoustic laughter properties and annotated humour ratings over two settings. The results reveal that the duration, pitch and intensity of laughs from participants do not correlate with their own perception of how humourous they are, however the acoustics of laughter do correlate with how humourous they are being perceived by their conversational partne

MEMOA: Introducing the Multi-Modal Emotional Memories of Older Adults Database

In order to contribute to the need of spontaneous multi-modal affective databases for the automatic recognition of emotions in older adults, this paper presents a novel Dutch multi-modal database consisting of emotional memories of older adults. The data consists of positive and negative memories of older adults eliciting through two emotion reliving tasks: autobiographical memory recall in the first session and life story books to discuss these memories in depth in the second session. Data collection was carried out at the participants' home or at a place comfortable to them. Audio was recorded for the first session whereas audio, video and physiological data were recorded for the second session. As this database introduces a novel way of using autobiographical memories to study emotional expressions in older adults, a first step of the complex coding of emotions is presented in this paper. We reflect on the challenges encountered in the database and propose ways to address these issues