An affect-based video retrieval system with open vocabulary querying

Content-based video retrieval systems (CBVR) are creating new search and browse capabilities using metadata describing significant features of the data. An often overlooked aspect of human interpretation of multimedia data is the affective dimension. Incorporating affective information into multimedia metadata can potentially enable search using this alternative interpretation of multimedia content. Recent work has described methods to automatically assign affective labels to multimedia data using various approaches. However, the subjective and imprecise nature of affective labels makes it difficult to bridge the semantic gap between system-detected labels and user expression of information requirements in multimedia retrieval. We present a novel affect-based video retrieval system incorporating an open-vocabulary query stage based on WordNet enabling search using an unrestricted query vocabulary. The system performs automatic annotation of video data with labels of well defined affective terms. In retrieval annotated documents are ranked using the standard Okapi retrieval model based on open-vocabulary text queries. We present experimental results examining the behaviour of the system for retrieval of a collection of automatically annotated feature films of different genres. Our results indicate that affective annotation can potentially provide useful augmentation to more traditional objective content description in multimedia retrieval

Conflict monitoring in speech processing: an fMRI study of error detection in speech production and perception

To minimize the number of errors in speech, and thereby facilitate communication, speech is monitored before articulation. It is, however, unclear at which level during speech production monitoring takes place, and what mechanisms are used to detect and correct errors. The present study investigated whether internal verbal monitoring takes place through the speech perception system, as proposed by perception-based theories of speech monitoring, or whether mechanisms independent of perception are applied, as proposed by production-based theories of speech monitoring. With the use of fMRI during a tongue twister task we observed that error detection in internal speech during noise-masked overt speech production and error detection in speech perception both recruit the same neural network, which includes pre-supplementary motor area (pre-SMA), dorsal anterior cingulate cortex (dACC), anterior insula (AI), and inferior frontal gyrus (IFG). Although production and perception recruit similar areas, as proposed by perception-based accounts, we did not find activation in superior temporal areas (which are typically associated with speech perception) during internal speech monitoring in speech production as hypothesized by these accounts. On the contrary, results are highly compatible with a domain general approach to speech monitoring, by which internal speech monitoring takes place through detection of conflict between response options, which is subsequently resolved by a domain general executive center (e.g., the ACC)

Modeling Emotion Influence from Images in Social Networks

Images become an important and prevalent way to express users' activities, opinions and emotions. In a social network, individual emotions may be influenced by others, in particular by close friends. We focus on understanding how users embed emotions into the images they uploaded to the social websites and how social influence plays a role in changing users' emotions. We first verify the existence of emotion influence in the image networks, and then propose a probabilistic factor graph based emotion influence model to answer the questions of "who influences whom". Employing a real network from Flickr as experimental data, we study the effectiveness of factors in the proposed model with in-depth data analysis. Our experiments also show that our model, by incorporating the emotion influence, can significantly improve the accuracy (+5%) for predicting emotions from images. Finally, a case study is used as the anecdotal evidence to further demonstrate the effectiveness of the proposed model

Psychosocial implications ofblindness and low-vision

This article discusses several aspects of psychosocial adjustment to blindness andlow-vision and proposes that the education of both the self and society are essential forpositive adjustment. It exposes some of the general misunderstandings about visualimpairment and demonstrates how these are partly responsible for the perpetuation of mythsand misconceptions regarding the character and abilities of this population. It argues thatconfidence and self-esteem are deeply connected to ability and should be regarded asconstructive elements of the ego usually manifested in different types of introverted orextroverted behaviour. Wherever possible arguments will be backed by current and pastresearch in social and abnormal psychology as well as specific case studies recorded by theauthor during the years he spent conducting research and working as a life-skills tutor at theRoyal London Society for the Blind

Mind the Gap: Expressing affect with hyperbole and hyperbolic compounds

Hyperbole is traditionally understood as exaggeration. Instead, in this paper, we shall define it not just in terms of its form, but in terms of its effects and its purpose. Specifically, we characterize its form as a shift of magnitude along a scale of measurement. In terms of its effect, it uses this magnitude shift to make the target property more salient. The purpose of hyperbole is to express with colour and force that the target property is either greater or lesser than expected or desired. This purpose is well suited to hyperbolic expression. This because hyperbole naturally draws a contrast between two points: how things are versus how they were expected to be. We also consider compound figures involving hyperbole. When it combines with other figures hyperbole operates by magnifying the specific effects of the figure it operates on. We shall see that sometimes hyperbole works as an input for irony; and at other times it builds on a metaphor to increase the effects of that metaphor

Rahner\u27s Primordial Words and Bernstein\u27s Metaphorical Leaps: The Affinity of Art with Religion and Theology

Karl Rahner\u27s notion of primordial words and Leonard Bernstein\u27s conception of music as intrinsically metaphorical are engaged to suggest that there is a fundamental affinity between artistic and religious imagination. The affinity is grounded, in part at least, in metaphoric process—an elemental cognitive act in which the human spirit is stretched so that its expressions can address what lies beyond them