6,614 research outputs found
Affect-based information retrieval
One of the main challenges Information Retrieval (IR) systems face nowadays originates from the semantic gap problem: the semantic difference between a user’s query representation and the internal representation of an information item in a collection. The gap is further widened when the user is driven by an ill-defined information need, often the result of an anomaly in his/her current state of knowledge. The formulated search queries, which are submitted to the retrieval systems to locate relevant items, produce poor results that do not address the users’ information needs.
To deal with information need uncertainty IR systems have employed in the past a range of feedback techniques, which vary from explicit to implicit. The first category of feedback techniques necessitates the communication of explicit relevance judgments, in return for better query reformulations and recommendations of relevant results. However, the latter happens at the expense of users’ cognitive resources and, furthermore, introduces an additional layer of complexity to the search process. On the other hand, implicit feedback techniques make inferences on what is relevant based on observations of user search behaviour. By doing so, they disengage users from the cognitive burden of document rating and relevance assessments. However, both categories of RF techniques determine topical relevance with respect to the cognitive and situational levels of interaction, failing to acknowledge the importance of emotions in cognition and decision making.
In this thesis I investigate the role of emotions in the information seeking process and develop affective feedback techniques for interactive IR. This novel feedback framework aims to aid the search process and facilitate a more natural and meaningful interaction. I develop affective models that determine topical relevance based on information gathered from various sensory channels, and enhance their performance using personalisation techniques. Furthermore, I present an operational video retrieval system that employs affective feedback to enrich user profiles and offers meaningful recommendations of unseen videos.
The use of affective feedback as a surrogate for the information need is formalised as the Affective Model of Browsing. This is a cognitive model that motivates the use of evidence extracted from the psycho-somatic mobilisation that occurs during cognitive appraisal. Finally, I address some of the ethical and privacy issues that arise from the social-emotional interaction between users and computer systems. This study involves questionnaire data gathered over three user studies, from 74 participants of different educational background, ethnicity and search experience. The results show that affective feedback is a promising area of research and it can improve many aspects of the information seeking process, such as indexing, ranking and recommendation. Eventually, it may be that relevance inferences obtained from affective models will provide a more robust and personalised form of feedback, which will allow us to deal more effectively with issues such as the semantic gap
Report on the Information Retrieval Festival (IRFest2017)
The Information Retrieval Festival took place in April 2017 in Glasgow. The focus of the workshop was to bring together IR researchers from the various Scottish universities and beyond in order to facilitate more awareness, increased interaction and reflection on the status of the field and its future. The program included an industry session, research talks, demos and posters as well as two keynotes. The first keynote was delivered by Prof. Jaana Kekalenien, who provided a historical, critical reflection of realism in Interactive Information Retrieval Experimentation, while the second keynote was delivered by Prof. Maarten de Rijke, who argued for more Artificial Intelligence usage in IR solutions and deployments. The workshop was followed by a "Tour de Scotland" where delegates were taken from Glasgow to Aberdeen for the European Conference in Information Retrieval (ECIR 2017
Search Process as Transitions Between Neural States
Search is one of the most performed activities on the World Wide
Web. Various conceptual models postulate that the search process
can be broken down into distinct emotional and cognitive states
of searchers while they engage in a search process. These models
significantly contribute to our understanding of the search process.
However, they are typically based on self-report measures, such as
surveys, questionnaire, etc. and therefore, only indirectly monitor
the brain activity that supports such a process. With this work,
we take one step further and directly measure the brain activity
involved in a search process. To do so, we break down a search
process into five time periods: a realisation of Information Need,
Query Formulation, Query Submission, Relevance Judgment and
Satisfaction Judgment. We then investigate the brain activity between
these time periods. Using functional Magnetic Resonance
Imaging (fMRI), we monitored the brain activity of twenty-four participants
during a search process that involved answering questions
carefully selected from the TREC-8 and TREC 2001 Q/A Tracks.
This novel analysis that focuses on transitions rather than states
reveals the contrasting brain activity between time periods – which
enables the identification of the distinct parts of the search process
as the user moves through them. This work, therefore, provides an
important first step in representing the search process based on the
transitions between neural states. Discovering more precisely how
brain activity relates to different parts of the search process will
enable the development of brain-computer interactions that better
support search and search interactions, which we believe our study
and conclusions advance
Computational and Psycho-Physiological Investigations of Musical Emotions
The ability of music to stir human emotions is a well known fact (Gabrielsson & Lindstrom.
2001). However, the manner in which music contributes to those experiences remains
obscured. One of the main reasons is the large number of syndromes that characterise
emotional experiences. Another is their subjective nature: musical emotions can be
affected by memories, individual preferences and attitudes, among other factors (Scherer
& Zentner, 2001). But can the same music induce similar affective experiences in all
listeners, somehow independently of acculturation or personal bias? A considerable
corpus of literature has consistently reported that listeners agree rather strongly about
what type of emotion is expressed in a particular piece or even in particular moments or
sections (Juslin & Sloboda, 2001). Those studies suggest that music features encode
important characteristics of affective experiences, by suggesting the influence of various
structural factors of music on emotional expression. Unfortunately, the nature of these
relationships is complex, and it is common to find rather vague and contradictory
descriptions.
This thesis presents a novel methodology to analyse the dynamics of emotional
responses to music. It consists of a computational investigation, based on spatiotemporal
neural networks sensitive to structural aspects of music, which "mimic" human affective
responses to music and permit to predict new ones. The dynamics of emotional
responses to music are investigated as computational representations of perceptual
processes (psychoacoustic features) and self-perception of physiological activation
(peripheral feedback). Modelling and experimental results provide evidence suggesting
that spatiotemporal patterns of sound resonate with affective features underlying
judgements of subjective feelings. A significant part of the listener's affective response
is predicted from the a set of six psychoacoustic features of sound - tempo, loudness,
multiplicity (texture), power spectrum centroid (mean pitch), sharpness (timbre) and
mean STFT flux (pitch variation) - and one physiological variable - heart rate. This work
contributes to new evidence and insights to the study of musical emotions, with particular
relevance to the music perception and emotion research communities
Role of emotion in information retrieval
The main objective of Information Retrieval (IR) systems is to satisfy searchers’ needs. A great deal of research has been conducted in the past to attempt to achieve a better insight into searchers’ needs and the factors that can potentially influence the success of an Information Retrieval and Seeking (IR&S) process.
One of the factors which has been considered is searchers’ emotion. It has been shown in previous research that emotion plays an important role in the success of an IR&S process, which has the purpose of satisfying an information need. However, these previous studies do not give a sufficiently prominent position to emotion in IR, since they limit the role of emotion to a secondary factor, by assuming that a lack of knowledge (the need for information) is the primary factor (the motivation of the search).
In this thesis, we propose to treat emotion as the principal factor in the system of needs of a searcher, and therefore one that ought to be considered by the retrieval algorithms. We present a more realistic view of searchers’ needs by considering not only theories from information retrieval and science, but also from psychology, philosophy, and sociology. We extensively report on the role of emotion in every aspect of human behaviour, both at an individual and social level. This serves not only to modify the current IR views of emotion, but more importantly to uncover social situations where emotion is the primary factor (i.e., source of motivation) in an IR&S process.
We also show that the emotion aspect of documents plays an important part in satisfying the searcher’s need, in particular when emotion is indeed a primary factor. Given the above, we define three concepts, called emotion need, emotion object and emotion relevance, and present a conceptual map that utilises these concepts in IR tasks and scenarios.
In order to investigate the practical concepts such as emotion object and emotion relevance in a real-life application, we first study the possibility of extracting emotion from text, since this is the first pragmatic challenge to be solved before any IR task can be tackled. For this purpose, we developed a text-based emotion extraction system and demonstrate that it outperforms other available emotion extraction approaches.
Using the developed emotion extraction system, the usefulness of the practical concepts mentioned above is studied in two scenarios: movie recommendation and news diversification.
In the movie recommendation scenario, two collaborative filtering (CF) models were proposed. CF systems aim to recommend items to a user, based on the information gathered from other users who have similar interests. CF techniques do not handle data sparsity well, especially in the case of the cold start problem, where there is no past rating for an item. In order to predict the rating of an item for a given user, the first and second models rely on an extension of state-of-the-art memory-based and model-based CF systems. The features used by the models are two emotion spaces extracted from the movie plot summary and the reviews made by users, and three semantic spaces, namely, actor, director, and genre. Experiments with two MovieLens datasets show that the inclusion of emotion information significantly improves the accuracy of prediction when compared with the state-of-the-art CF techniques, and also tackles data sparsity issues.
In the news retrieval scenario, a novel way of diversifying results, i.e., diversifying based on the emotion aspect of documents, is proposed. For this purpose, two approaches are introduced to consider emotion features for diversification, and they are empirically tested on the TREC 678 Interactive Track collection. The results show that emotion features are capable of enhancing retrieval effectiveness.
Overall, this thesis shows that emotion plays a key role in IR and that its importance needs to be considered. At a more detailed level, it illustrates the crucial part that emotion can play in
• searchers, both as a primary (emotion need) and secondary factor (influential role) in an IR&S process;
• enhancing the representation of a document using emotion features (emotion object); and finally,
• improving the effectiveness of IR systems at satisfying searchers’ needs (emotion relevance)
- …