Workshop on evaluating personal search

The first ECIR workshop on Evaluating Personal Search was held on 18th April 2011 in Dublin, Ireland. The workshop consisted of 6 oral paper presentations and several discussion sessions. This report presents an overview of the scope and contents of the workshop and outlines the major outcomes

A laboratory-based method for the evaluation of personalised search

Comparative evaluation of Information Retrieval Systems (IRSs) using publically available test collections has become an established practice in Information Retrieval (IR). By means of the popular Cranfield evaluation paradigm IR test collections enable researchers to compare new methods to existing approaches. An important area of IR research where this strategy has not been applied to date is Personalised Information Retrieval (PIR), which has generally relied on user-based evaluations. This paper describes a method that enables the creation of publically available extended test collections to allow repeatable laboratory-based evaluation of personalised search

Applying the KISS principle for the CLEF-IP 2010 prior art candidate patent search task

We present our experiments and results for the DCU CNGL participation in the CLEF-IP 2010 Candidate Patent Search Task. Our work applied standard information retrieval (IR) techniques to patent search. In addition, a very simple citation extraction method was applied to improve the results. This was our second consecutive participation in the CLEF-IP tasks. Our experiments in 2009 showed that many sophisticated approach to IR do not improve the retrieval effectiveness for this task. For this reason of we decided to apply only simple methods in 2010. These were demonstrated to be highly competitive with other participants. DCU submitted three runs for the Prior Art Candidate Search Task, two of these runs achieved the second and third ranks among the 25 runs submitted by nine different participants. Our best run achieved MAP of 0.203, recall of 0.618, and PRES of 0.523

LIKES: Educating the Next Generation of Knowledge Society Builders

Although information technology (IT) is used extensively in the education of all disciplines, the computing-related fields are facing tremendous challenges, such as declining student enrollment and a lack of representation from minorities and women. Strengthening the connection between computing and other fields could help instructors to integrate IT in their teaching and to support the learning of students, who will become the next generation of Knowledge Society builders. Presently, this connection is weak due to the lack of interdisciplinary collaboration and mutual understanding among faculty in computing and other fields. Our ongoing effort entitled “Living in the KnowlEdge Society (LIKES) Community Building Project” aims to build a community that will define a socially-relevant way to make systemic changes in how computing and IT concepts are taught and applied in both computing and other fields. In this paper, we review previous efforts in this area and summarize our project’s achievements and lessons learned. We also provide recommendations on integrating IT into other curricula and on strengthening interdisciplinary collaborations

Report on the Information Retrieval Festival (IRFest2017)

The Information Retrieval Festival took place in April 2017 in Glasgow. The focus of the workshop was to bring together IR researchers from the various Scottish universities and beyond in order to facilitate more awareness, increased interaction and reflection on the status of the field and its future. The program included an industry session, research talks, demos and posters as well as two keynotes. The first keynote was delivered by Prof. Jaana Kekalenien, who provided a historical, critical reflection of realism in Interactive Information Retrieval Experimentation, while the second keynote was delivered by Prof. Maarten de Rijke, who argued for more Artificial Intelligence usage in IR solutions and deployments. The workshop was followed by a "Tour de Scotland" where delegates were taken from Glasgow to Aberdeen for the European Conference in Information Retrieval (ECIR 2017