8 research outputs found
Evaluating Information Retrieval and Access Tasks
This open access book summarizes the first two decades of the NII Testbeds and Community for Information access Research (NTCIR). NTCIR is a series of evaluation forums run by a global team of researchers and hosted by the National Institute of Informatics (NII), Japan. The book is unique in that it discusses not just what was done at NTCIR, but also how it was done and the impact it has achieved. For example, in some chapters the reader sees the early seeds of what eventually grew to be the search engines that provide access to content on the World Wide Web, todayâs smartphones that can tailor what they show to the needs of their owners, and the smart speakers that enrich our lives at home and on the move. We also get glimpses into how new search engines can be built for mathematical formulae, or for the digital record of a lived human life. Key to the success of the NTCIR endeavor was early recognition that information access research is an empirical discipline and that evaluation therefore lay at the core of the enterprise. Evaluation is thus at the heart of each chapter in this book. They show, for example, how the recognition that some documents are more important than others has shaped thinking about evaluation design. The thirty-three contributors to this volume speak for the many hundreds of researchers from dozens of countries around the world who together shaped NTCIR as organizers and participants. This book is suitable for researchers, practitioners, and studentsâanyone who wants to learn about past and present evaluation efforts in information retrieval, information access, and natural language processing, as well as those who want to participate in an evaluation task or even to design and organize one
Abstracts: HASTAC 2017: The Possible Worlds of Digital Humanities
The document contains abstracts for HASTAC 2017
Recommended from our members
Exploring mobile trajectories: An investigation of individual spatial behaviour and geographic filters for information retrieval - Volume 1
This section presents both quantitative results, related to the performance of prediction surfaces according to the evaluation criteria described in section 3.5, and qualitative results, based upon testing geographic filters for information retrieval in an outdoor mobile computing environment as part of a major user evaluation study in the Swiss National Park, in the Summer of 2004.
The chapter begins with quantitative evaluation, where three test scenarios are described (walking, driving and daily migration), followed by a description of the systematic variation in the temporal component of prediction, designed to compare short-term (10 minutes) and long-term (60 minutes) predictions into future. Next, three geographic filters described in the methodology are introduced as prediction surfaces. The three filters are spatial proximity, temporal proximity and speed-heading predictions. For each approach, the prediction input parameters were varied in a systematic way to uncover the impact of buffer size and distance decay functions (for spatial proximity prediction surfaces), the ârecent behaviour periodâ, temporal weighting and decay function (for speed-heading prediction surfaces) and the time budget and enclosing function (for temporal proximity prediction surfaces). Next, the results are presented and analysed to describe, explain and contrast the characteristics of each prediction approach. This is followed by a brief assessment of the suitability of each approach to the scenarios in which it was tested.
Overall, predictions based upon temporal proximity are found to be more effective than speed-heading predictions, which in turn out are more effective than predictions based upon spatial proximity.
Finally, the chapter concludes with the results of the user evaluation study, which suggests that users of mobile information retrieval tools found the implemented âsearch aheadâ filter useful, are receptive to the idea of other geographic filters, and benefit from the use of personalised geographic information with a spatial and temporal component
Combining SOA and BPM Technologies for Cross-System Process Automation
This paper summarizes the results of an industry case study that introduced a cross-system business process automation solution based on a combination of SOA and BPM standard technologies (i.e., BPMN, BPEL, WSDL). Besides discussing major weaknesses of the existing, custom-built, solution and comparing them against experiences with the developed prototype, the paper presents a course of action for transforming the current solution into the proposed solution. This includes a general approach, consisting of four distinct steps, as well as specific action items that are to be performed for every step. The discussion also covers language and tool support and challenges arising from the transformation