Skip to main content
Article thumbnail
Location of Repository

From Task-based Evaluation to Feature-based Evaluation in Personal Search

By Sargol Sadeghi, Mark Sanderson and Falk Scholer

Abstract

Task-based evaluation has been suggested as a solution for comparing search systems in the personal context. However, as personal search tasks are broad, dependent on users, and have different levels of specificity [3], focusing on the building blocks (or characteristics) of these tasks could provide a more reliable and maintainable alternative for evaluation. Moreover, the characteristics can be used to determine to what extent evaluation results are generalizable and comparable across different users and tasks. In this position paper, a characteristic reference model for personal search tasks will be introduced. Based on this model, different search systems can be compared not only in relation to task types, but also in terms of the characteristics that are most influential in search tasks, increasing the level of detail at which comparisons can be made

Topics: Performance, Design, Experimentation, Human Factors. Keywords Personal Search, Task-based Evaluation, Task, Search Characteristic
Year: 2014
OAI identifier: oai:CiteSeerX.psu:10.1.1.416.4731
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://citeseerx.ist.psu.edu/v... (external link)
  • http://ceur-ws.org/Vol-909/pos... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.