Location of Repository

The Relationship between IR Effectiveness Measures and User Satisfaction

By A. Al-Maskari, M. Sanderson and P. Clough

Abstract

This paper presents an experimental study of users assessing the quality of Google web search results. In particular we look at how users' satisfaction correlates with the effectiveness of Google as quantified by IR measures such as precision and the suite of Cumulative Gain measures (CG, DCG, NDCG). Results indicate strong correlation between users' satisfaction, CG and precision, moderate correlation with DCG, with perhaps surprisingly negligible correlation with NDCG. The reasons for the low correlation with NDCG are examined

Publisher: ACM
OAI identifier: oai:eprints.whiterose.ac.uk:4508

Suggested articles

Preview


To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.