Skip to main content
Article thumbnail
Location of Repository

Which user interaction for cross-language information retrieval? Design issues and reflections

By Daniela Petrelli, Stephen Levin, Micheline Beaulieu and Mark Sanderson


A novel and complex form of information access is cross-language information retrieval: searching for texts written in foreign languages based on native language queries. Although the underlying technology for achieving such a search is relatively well understood, the appropriate interface design is not. The authors present three user evaluations undertaken during the iterative design of Clarity, a cross-language retrieval system for low-density languages, and shows how the user-interaction design evolved depending on the results of usability tests. The first test was instrumental to identify weaknesses in both functionalities and interface; the second was run to determine if query translation should be shown or not; the final was a global assessment and focused on user satisfaction criteria. Lessons were learned at every stage of the process leading to a much more informed view of what a cross-language retrieval system should offer to users

Year: 2006
OAI identifier:

Suggested articles


  1. (2000). A Parents’ and Teachers’ Guide to Bilingualism.
  2. (2003). Beyond Borders - web globalization strategies. doi
  3. (1999). Breaking down Usability.
  4. (2001). Cross-Language Information Access through Phrase Browsing.
  5. (2000). Cross-Language Information Access to Multilingual Collections on the Internet.
  6. (2004). Cross-Lingual Document Retrieval, Categorization and Navigation Based on Distributed Services. In:
  7. (1998). Design and Evaluation of a Psychological Experiment on the Effectiveness of Document Summarisation for the Retrieval of Multilingual WWW Documents, Working notes of the AAAI Spring Symposium on Intelligent Text Summarisation. Stanfors
  8. (1998). Development of an instrument measuring user satisfaction of the human-computer interface. In:
  9. (1995). Evaluation of Evaluation of Information Retrieval.
  10. (2000). Experimental components for the evaluation of interactive information retrieval systems.
  11. (1973). Experiments in multi-lingual information retrieval,
  12. (1997). Experiments on Interfaces to Support Query Expansion.
  13. (2003). Fuzzy Translation of Cross-Lingual Spelling Variants.
  14. (2000). Helping People Find What They Don’t Know.
  15. (2003). iCLEF at Maryland: Translation Selection and Document Selection.
  16. (2002). Interaction design: Beyond human-computer interaction.
  17. (1999). Keizai: An Interactive Cross-Language Text Retrieval System. In
  18. (2003). Mouse or Rat? Translation as Negotiation.
  19. (2004). Observing Users - Designing Clarity: A Case Study on the User-Centred Design of a Cross-Language Information Retrieval System.
  20. (1992). On the evaluation of IR systems.
  21. (1997). Phrasal translation and query expansion techniques for crosslanguage information retrieval.
  22. (1996). Querying Across Languages: A Dictionary-Based Approach to Multilingual Information Retrieval.
  23. (2000). Reflections on Mira: Interactive Evaluation in Information Retrieval. In
  24. (1997). Relevance: The Whole History.
  25. (2004). Report on Effectiveness of Clarity System. D7-1. Available at (accessed 10.3.2004) Lopez-Ostenero
  26. (2003). Report on Effectiveness of User Feedback CLIR System. D6-2. Available at (accessed 10.3.2004)
  27. (1998). Resolving ambiguity for cross-language retrieval. In
  28. (1999). Should we Translate the Documents or the Queries in Cross-language Information Retrieval.
  29. (2002). The CLEF
  30. (2000). TREC-9 Cross-lingual Retrieval at BBN. TREC
  31. (1993). Usability engineering. New York: Academic Press. NTCIR homepage (accessed 1.3.2004) Oard,
  32. (1998). User and task analysis for interface design.Wiley.
  33. (2002). User Requirement Elicitation for Crosslanguage Information Retrieval.
  34. (1980). Verbal reports as data.

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.