Skip to main content
Article thumbnail
Location of Repository

An empirical study of the effect of agent competence on user performance and perception

By Jun Xiao, John Stasko and Richard Catrambone


We studied the role of the competence of an interface agent that helped users to learn and use a text editor. Participants in the study made a set of changes to a document with the aid of one of four interface agents. The agent would respond to participants ’ spoken questions as well as make proactive suggestions using a synthesized voice. The agents varied in the quality of responses and suggestions. One group of participants could also access a help screen. Results revealed that the perceived utility of the agent was influenced by the types of errors it made, while participants ' subjective impressions of the agent related to the perceptions of its embodiment. Additionally, allowing participants to choose their preferred assistance styles improved objective performance. We relate quantitative findings with qualitative interview data and discuss implications for the design and the implementation of systems with interface agents

Topics: interface agents, empirical evaluation, Wizard-of-Oz technique, qualitative
Publisher: IEEE Computer Society
Year: 2004
OAI identifier: oai:CiteSeerX.psu:
Provided by: CiteSeerX
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • (external link)
  • (external link)
  • Suggested articles

    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.