Skip to main content
Article thumbnail
Location of Repository

Evaluation of collecting reviews in centralized online reputation systems.

By Ling Liu, Malcolm Munro and William Song


Background: Centralized Online Reputation Systems (ORS) have been widely used by internet companies. They collect users’ opinions on products, transactions and events as reputation information then aggregate and publish the information to the public.\ud \ud Aim: Studies of reputation systems evaluation to date have tended to focus on isolated systems or their aggregating algorithms only. This paper proposes an evaluation mechanism to measure different reputation systems in the same context.\ud \ud Method: Reputation systems naturally have differing interfaces, and track different aspects of user behavior, however, from information system perspective, they all share five underlying components: Input, Processing Storage, Output and Feedback Loop. Therefore, reputation systems can be divided into these five components and measured by their properties respectively\ud \ud Results: The paper concentrates on the evaluation of Input and develops a set of simple formulas to represent the cost of reputation information collection. This is then applied to three different sites and the resulting analysis shows the pros and cons of the differing approaches of each of these sites

Topics: Online reputation systems, Evaluation, E-commerce.
Year: 2010
OAI identifier:

Suggested articles


  1. (2008). Not quite the average: An empirical study of web use. doi
  2. (2005). Performance evaluation of rating aggregation algorithms in reputation systems.
  3. (2007). Reputation management survey.
  4. (2005). Review on computational trust and reputation models. doi
  5. (2004). Slash(dot) and burn: distributed moderation in a large online conversation space.
  6. (2007). Social information processing in news aggregation. doi
  7. (2006). The value of reputation on ebay: A controlled experiment. doi
  8. (2005). The Wisdom of Crowds. doi
  9. (2000). Trust management through reputation mechanisms. doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.