Distribution of user-perceived usefulness of four presentation styles of opinion summarization

In this study, four opinion summarization styles were compared under an experimental environment. Thirty four participants sorted thirty two cards into five usefulness categories. Every eight cards belong to one presentation style. It was found that the users spent the shortest time on cards in “not at all useful” category. The time of viewing “extremely useful” cards was also shorter than that of “somewhat useful”, “useful”, and “very useful” cards. This result can be explained with the components of the usefulness categories. Tag clouds and Aspect oriented sentiments needed less time to view. They are the major styles in “not at all useful” and “extremely useful”. Paragraph summaries and Group samples requested more time and they took at least 50% in “somewhat useful”, “useful”, and “very useful”. The findings are consistent with our previous results

What Users Prefer and Why: A User Study on Effective Presentation Styles of Opinion Summarization

International audienceOpinion Summarization research addresses how to help people in making appropriate decisions in an effective way. This paper aims to help users in their decision-making by providing them effective opinion presentation styles. We carried out two phases of experiments to systematically compare usefulness of different types of opinion summarization techniques. In the first crowd-sourced study, we recruited 46 turkers to generate high quality summary information. This first phase generated four styles of summaries: Tag Clouds, Aspect Oriented Sentiments, Paragraph Summary and Group Sample. In the follow-up second phase, 34 participants tested the four styles in a card sorting experiment. Each participant was given 32 cards with 8 per presentation styles and completed the task of grouping the cards into five categories in terms of the usefulness of the cards. Results indicated that participants preferred Aspect Oriented Sentiments the most and Tag cloud the least. Implications and hypotheses are discussed