A Meta-Analysis on the Determinants of Online Review Helpfulness

Online consumer reviews can help customers decrease uncertainty and risk faced in online shopping. However, information overload and conflicting comments in online reviews can get consumers confused. Therefore, it is important for both researchers and practitioners to understand the characteristics of helpful reviews. But studies examining the determinants of perceived review helpfulness produce mixed findings. We review extant research about the determinant factors of perceived helpfulness. Conflicting findings exist for six review related factors, namely review extremity, review readability, review total votes, linear review rating, quadratic review rating, and review sentiment. We conduct a meta-analysis to reconcile the contradictory findings on the influence of review related factors over perceived review helpfulness. The meta-analysis results confirm that review extremity, readability, total votes, and positive sentiment have a negative influence on helpfulness, but review rating is positively related to helpfulness. We also examine those studies whose findings are contradictive with the meta-analysis results. Measure discrepancy and reviewed product type are the two main reasons why mixed findings exist in extant research

Estimating the Socio-Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics

With the rapid growth of the Internet, the ability of users to create and publish content has created active electronic communities that provide a wealth of product information. However, the high volume of reviews that are typically published for a single product makes harder for individuals as well as manufacturers to locate the best reviews and understand the true underlying quality of a product. In this paper, we re-examine the impact of reviews on economic outcomes like product sales and see how different factors affect social outcomes like the extent of their perceived usefulness. Our approach explores multiple aspects of review text, such as lexical, grammatical, semantic, and stylistic levels to identify important text-based features. In addition, we also examine multiple reviewer-level features such as average usefulness of past reviews and the self-disclosed identity measures of reviewers that are displayed next to a review. Our econometric analysis reveals that the extent of subjectivity, informativeness, readability, and linguistic correctness in reviews matters in influencing sales and perceived usefulness. Reviews that have a mixture of objective, and highly subjective sentences have a negative effect on product sales, compared to reviews that tend to include only subjective or only objective information. However, such reviews are considered more informative (or helpful) by the users. By using Random Forest based classifiers, we show that we can accurately predict the impact of reviews on sales and their perceived usefulness. Reviews for products that have received widely fluctuating reviews, also have reviews of widely fluctuating helpfulness. In particular, we find that highly detailed and readable reviews can have low helpfulness votes in cases when users tend to vote negatively not because they disapprove of the review quality but rather to convey their disapproval of the review polarity. We examine the relative importance of the three broad feature categories: `reviewer-related' features, `review subjectivity' features, and `review readability' features, and find that using any of the three feature sets results in a statistically equivalent performance as in the case of using all available features. This paper is the first study that integrates econometric, text mining, and predictive modeling techniques toward a more complete analysis of the information captured by user-generated online reviews in order to estimate their socio-economic impact. Our results can have implications for judicious design of opinion forums

Evaluating online review helpfulness based on Elaboration Likelihood Model: the moderating role of readability

It is important to understand factors affecting the perceived online review helpfulness as it helps solve the problem of information overload in online shopping. Moreover, it is also crucial to explore the factors’ relative importance in predicting review helpfulness in order to effectively detect potential helpful reviews before they exert influences. Applying Elaboration Likelihood Model (ELM), this study first investigates the effects of central cues (review subjectivity and elaborateness) and peripheral cues (reviewer rank) on review helpfulness with readability as a moderator. Second, it also explores their relative predicting power using the machine learning technique. ELM is tested in online context and the results are compared between experience and search goods. Our results provide evidence that for both types of products review subjectivity can play a more significant role when the content readability is high. Furthermore, this study reveals that the dominant predictor is varied for different product types

Prediction of Helpful Reviews using Emotions Extraction

Reviews keep playing an increasingly important role in the decision process of buying products and booking hotels. However, the large amount of available information can be confusing to users. A more succinct interface, gathering only the most helpful reviews, can reduce information processing time and save effort. To create such an interface in real time, we need reliable prediction algorithms to classify and predict new reviews which have not been voted but are potentially helpful. So far such helpfulness prediction algorithms have benefited from structural aspects, such as the length and readability score. Since emotional words are at the heart of our written communication and are powerful to trigger listeners’ attention, we believe that emotional words can serve as important parameters for predicting helpfulness of review text. Using GALC, a general lexicon of emotional words associated with a model representing 20 different categories, we extracted the emotionality from the review text and applied supervised classification method to derive the emotion-based helpful review prediction. As the second contribution, we propose an evaluation framework comparing three different real-world datasets extracted from the most well-known product review websites. This framework shows that emotion-based methods are outperforming the structure-based approach, by up to 9%

Using Argument-based Features to Predict and Analyse Review Helpfulness

We study the helpful product reviews identification problem in this paper. We observe that the evidence-conclusion discourse relations, also known as arguments, often appear in product reviews, and we hypothesise that some argument-based features, e.g. the percentage of argumentative sentences, the evidences-conclusions ratios, are good indicators of helpful reviews. To validate this hypothesis, we manually annotate arguments in 110 hotel reviews, and investigate the effectiveness of several combinations of argument-based features. Experiments suggest that, when being used together with the argument-based features, the state-of-the-art baseline features can enjoy a performance boost (in terms of F1) of 11.01\% in average.Comment: 6 pages, EMNLP201

Book Reviews

Review by Shane Kraeger of Exegetical Guide to the Greek New Testament: Colossians and Philemon. by Murray J. Harris. Nashville: B&H Academic, 2010. xxxii + 272 pp., $24.99. Review by Joshua C. Stone of To Change the World: The Irony, Tragedy, and Possibility of Christianity in the Late Modern World by James Davison Hunter. Oxford: Oxford University Press, 2010, 358pp.,$27.95. Review by R. Lee Webb of Interpreting the Psalms for Teaching and Preaching. Eds. Herbert W. Bateman IV and D. Brent Sandy. St. Louis: Chalice Press, 2010, 292 pp., 34.99. Review by Roberto Rodriguez-Nunez of Augustine as Mentor: A Model for Preparing Spiritual Leaders by Edward L. Smither. Nashville, TN: B & H Academic, 2009, 264 pp., 12.23

Using Argument-based Features to Predict and Analyse Review Helpfulness

We study the helpful product reviews identification problem in this paper. We observe that the evidence-conclusion discourse relations, also known as arguments, often appear in product reviews, and we hypothesise that some argument-based features, e.g. the percentage of argumentative sentences, the evidences-conclusions ratios, are good indicators of helpful reviews. To validate this hypothesis, we manually annotate arguments in 110 hotel reviews, and investigate the effectiveness of several combinations of argument-based features. Experiments suggest that, when being used together with the argument-based features, the state-of-the-art baseline features can enjoy a performance boost (in terms of F1) of 11.01\% in average.Comment: 6 pages, EMNLP201

Revisiting Review Depth in Search for Helpful Online Reviews

This study investigates online review features that constitute review depth and assess their impacts on review helpfulness. It develops a model capturing the moderating effects of heuristic and systematic cues of an online review on the relationship between review length and its helpfulness. In particular, this study examines the moderating effects of price, product type, review readability and the presence of two-sided arguments. For testing the model, a dataset of 568,454 reviews from 256,059 different reviewers on Amazon.com were analyzed. The variables were operationalized using test processing techniques and relationships were empirically tested using regression and machine learning models. The results highlight significant moderating effects of review readability and the presence of two-sided arguments on the relationship between review length and its helpfulness. However, the results did not confirm the moderating effects of price and product type. This article discusses the significant implications for a better understanding of review depth and helpfulness in e-commerce platforms

Electronic word of mouth in social media: The common characteristics of retweeted and favourited marketer-generated content posted on Twitter

Marketers desire to utilise electronic word of mouth (eWOM) marketing on social media sites. However, not all online content generated by marketers has the same effect on consumers; some of them are effective while others are not. This paper aims to examine different characteristics of marketer-generated content (MGC) that of which one lead users to eWOM. Twitter was chosen as one of the leading social media sites and a content analysis approach was employed to identify the common characteristics of retweeted and favourited tweets. 2,780 tweets from six companies (Booking, Hostelworld, Hotels, Lastminute, Laterooms and Priceline) operating in the tourism sector are analysed. Results indicate that the posts which contain pictures, hyperlinks, product or service information, direct answers to customers and brand centrality are more likely to be retweeted and favourited by users. The findings present the main eWOM drivers for MGC in social media.Abdulaziz Elwalda and Mohammed Alsagga