Estimating the Socio-Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics

With the rapid growth of the Internet, the ability of users to create and publish content has created active electronic communities that provide a wealth of product information. However, the high volume of reviews that are typically published for a single product makes harder for individuals as well as manufacturers to locate the best reviews and understand the true underlying quality of a product. In this paper, we re-examine the impact of reviews on economic outcomes like product sales and see how different factors affect social outcomes like the extent of their perceived usefulness. Our approach explores multiple aspects of review text, such as lexical, grammatical, semantic, and stylistic levels to identify important text-based features. In addition, we also examine multiple reviewer-level features such as average usefulness of past reviews and the self-disclosed identity measures of reviewers that are displayed next to a review. Our econometric analysis reveals that the extent of subjectivity, informativeness, readability, and linguistic correctness in reviews matters in influencing sales and perceived usefulness. Reviews that have a mixture of objective, and highly subjective sentences have a negative effect on product sales, compared to reviews that tend to include only subjective or only objective information. However, such reviews are considered more informative (or helpful) by the users. By using Random Forest based classifiers, we show that we can accurately predict the impact of reviews on sales and their perceived usefulness. Reviews for products that have received widely fluctuating reviews, also have reviews of widely fluctuating helpfulness. In particular, we find that highly detailed and readable reviews can have low helpfulness votes in cases when users tend to vote negatively not because they disapprove of the review quality but rather to convey their disapproval of the review polarity. We examine the relative importance of the three broad feature categories: `reviewer-related' features, `review subjectivity' features, and `review readability' features, and find that using any of the three feature sets results in a statistically equivalent performance as in the case of using all available features. This paper is the first study that integrates econometric, text mining, and predictive modeling techniques toward a more complete analysis of the information captured by user-generated online reviews in order to estimate their socio-economic impact. Our results can have implications for judicious design of opinion forums

Understanding, Analyzing and Predicting Online User Behavior

abstract: Due to the growing popularity of the Internet and smart mobile devices, massive data has been produced every day, particularly, more and more users’ online behavior and activities have been digitalized. Making a better usage of the massive data and a better understanding of the user behavior become at the very heart of industrial firms as well as the academia. However, due to the large size and unstructured format of user behavioral data, as well as the heterogeneous nature of individuals, it leveled up the difficulty to identify the SPECIFIC behavior that researchers are looking at, HOW to distinguish, and WHAT is resulting from the behavior. The difference in user behavior comes from different causes; in my dissertation, I am studying three circumstances of behavior that potentially bring in turbulent or detrimental effects, from precursory culture to preparatory strategy and delusory fraudulence. Meanwhile, I have access to the versatile toolkit of analysis: econometrics, quasi-experiment, together with machine learning techniques such as text mining, sentiment analysis, and predictive analytics etc. This study creatively leverages the power of the combined methodologies, and apply it beyond individual level data and network data. This dissertation makes a first step to discover user behavior in the newly boosting contexts. My study conceptualize theoretically and test empirically the effect of cultural values on rating and I find that an individualist cultural background are more likely to lead to deviation and more expression in review behaviors. I also find evidence of strategic behavior that users tend to leverage the reporting to increase the likelihood to maximize the benefits. Moreover, it proposes the features that moderate the preparation behavior. Finally, it introduces a unified and scalable framework for delusory behavior detection that meets the current needs to fully utilize multiple data sources.Dissertation/ThesisDoctoral Dissertation Business Administration 201

Natural language processing techniques for researching and improving peer feedback

Peer review has been viewed as a promising solution for improving studennts' writing, which still remains a great challenge for educators. However, one core problem with peer review of writing is that potentially useful feedbback from peers is not always presented in ways that lead to revision. Our prior investigations found that whether students implement feedback is significantly correlated with two feedback features: localization information and concrete solutions. But focusing on feedback features is time-intensive for researchers and instructors. We apply data mining and Natural Languagee Processing techniques to automatically code reviews for these feedback features. Our results show that it is feasible to provide intelligent suppport to peer review systems to automatically assess students' reviewing performance with respect to problem localization and solution. We also show that similar research conclusions about helpfulness perceptions of feedback across students and different expert types can be drawn from automatically coded data and from hand-coded data. © Earli

Assessing the effect of mobile word-of-mouth on consumers : the physical, psychological and social influences

Mobile technologies enable users to discover and research products anytime, anywhere. Mobile devices allow consumers to create and share content based on physical location, facilitate seamless interactions, and provide context-relevant information that can better satisfy users’ needs and enhance their shopping experience. As consumers increasingly rely on mobile devices to search information and purchase products, they need immediate, updated, informative and credible opinions in concise forms. Meanwhile, marketers face unprecedented opportunities for mobile marketing, making ever important for them to understand the mobile word-of-mouth and its effect on the purchase behaviors of consumers on the mobile platform vs. those on other devices. Drawing from the media richness theory and the principle of compensatory adaptation, study one performs sentiment analysis of online product reviews from both mobile and desktop devices by analyzing over one million customer reviews from Dianping.com. We find that mobile reviews are naturally shorter, contain more adverbs and adjectives, and have smaller readership and less votes of helpfulness. The product ratings from mobile reviews are more polarized yet the average valence of mobile reviews is higher. By comparison, desktop reviews contain more pictures and are rated more helpful. Lastly, pricy products receive more desktop reviews than mobile ones. Study two draws from the construal level theory and posit that WOM from mobile devices reflects closer psychological distances (temporal and social), thus constitutes a lower construal level than that from desktop computers. Using a dataset of over one million product reviews from Dianping.com, we assess the value of online product reviews from mobile devices in comparison with those from the desktop computers. Our findings show that WOM is more helpful when it is socially and temporally closer to the users and this effect is amplified when using mobile devices, which bring the mental construal to a low level and make others’ opinions more relevant. Further, we show that product type moderates the effect of online reviews in that m-WOM is more influential for hedonic products and its value for the utilitarian consumption is the lowest. Study three deploys the observational learning theory to examine the effect of WOM across the mobile and desktop devices on the purchase behavior of online promotional offers. The findings suggest that the effect of WOM on the purchase of promotion offers varies significantly across the platforms, product categories, and discount rates. These findings help better understand the strengths, limitations and the effect of m-WOM as marketers attempt to offer consumers context-sensitive and time-critical promotions through mobile devices and make a significant contribution to the literature on interactive marketing. These studies render meaningful implications for theory development about the role of mobile technologies in marketing and can assist practitioners formulating effective promotional strategies through the electronic channels via mobile and desktop devices

Rating and perceived helpfulness in a bipartite network of online product reviews

In many e-commerce platforms user communities share product information in the form of reviews and ratings to help other consumers to make their choices. This study develops a new theoretical framework generating a bipartite network of products sold by Amazon.com in the category “musical instruments”, by linking products through the reviews. We analyze product rating and perceived helpfulness of online customer reviews and the relationship between the centrality of reviews, product rating and the helpfulness of reviews using Clustering, regression trees, and random forests algorithms to, respectively, classify and find patterns in 2214 reviews. Results demonstrate: (1) that a high number of reviews do not imply a high product rating; (2) when reviews are helpful for consumer decision-making we observe an increase on the number of reviews; (3) a clear positive relationship between product rating and helpfulness of the reviews; and (4) a weak relationship between the centrality measures (betweenness and eigenvector) giving the importance of the product in the network, and the quality measures (product rating and helpfulness of reviews) regarding musical instruments. These results suggest that products may be central to the network, although with low ratings and with reviews providing little helpfulness to consumers. The findings in this study provide several important contributions for e-commerce businesses’ improvement of the review service management to support customers’ experiences and online customers’ decision-making.publishe

Bias at a Second Glance: A Deep Dive into Bias for German Educational Peer-Review Data Modeling

Natural Language Processing (NLP) has become increasingly utilized to provide adaptivity in educational applications. However, recent research has highlighted a variety of biases in pre-trained language models. While existing studies investigate bias in different domains, they are limited in addressing fine-grained analysis on educational and multilingual corpora. In this work, we analyze bias across text and through multiple architectures on a corpus of 9,165 German peer-reviews collected from university students over five years. Notably, our corpus includes labels such as helpfulness, quality, and critical aspect ratings from the peer-review recipient as well as demographic attributes. We conduct a Word Embedding Association Test (WEAT) analysis on (1) our collected corpus in connection with the clustered labels, (2) the most common pre-trained German language models (T5, BERT, and GPT-2) and GloVe embeddings, and (3) the language models after fine-tuning on our collected data-set. In contrast to our initial expectations, we found that our collected corpus does not reveal many biases in the co-occurrence analysis or in the GloVe embeddings. However, the pre-trained German language models find substantial conceptual, racial, and gender bias and have significant changes in bias across conceptual and racial axes during fine-tuning on the peer-review data. With our research, we aim to contribute to the fourth UN sustainability goal (quality education) with a novel dataset, an understanding of biases in natural language education data, and the potential harms of not counteracting biases in language models for educational tasks.Comment: Accepted as a full paper at COLING 2022: The 29th International Conference on Computational Linguistics, 12-17 of October 2022, Gyeongju, Republic of Kore

The Relationship Between Disclosing Purchase Information and Reputation Systems in Electronic Markets

In this work we investigate how the introduction of the Verified Purchase (VP) badge on Amazon.com affected both the review helpfulness and the product ratings. We first conduct a propensity score matching study and find that all else equal, camera reviews are on average ranked 7 positions higher than non-VP reviews, while book VP reviews are on average ranked 11 positions higher than non-VP reviews. Next, we use a natural experiment setting to identify whether the entry of the VP feature had an effect on the (1) overall review helpfulness (both VP and non-VP reviews), and (2) average product rating. Our results show that the introduction of VP caused an increase in review helpfulness of 7.7% for books, and 1.7% for electronics. Furthermore, it caused on average an increase of 20 and 18 positions in the ranks on book and electronic products respectively

Reviews Left and Right: The Link Between Reviewers’ Political Ideology and Online Review Language

Online reviews, i.e., evaluations of products and services posted on websites, are ubiquitous. Prior research observed substantial variance in the language of such online reviews and linked it to downstream consequences like perceived helpfulness. However, the understanding of why the language of reviews varies is limited. This is problematic because it might have vital implications for the design of IT systems and user interactions. To improve the understanding of online review language, the paper proposes that consumers’ personality, as reflected in their political ideology, is a predictor of such online review language. Specifically, it is hypothesized that reviewers’ political ideology as measured by degree of conservatism on a liberal–conservative spectrum is negatively related to review depth (the number of words and the number of arguments in a review), cognitively complex language in reviews, diversity of arguments, and positive valence in language. Support for these hypotheses is obtained through the analysis of a unique dataset that links a sample of online reviews to reviewers’ political ideology as inferred from their online news consumption recorded in clickstream data

The Effects of Text Complexity on Online Review Helpfulness

This research reported in this paper extends the literature on the helpfulness of online reviews. Previous research has assessed online reviews using standard unidimensional readability algorithms. This research extends previous work by investigating a multidimensional framework, and associated measures, of text complexity and its impact on the helpfulness of online reviews. Results show that as the amount of passive voice and negation in online reviews increase, the helpfulness of said review decreases. Other significant predictors of review helpfulness include word meaningfulness, lexical diversity, and the number of modifiers per noun phrase