Understanding user behavior aspects on emergency mobile applications during emergency communications using NLP and text mining techniques

Abstract. The use of mobile devices has been skyrocketing in our society. Users can access and share any type of information in a timely manner through these devices using different social media applications. This enabled users to increase their awareness of ongoing events such as election campaigns, sports updates, movie releases, disaster occurrences, and studies. The attractiveness, affordability, and two-way communication capabilities empowered these mobile devices that support various social media platforms to be central to emergency communication as well. This makes a mobile-based emergency application an attractive communication tool during emergencies. The emergence of mobile-based emergency communication has intrigued us to learn about the user behavior related to the usage of these applications. Our study was mainly conducted on emergency apps in Nordic countries such as Finland, Sweden, and Norway. To understand the user objects regarding the usage of emergency mobile applications we leveraged various Natural Language Processing and Text Mining techniques. VADER sentiment tool was used to predict and track users’ review polarity of a particular application over time. Lately, to identify factors that affect users’ sentiments, we employed topic modeling techniques such as the Latent Dirichlet Allocation (LDA) model. This model identifies various themes discussed in the user reviews and the result of each theme will be represented by the weighted sum of words in the corpus. Even though LDA succeeds in highlighting the user-related factors, it fails to identify the aspects of the user, and the topic definition from the LDA model is vague. Hence we leveraged Aspect Based Sentiment Analysis (ABSA) methods to extract the user aspects from the user reviews. To perform this task we consider fine-tuning DeBERTa (a variant of the BERT model). BERT is a Bidirectional Encoder Representation of transformer architecture which allows the model to learn the context in the text. Following this, we performed a sentence pair sentiment classification task using different variants of BERT. Later, we dwell on different sentiments to highlight the factors and the categories that impact user behavior most by leveraging the Empath categorization technique. Finally, we construct a word association by considering different Ontological vocabularies related to mobile applications and emergency response and management systems. The insights from the study can be used to identify the user aspect terms, predict the sentiment of the aspect term in the review provided, and find how the aspect term impacts the user perspective on the usage of mobile emergency applications

Aspect-Based Sentiment Analysis on Mobile Game Reviews Using Deep Learning

This paper proposes an aspect-based sentiment analysis method on mobile game reviews using deep learning, which can make better use of massive mobile game reviews data to judge users\u27 emotional tendencies for different attributes of the game at a fine-grained level. Specifically, there are three models in our sentiment analysis method. The baseline model includes Bi-LSTM, FCN, and CRF for sentiment collocation extraction, matching, and classification. The iterative model updates the neural network structure and effectively improves the model\u27s recall rate in the experiments. The joint model is based on the information passing mechanism and further improves the comprehensive performance of the model. We crawled more than 100,000 game review items from two well-known Chinese game review websites Bilibili and Taptap and manually annotated 3,000 items to construct the experiment dataset. Several experiments have been carried out to evaluate our methods. The experimental results show that our methods have achieved good results

Detection of spam review on mobile app stores, evaluation of helpfulness of user reviews and extraction of quality aspects using machine learning techniques

As mobile devices have overtaken fixed Internet access, mobile applications and distribution platforms have gained in importance. App stores enable users to search and purchase mobile applications and then to give feedback in the form of reviews and ratings. A review might contain critical information about user experience, feature requests and bug reports. User reviews are valuable not only to developers and software organizations interested in learning the opinion of their customers but also to prospective users who would like to find out what others think about an app. Even though some surveys have inventoried techniques and methods in opinion mining and sentiment analysis, no systematic literature review (SLR) study had yet reported on mobile app store opinion mining and spam review detection problems. Mining opinions from app store reviews requires pre-processing at the text and content levels, including filtering-out nonopinionated content and evaluating trustworthiness and genuineness of the reviews. In addition, the relevance of the extracted features are not cross-validated with main software engineering concepts. This research project first conducted a systematic literature review (SLR) on the evaluation of mobile app store opinion mining studies. Next, to fill the identified gaps in the literature, we used a novel convolutional neural network to learn document representation for deceptive spam review detection by characterizing an app store review dataset which includes truthful and spam reviews for the first time in the literature. Our experiments reported that our neural network based method achieved 82.5% accuracy, while a baseline Support Vector Machine (SVM) classification model reached only 70% accuracy despite leveraging various feature combinations. We next compared four classification models to assess app store user review helpfulness and proposed a predictive model which makes use of review meta-data along with structural and lexical features for helpfulness prediction. In the last part of this research study, we constructed an annotated app store review dataset for the aspect extraction task, based on ISO 25010 - Systems and software Product Quality Requirements and Evaluation standard and two deep neural network models: Bi-directional Long-Short Term Memory and Conditional Random Field (Bi-LSTM+CRF) and Deep Convolutional Neural Networks and Conditional Random Field (CNN+CRF) for aspect extraction from app store user reviews. Both models achieved nearly 80% F1 score (the weighted average of precision and recall which takes both false positives and false negatives into account) in exact aspect matching and 86% F1 score in partial aspect matching

Exploring the determinants of the user experience in P2P payment systems in Spain: a text mining approach

Purpose: This study aims to identify which determinants are responsible for impact ing the user experience of three peer-to-peer (P2P) payment services in the Spanish market. Design/methodology/approach: A sample of all online reviews (n=16,048) pub lished in Google Play of three paytech apps—Bizum, Twyp, and Verse—was analyzed using text mining and sentiment analysis. Findings: A holistic interpretation of the seed terms included in each aspect allowed to label them based on the preferences expressed by paytech app users in their reviews. Six latent aspects were identified: ease of use, usefulness, perceived value, per formance expectancy, perceived quality, and user experience. In addition, the results of the analysis suggest a positivity bias in the online reviews of fintech P2P app users. Our results also show that online reviews of apps associated with banks or financial institutions, such as Bizum (to a greater extent) or Twyp, show more negative emotions, whereas independent apps (Verse) show more positive emotions. Moreover, the most critical users are those of unidentified gender, while women remain in a more neutral position, and men tend to express their opinions more positively regarding P2P pay ment apps. Practical implications: Paytech providers should analyze the problems faced by users immediately after an encounter. By applying text mining analysis, service providers can gain efficiency in understanding user sentiments and emotions without tedious and time-consuming reviews. Originality/value: This is a pioneering study on peer-to-peer (P2P) mobile payment systems from the user’s perspective because it investigates the emotions and senti ments that users convey through bank reviews