User Emotion Identification in Twitter Using Specific Features: Hashtag, Emoji, Emoticon, and Adjective Term

Twitter is a social media application, which can give a sign for identifying user emotion. Identification of user emotion can be utilized in commercial domain, health, politic, and security problems. The problem of emotion identification in twit is the unstructured short text messages which lead the difficulty to figure out main features. In this paper, we propose a new framework for identifying the tendency of user emotions using specific features, i.e. hashtag, emoji, emoticon, and adjective term. Preprocessing is applied in the first phase, and then user emotions are identified by means of classification method using kNN. The proposed method can achieve good results, near ground truth, with accuracy of 92%

Emotion Classification of Indonesian Tweets using Bidirectional LSTM

Emotion classification can be a powerful tool to derive narratives from social media data. Traditional machine learning models that perform emotion classification on Indonesian Twitter data exist but rely on closed-source features. Recurrent neural networks can meet or exceed the performance of state-of-the-art traditional machine learning techniques using exclusively open-source data and models. Specifically, these results show that recurrent neural network variants can produce more than an 8% gain in accuracy in comparison with logistic regression and SVM techniques and a 15% gain over random forest when using FastText embeddings. This research found a statistical significance in the performance of a single-layer bidirectional long short-term memory model over a two-layer stacked bidirectional long short-term memory model. This research also found that a single-layer bidirectional long short-term memory recurrent neural network met the performance of a state-of-the-art logistic regression model with supplemental closed-source features from a study by Saputri et al. [8] when classifying the emotion of Indonesian tweets

Emotion Classification in Indonesian Language: A CNN Approach with Hyperband Tuning

Klasifikasi Emosi dalam Bahasa Indonesia: Pendekatan CNN dengan Hyperband Tuning. Saat ini, teknik klasifikasi emosi yang andal sangat dibutuhkan di beberapa bidang. Penelitian ini mengusulkan penggunaan Convolutional Neural Network (CNN) yang telah dioptimalkan dengan Hyperband Tuner (HT) untuk secara efektif melakukan tugas Klasifikasi Emosi dalam bahasa Indonesia. Eksperimen pada berbagai teknik ekstraksi fitur, termasuk CountVectorizer (CV), TF-IDF, dan Keras Tokenizer (KT) dilakukan juga untuk mengeksplorasi kombinasi terbaik dari ekstraksi fitur dan CNN pada set data yang ada. Metodologi yang diusulkan dievaluasi dan dibandingkan dengan KNearest Neighbors (KNN), Decision Tree (DT), Naive Bayes (NB), dan Boosting SVM. Hasil percobaan menunjukkan bahwa metode yang digunakan pada penelitian ini mengungguli teknik yang ada, dibuktikan oleh metrik akurasi, presisi, daya ingat, dan skor F1, yang masing-masing mencapai 71,5655%, 71,5483%, 71,5655%, dan 71,0041%.   Emotion Classification in Indonesian Language: A CNN Approach with Hyperband Tuning. In today's world, there is a high demand for accurate techniques to classify emotions in various fields. This study proposed utilizing a Convolutional Neural Network (CNN) optimized with a Hyperband Tuner (HT) to perform the Emotion Classification task in the Indonesian language effectively. Various feature extraction techniques experiments were conducted to explore the best combinations of feature extraction and CNN for the data set, including CountVectorizer (CV), TF-IDF, and Keras Tokenizer (KT). Last, the proposed methodology was evaluated and compared to the stateof-the-art techniques, including K-Nearest Neighbors (KNN), Decision Tree (DT), Naive Bayes (NB), and Boosting SVM. The experimental results revealed that the proposed method in this research outperforms the existing technique as evidenced by the accuracy, precision, recall, and F1-score metrics, which respectively reached 71.5655%, 71.5483%, 71.5655%, and 71.0041%

Measuring Emotions in the COVID-19 Real World Worry Dataset

The COVID-19 pandemic is having a dramatic impact on societies and economies around the world. With various measures of lockdowns and social distancing in place, it becomes important to understand emotional responses on a large scale. In this paper, we present the first ground truth dataset of emotional responses to COVID-19. We asked participants to indicate their emotions and express these in text. This resulted in the Real World Worry Dataset of 5,000 texts (2,500 short + 2,500 long texts). Our analyses suggest that emotional responses correlated with linguistic measures. Topic modeling further revealed that people in the UK worry about their family and the economic situation. Tweet-sized texts functioned as a call for solidarity, while longer texts shed light on worries and concerns. Using predictive modeling approaches, we were able to approximate the emotional responses of participants from text within 14% of their actual value. We encourage others to use the dataset and improve how we can use automated methods to learn about emotional responses and worries about an urgent problem.Comment: Accepted to ACL 2020 COVID-19 worksho

Detecting emotions using a combination of bidirectional encoder representations from transformers embedding and bidirectional long short-term memory

One of the most difficult topics in natural language understanding (NLU) is emotion detection in text because human emotions are difficult to understand without knowing facial expressions. Because the structure of Indonesian differs from other languages, this study focuses on emotion detection in Indonesian text. The nine experimental scenarios of this study incorporate word embedding (bidirectional encoder representations from transformers (BERT), Word2Vec, and GloVe) and emotion detection models (bidirectional long short-term memory (BiLSTM), LSTM, and convolutional neural network (CNN)). With values of 88.28%, 88.42%, and 89.20% for Commuter Line, Transjakarta, and Commuter Line+Transjakarta, respectively, BERT-BiLSTM generates the highest accuracy on the data. In general, BiLSTM produces the highest accuracy, followed by LSTM, and finally CNN. When it came to word embedding, BERT embedding outperformed Word2Vec and GloVe. In addition, the BERT-BiLSTM model generates the highest precision, recall, and F1-measure values in each data scenario when compared to other models. According to the results of this study, BERT-BiLSTM can enhance the performance of the classification model when compared to previous studies that only used BERT or BiLSTM for emotion detection in Indonesian texts

Big five personality prediction based in Indonesian tweets using machine learning methods

The popularity of social media has drawn the attention of researchers who have conducted cross-disciplinary studies examining the relationship between personality traits and behavior on social media. Most current work focuses on personality prediction analysis of English texts, but Indonesian has received scant attention. Therefore, this research aims to predict user’s personalities based on Indonesian text from social media using machine learning techniques. This paper evaluates several machine learning techniques, including naive Bayes (NB), K-nearest neighbors (KNN), and support vector machine (SVM), based on semantic features including emotion, sentiment, and publicly available Twitter profile. We predict the personality based on the big five personality model, the most appropriate model for predicting user personality in social media. We examine the relationships between the semantic features and the Big Five personality dimensions. The experimental results indicate that the Big Five personality exhibit distinct emotional, sentimental, and social characteristics and that SVM outperformed NB and KNN for Indonesian. In addition, we observe several terms in Indonesian that specifically refer to each personality type, each of which has distinct emotional, sentimental, and social features