Optimizing Multi-Class Text Classification: A Diverse Stacking Ensemble Framework Utilizing Transformers

Customer reviews play a crucial role in assessing customer satisfaction, gathering feedback, and driving improvements for businesses. Analyzing these reviews provides valuable insights into customer sentiments, including compliments, comments, and suggestions. Text classification techniques enable businesses to categorize customer reviews into distinct categories, facilitating a better understanding of customer feedback. However, challenges such as overfitting and bias limit the effectiveness of a single classifier in ensuring optimal prediction. This study proposes a novel approach to address these challenges by introducing a stacking ensemble-based multi-text classification method that leverages transformer models. By combining multiple single transformers, including BERT, ELECTRA, and DistilBERT, as base-level classifiers, and a meta-level classifier based on RoBERTa, an optimal predictive model is generated. The proposed stacking ensemble-based multi-text classification method aims to enhance the accuracy and robustness of customer review analysis. Experimental evaluations conducted on a real-world customer review dataset demonstrate the effectiveness and superiority of the proposed approach over traditional single classifier models. The stacking ensemble-based multi-text classification method using transformers proves to be a promising solution for businesses seeking to extract valuable insights from customer reviews and make data-driven decisions to enhance customer satisfaction and drive continuous improvement

Topic Modeling based text classification regarding Islamophobia using Word Embedding and Transformers Techniques

Islamophobia is a rising area of concern in the current era where Muslims face discrimination and receive negative perspectives towards their religion, Islam. Islamophobia is a type of racism that is being practiced by individuals, groups, and organizations worldwide. Moreover, the ease of access to social media platforms and their augmented usage has also contributed to spreading hate speech, false information, and negative opinions about Islam. In this research study, we focused to detect Islamophobic textual content shared on various social media platforms. We explored the state-of-the-art techniques being followed in text data mining and Natural Language Processing (NLP). Topic modelling algorithm Latent Dirichlet Allocation is used to find top topics. Then, word embedding approaches such as Word2Vec and Global Vectors for word representation (GloVe) are used as feature extraction techniques. For text classification, we utilized modern text analysis techniques of transformers-based Deep Learning algorithms named Bidirectional Encoders Representation from Transformers (BERT) and Generative Pre-Trained Transformer (GPT). For results comparison, we conducted an extensive empirical analysis of Machine Learning algorithms and Deep Learning using conventional textual features such as the Term Frequency-Inverse Document Frequency, N-gram, and Bag of words (BoW). The empirical based results evaluated using standard performance evaluation measures show that the proposed approach effectively detects the textual content related to Islamophobia. In the corpus of the study under Machine Learning models Support Vector Machine (SVM) performed best with an F1 score of 91%. The Transformer based core NLP models and the Deep Learning model Convolutional Neural Network (CNN) when combined with GloVe performed best among all the techniques except SVM with BoW. GPT, SVM when combined with BoW and BERT yielded the best F1 score of 92%, 92% and 91.9% respectively, while CNN performed slightly poor with an F1 score of 91%

O impacto da inteligência artificial no negócio eletrónico

Pela importância que a Inteligência Artificial exibe na atualidade, revela-se de grande interesse verificar até que ponto ela está a transformar o Negócio Eletrónico. Para esse efeito, delineou-se uma revisão sistemática com o objetivo de avaliar os impactos da proliferação destes instrumentos. A investigação empreendida pretendeu identificar artigos científicos que, através de pesquisas realizadas a Fontes de Dados Eletrónicas, pudessem responder às questões de investigação implementadas: a) que tipo de soluções, baseadas na Inteligência Artificial (IA), têm sido usadas para melhorar o Negócio Eletrónico (NE); b) em que domínios do NE a IA foi aplicada; c) qual a taxa de sucesso ou fracasso do projeto. Simultaneamente, tiveram de respeitar critérios de seleção, nomeadamente, estar escritos em inglês, encontrarem-se no intervalo temporal 2015/2021 e tratar-se de estudos empíricos, suportados em dados reais. Após uma avaliação de qualidade final, procedeu-se à extração dos dados pertinentes para a investigação, para formulários criados em MS Excel. Estes dados estiveram na base da análise quantitativa e qualitativa que evidenciaram as descobertas feitas e sobre os quais se procedeu, posteriormente, à sua discussão. A dissertação termina com as conclusão e discussão de trabalhos futuros.Due to the importance that Artificial Intelligence exhibits today, it is of great interest to see to what extent it is transforming the Electronic Business. To this end, a systematic review was designed to evaluate the impacts of the proliferation of these instruments. The research aimed to identify scientific articles that, through research carried out on Electronic Data Sources, could answer the research questions implemented: a) what kind of solutions, based on Artificial Intelligence, have been used to improve the Electronic Business; b) in which areas of the Electronic Business Artificial Intelligence has been applied; c) what the success rate or failure of the project is. At the same time, they must comply with selection criteria, to be written in English, to be found in the 2015/2021-time interval and to be empirical studies supported by actual data. After a final quality evaluation, the relevant data for the investigation were extracted for forms created in MS Excel. These data were the basis of the quantitative and qualitative analysis that evidenced the findings found and on which they were subsequently discussed. The dissertation ends with the conclusion and discussion of future works