2,192 research outputs found
Is ChatGPT a Good Sentiment Analyzer? A Preliminary Study
Recently, ChatGPT has drawn great attention from both the research community
and the public. We are particularly curious about whether it can serve as a
universal sentiment analyzer. To this end, in this work, we provide a
preliminary evaluation of ChatGPT on the understanding of opinions, sentiments,
and emotions contained in the text. Specifically, we evaluate it in four
settings, including standard evaluation, polarity shift evaluation, open-domain
evaluation, and sentiment inference evaluation. The above evaluation involves
18 benchmark datasets and 5 representative sentiment analysis tasks, and we
compare ChatGPT with fine-tuned BERT and corresponding state-of-the-art (SOTA)
models on end-task. Moreover, we also conduct human evaluation and present some
qualitative case studies to gain a deep comprehension of its sentiment analysis
capabilities.Comment: Technical Repor
- …