Effectiveness of large language models and software libraries in sentiment analysis
This paper investigates the effectiveness of selected tools for sentiment analysis, focusing on both dedicated software libraries (NLTK, Pattern, TextBlob) and large language models (ChatGPT and Gemini). The evaluation was conducted in two stages: sentiment analysis of 30 synthetic opinions of vary...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Polish Association for Knowledge Promotion
2025-06-01
|
| Series: | Applied Computer Science |
| Subjects: | |
| Online Access: | https://ph.pollub.pl/index.php/acs/article/view/6936 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | This paper investigates the effectiveness of selected tools for sentiment analysis, focusing on both dedicated software libraries (NLTK, Pattern, TextBlob) and large language models (ChatGPT and Gemini). The evaluation was conducted in two stages: sentiment analysis of 30 synthetic opinions of varying linguistic complexity, and analysis of 5 sets of real user reviews collected from the web. The results show that large language models - although not explicitly designed for sentiment analysis - achieved the highest accuracy, with ChatGPT consistently producing the lowest deviation from human ratings. In contrast, software libraries showed greater variation, especially in the presence of complex linguistic structures. These findings highlight the potential of large language models in sentiment analysis tasks and underscore their robustness in interpreting nuanced language.
|
|---|---|
| ISSN: | 2353-6977 |