Construction and implementation of knowledge enhancement pre-trained language model for text sentiment analysis
With the in-depth development of natural language processing technology, text sentiment analysis has shown great potential in public opinion monitoring, market analysis and other fields. However, traditional methods have limitations in dealing with complex semantic and emotional diversity. Therefore...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-12-01
|
| Series: | Systems and Soft Computing |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2772941925001115 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850239751934705664 |
|---|---|
| author | Lan Cui |
| author_facet | Lan Cui |
| author_sort | Lan Cui |
| collection | DOAJ |
| description | With the in-depth development of natural language processing technology, text sentiment analysis has shown great potential in public opinion monitoring, market analysis and other fields. However, traditional methods have limitations in dealing with complex semantic and emotional diversity. Therefore, this study proposes a knowledge-enhanced pre-trained language model for text sentiment analysis. The model effectively improves the model's ability to understand emotional semantics by integrating external knowledge bases, such as emotional dictionaries and domain-specific knowledge. In the pre-training stage, we adopted a large-scale Chinese text dataset and combined emotional labels for joint training. The experimental results show that compared with the baseline model, the accuracy of the proposed model in the sentiment classification task is improved by 8.3 %, and the F1 score is improved by 7.5 %. The model performed equally well in the fine-grained sentiment analysis task, with accuracy and F1 scores improving by 6.2 % and 5.8 %, respectively. In addition, the model shows stronger robustness when dealing with long texts and complex emotional expressions. Further analysis shows that the knowledge enhancement module effectively improves the model's ability to recognize emotional vocabulary and tendencies. This study provides a new technical path for text sentiment analysis and a valuable exploration for applying pre-trained language models in specific fields. |
| format | Article |
| id | doaj-art-50c75aecdca242e4ba9abd80c933d906 |
| institution | OA Journals |
| issn | 2772-9419 |
| language | English |
| publishDate | 2025-12-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Systems and Soft Computing |
| spelling | doaj-art-50c75aecdca242e4ba9abd80c933d9062025-08-20T02:01:04ZengElsevierSystems and Soft Computing2772-94192025-12-01720029310.1016/j.sasc.2025.200293Construction and implementation of knowledge enhancement pre-trained language model for text sentiment analysisLan Cui0Corresponding author.; Liaoning University of International Business and Economics, Dalian 116502, ChinaWith the in-depth development of natural language processing technology, text sentiment analysis has shown great potential in public opinion monitoring, market analysis and other fields. However, traditional methods have limitations in dealing with complex semantic and emotional diversity. Therefore, this study proposes a knowledge-enhanced pre-trained language model for text sentiment analysis. The model effectively improves the model's ability to understand emotional semantics by integrating external knowledge bases, such as emotional dictionaries and domain-specific knowledge. In the pre-training stage, we adopted a large-scale Chinese text dataset and combined emotional labels for joint training. The experimental results show that compared with the baseline model, the accuracy of the proposed model in the sentiment classification task is improved by 8.3 %, and the F1 score is improved by 7.5 %. The model performed equally well in the fine-grained sentiment analysis task, with accuracy and F1 scores improving by 6.2 % and 5.8 %, respectively. In addition, the model shows stronger robustness when dealing with long texts and complex emotional expressions. Further analysis shows that the knowledge enhancement module effectively improves the model's ability to recognize emotional vocabulary and tendencies. This study provides a new technical path for text sentiment analysis and a valuable exploration for applying pre-trained language models in specific fields.http://www.sciencedirect.com/science/article/pii/S2772941925001115Text sentiment analysisKnowledge enhancementPre-trained language modelEmotion classificationFine-grained sentiment analysis |
| spellingShingle | Lan Cui Construction and implementation of knowledge enhancement pre-trained language model for text sentiment analysis Systems and Soft Computing Text sentiment analysis Knowledge enhancement Pre-trained language model Emotion classification Fine-grained sentiment analysis |
| title | Construction and implementation of knowledge enhancement pre-trained language model for text sentiment analysis |
| title_full | Construction and implementation of knowledge enhancement pre-trained language model for text sentiment analysis |
| title_fullStr | Construction and implementation of knowledge enhancement pre-trained language model for text sentiment analysis |
| title_full_unstemmed | Construction and implementation of knowledge enhancement pre-trained language model for text sentiment analysis |
| title_short | Construction and implementation of knowledge enhancement pre-trained language model for text sentiment analysis |
| title_sort | construction and implementation of knowledge enhancement pre trained language model for text sentiment analysis |
| topic | Text sentiment analysis Knowledge enhancement Pre-trained language model Emotion classification Fine-grained sentiment analysis |
| url | http://www.sciencedirect.com/science/article/pii/S2772941925001115 |
| work_keys_str_mv | AT lancui constructionandimplementationofknowledgeenhancementpretrainedlanguagemodelfortextsentimentanalysis |