Social Media Text Stance Detection Based on Large Language Models
Stance detection aims to analyze the attitude expressed in a text towards a given target. Social media texts are often short and evolve rapidly, which poses challenges for traditional stance detection methods due to sparse semantic information and inadequate representation of stance features. Additi...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press
2025-05-01
|
| Series: | Jisuanji kexue yu tansuo |
| Subjects: | |
| Online Access: | http://fcst.ceaj.org/fileup/1673-9418/PDF/2408074.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850193747563773952 |
|---|---|
| author | LI Juhao, SHI Lei, DING Meng, LEI Yongsheng, ZHAO Dongyue, CHEN Long |
| author_facet | LI Juhao, SHI Lei, DING Meng, LEI Yongsheng, ZHAO Dongyue, CHEN Long |
| author_sort | LI Juhao, SHI Lei, DING Meng, LEI Yongsheng, ZHAO Dongyue, CHEN Long |
| collection | DOAJ |
| description | Stance detection aims to analyze the attitude expressed in a text towards a given target. Social media texts are often short and evolve rapidly, which poses challenges for traditional stance detection methods due to sparse semantic information and inadequate representation of stance features. Additionally, many existing approaches overlook the role of sentiment information in stance detection. To address these issues, this paper proposes a stance detection method for social media texts leveraging large language models. A specially designed prompt template with explicit task instructions is employed to utilize the model’s pre-trained knowledge related to stance detection, mitigating the challenge of sparse semantic information. Furthermore, sentiment analysis tasks are integrated into the prompt instructions to guide the model’s focus on sentiment information, enriching the semantic cues for stance detection and addressing the underutilization of sentiment data. To enhance the model’s ability to extract and represent stance features, a task-specific adapter is integrated into the model. This improves the representation of stance features and enhances the overall performance of the model in stance detection tasks. Finally, the results from large language models with different architectures are integrated through ensemble voting to improve the stability of prediction results. To validate the method proposed in this paper, comparative experiments are constructed. The experiments conducted on the SemEval-2016 Task 6A dataset demonstrate that the proposed method achieves significantly better performance compared with existing benchmark methods. |
| format | Article |
| id | doaj-art-68b1ca5330fc46c7b6e7c346d22a2aa9 |
| institution | OA Journals |
| issn | 1673-9418 |
| language | zho |
| publishDate | 2025-05-01 |
| publisher | Journal of Computer Engineering and Applications Beijing Co., Ltd., Science Press |
| record_format | Article |
| series | Jisuanji kexue yu tansuo |
| spelling | doaj-art-68b1ca5330fc46c7b6e7c346d22a2aa92025-08-20T02:14:10ZzhoJournal of Computer Engineering and Applications Beijing Co., Ltd., Science PressJisuanji kexue yu tansuo1673-94182025-05-011951302131210.3778/j.issn.1673-9418.2408074Social Media Text Stance Detection Based on Large Language ModelsLI Juhao, SHI Lei, DING Meng, LEI Yongsheng, ZHAO Dongyue, CHEN Long01. College of Investigation, People’s Public Security University of China, Beijing 100038, China 2. State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, China 3. Public Security Behavioral Science Lab, People’s Public Security University of China, Beijing 100038, ChinaStance detection aims to analyze the attitude expressed in a text towards a given target. Social media texts are often short and evolve rapidly, which poses challenges for traditional stance detection methods due to sparse semantic information and inadequate representation of stance features. Additionally, many existing approaches overlook the role of sentiment information in stance detection. To address these issues, this paper proposes a stance detection method for social media texts leveraging large language models. A specially designed prompt template with explicit task instructions is employed to utilize the model’s pre-trained knowledge related to stance detection, mitigating the challenge of sparse semantic information. Furthermore, sentiment analysis tasks are integrated into the prompt instructions to guide the model’s focus on sentiment information, enriching the semantic cues for stance detection and addressing the underutilization of sentiment data. To enhance the model’s ability to extract and represent stance features, a task-specific adapter is integrated into the model. This improves the representation of stance features and enhances the overall performance of the model in stance detection tasks. Finally, the results from large language models with different architectures are integrated through ensemble voting to improve the stability of prediction results. To validate the method proposed in this paper, comparative experiments are constructed. The experiments conducted on the SemEval-2016 Task 6A dataset demonstrate that the proposed method achieves significantly better performance compared with existing benchmark methods.http://fcst.ceaj.org/fileup/1673-9418/PDF/2408074.pdfstance detection; large language models; natural language processing; multi-strategy optimization |
| spellingShingle | LI Juhao, SHI Lei, DING Meng, LEI Yongsheng, ZHAO Dongyue, CHEN Long Social Media Text Stance Detection Based on Large Language Models Jisuanji kexue yu tansuo stance detection; large language models; natural language processing; multi-strategy optimization |
| title | Social Media Text Stance Detection Based on Large Language Models |
| title_full | Social Media Text Stance Detection Based on Large Language Models |
| title_fullStr | Social Media Text Stance Detection Based on Large Language Models |
| title_full_unstemmed | Social Media Text Stance Detection Based on Large Language Models |
| title_short | Social Media Text Stance Detection Based on Large Language Models |
| title_sort | social media text stance detection based on large language models |
| topic | stance detection; large language models; natural language processing; multi-strategy optimization |
| url | http://fcst.ceaj.org/fileup/1673-9418/PDF/2408074.pdf |
| work_keys_str_mv | AT lijuhaoshileidingmengleiyongshengzhaodongyuechenlong socialmediatextstancedetectionbasedonlargelanguagemodels |