Bilinear Learning with Dual-Chain Feature Attention for Multimodal Rumor Detection
The rapid growth of social media and online information-sharing platforms facilitates the spread of rumors. Accurate rumor detection to minimize manual verification efforts remains a critical research challenge. While multimodal rumor detection leveraging both text and visual data has gained increas...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-05-01
|
| Series: | Mathematics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-7390/13/11/1731 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849330984683569152 |
|---|---|
| author | Zheheng Guo Haonan Liu Lijiao Zuo Junhao Wen |
| author_facet | Zheheng Guo Haonan Liu Lijiao Zuo Junhao Wen |
| author_sort | Zheheng Guo |
| collection | DOAJ |
| description | The rapid growth of social media and online information-sharing platforms facilitates the spread of rumors. Accurate rumor detection to minimize manual verification efforts remains a critical research challenge. While multimodal rumor detection leveraging both text and visual data has gained increasing attention due to the diversification of social media content, existing approaches face the following three key limitations: (1) yhey prioritize lexical features of text while neglecting inherent logical inconsistencies in rumor narratives; (2) they treat textual and visual features as independent modalities, failing to model their intrinsic connections; and (3) they overlook semantic incongruities between text and images, which are common in rumor content. This paper proposes a dual-chain multimodal feature learning framework for rumor detection to address these issues. The framework comprehensively extracts rumor content features through the following two parallel processes: a basic semantic feature extraction module that captures fundamental textual and visual semantics, and a logical connection feature learning module that models both the internal logical relationships within text and the cross-modal semantic alignment between text and images. The framework achieves the multi-level fusion of text–image features by integrating modal alignment and cross-modal attention mechanisms. Extensive experiments on the Pheme and Weibo datasets demonstrate that the proposed method performs better than baseline approaches, confirming its effectiveness in detecting multimodal rumors. |
| format | Article |
| id | doaj-art-c0fcd17d12114309b30c391f61c522e5 |
| institution | Kabale University |
| issn | 2227-7390 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Mathematics |
| spelling | doaj-art-c0fcd17d12114309b30c391f61c522e52025-08-20T03:46:46ZengMDPI AGMathematics2227-73902025-05-011311173110.3390/math13111731Bilinear Learning with Dual-Chain Feature Attention for Multimodal Rumor DetectionZheheng Guo0Haonan Liu1Lijiao Zuo2Junhao Wen3School of Earth Resources, China University of Geosciences (Wuhan), Wuhan 430074, ChinaSchool of Electronic Information and Communication, Huazhong University of Science and Technology, Wuhan 430074, ChinaSchool of Bigdata and Software Engineering, Chongqing University, Chongqing 400044, ChinaSchool of Bigdata and Software Engineering, Chongqing University, Chongqing 400044, ChinaThe rapid growth of social media and online information-sharing platforms facilitates the spread of rumors. Accurate rumor detection to minimize manual verification efforts remains a critical research challenge. While multimodal rumor detection leveraging both text and visual data has gained increasing attention due to the diversification of social media content, existing approaches face the following three key limitations: (1) yhey prioritize lexical features of text while neglecting inherent logical inconsistencies in rumor narratives; (2) they treat textual and visual features as independent modalities, failing to model their intrinsic connections; and (3) they overlook semantic incongruities between text and images, which are common in rumor content. This paper proposes a dual-chain multimodal feature learning framework for rumor detection to address these issues. The framework comprehensively extracts rumor content features through the following two parallel processes: a basic semantic feature extraction module that captures fundamental textual and visual semantics, and a logical connection feature learning module that models both the internal logical relationships within text and the cross-modal semantic alignment between text and images. The framework achieves the multi-level fusion of text–image features by integrating modal alignment and cross-modal attention mechanisms. Extensive experiments on the Pheme and Weibo datasets demonstrate that the proposed method performs better than baseline approaches, confirming its effectiveness in detecting multimodal rumors.https://www.mdpi.com/2227-7390/13/11/1731rumor detectionmultimodal featuremodal alignment |
| spellingShingle | Zheheng Guo Haonan Liu Lijiao Zuo Junhao Wen Bilinear Learning with Dual-Chain Feature Attention for Multimodal Rumor Detection Mathematics rumor detection multimodal feature modal alignment |
| title | Bilinear Learning with Dual-Chain Feature Attention for Multimodal Rumor Detection |
| title_full | Bilinear Learning with Dual-Chain Feature Attention for Multimodal Rumor Detection |
| title_fullStr | Bilinear Learning with Dual-Chain Feature Attention for Multimodal Rumor Detection |
| title_full_unstemmed | Bilinear Learning with Dual-Chain Feature Attention for Multimodal Rumor Detection |
| title_short | Bilinear Learning with Dual-Chain Feature Attention for Multimodal Rumor Detection |
| title_sort | bilinear learning with dual chain feature attention for multimodal rumor detection |
| topic | rumor detection multimodal feature modal alignment |
| url | https://www.mdpi.com/2227-7390/13/11/1731 |
| work_keys_str_mv | AT zhehengguo bilinearlearningwithdualchainfeatureattentionformultimodalrumordetection AT haonanliu bilinearlearningwithdualchainfeatureattentionformultimodalrumordetection AT lijiaozuo bilinearlearningwithdualchainfeatureattentionformultimodalrumordetection AT junhaowen bilinearlearningwithdualchainfeatureattentionformultimodalrumordetection |