Aspect-Based Sentiment Analysis Model for Short Text with Interactive Dependent Multi-head Graph Attention

This article proposes an Interactive Dependent Multi-head Graph Attention (IDM-GAT) model for short text sentiment analysis based on dependent multi-head graph attention, which addresses the shortcomings of existing methods for short text sentiment analysis , such as non-compliance with conventiona...

Full description

Saved in:
Bibliographic Details
Main Authors: AISiyu, CHENHailong, CUIXinying, ANRui
Format: Article
Language:zho
Published: Harbin University of Science and Technology Publications 2024-10-01
Series:Journal of Harbin University of Science and Technology
Subjects:
Online Access:https://hlgxb.hrbust.edu.cn/#/digest?ArticleID=2362
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849320226459484160
author AISiyu
CHENHailong
CUIXinying
ANRui
author_facet AISiyu
CHENHailong
CUIXinying
ANRui
author_sort AISiyu
collection DOAJ
description This article proposes an Interactive Dependent Multi-head Graph Attention (IDM-GAT) model for short text sentiment analysis based on dependent multi-head graph attention, which addresses the shortcomings of existing methods for short text sentiment analysis , such as non-compliance with conventional grammar and insufficient utilization of deep emotional expression between contextual words and aspect words. The model enhances the embedding of sentiment information at the sentence level by adding relative position vectors. Then, it uses the dependent graph attention structure to calculate the attention weights of individual words and dependencies between words in the sentence, and extracts sparse dependency relationships in short text as much as possible. It uses self-attention pooling and average pooling methods for contextual and aspect words at the word level, reducing the computational complexity of the model while preserving emotional features. The combination of two levels provides a more comprehensive modeling of short texts from both global and local perspectives. Through simulation experiments, the proposed model achieved accuracy of 83. 85% , 79. 15% , and 74. 39% on three benchmark datasets: Semeval2014 hotel reviews, computer reviews, and ACL14 Twitter, respectively.
format Article
id doaj-art-075632794bf84dd19a2e296a0153bc7b
institution Kabale University
issn 1007-2683
language zho
publishDate 2024-10-01
publisher Harbin University of Science and Technology Publications
record_format Article
series Journal of Harbin University of Science and Technology
spelling doaj-art-075632794bf84dd19a2e296a0153bc7b2025-08-20T03:50:11ZzhoHarbin University of Science and Technology PublicationsJournal of Harbin University of Science and Technology1007-26832024-10-012905101710.15938/j.jhust.2024.05.002Aspect-Based Sentiment Analysis Model for Short Text with Interactive Dependent Multi-head Graph AttentionAISiyu0CHENHailong1CUIXinying2ANRui3School of Computer Science and Technology, Harbin University of Science and Technology, Harbin 150080 , ChinaSchool of Computer Science and Technology, Harbin University of Science and Technology, Harbin 150080 , ChinaSchool of Computer Science and Technology, Harbin University of Science and Technology, Harbin 150080 , ChinaSchool of Computer Science and Technology, Harbin University of Science and Technology, Harbin 150080 , ChinaThis article proposes an Interactive Dependent Multi-head Graph Attention (IDM-GAT) model for short text sentiment analysis based on dependent multi-head graph attention, which addresses the shortcomings of existing methods for short text sentiment analysis , such as non-compliance with conventional grammar and insufficient utilization of deep emotional expression between contextual words and aspect words. The model enhances the embedding of sentiment information at the sentence level by adding relative position vectors. Then, it uses the dependent graph attention structure to calculate the attention weights of individual words and dependencies between words in the sentence, and extracts sparse dependency relationships in short text as much as possible. It uses self-attention pooling and average pooling methods for contextual and aspect words at the word level, reducing the computational complexity of the model while preserving emotional features. The combination of two levels provides a more comprehensive modeling of short texts from both global and local perspectives. Through simulation experiments, the proposed model achieved accuracy of 83. 85% , 79. 15% , and 74. 39% on three benchmark datasets: Semeval2014 hotel reviews, computer reviews, and ACL14 Twitter, respectively.https://hlgxb.hrbust.edu.cn/#/digest?ArticleID=2362dependent multi-head graph attentioninteractive attentionshort textaspect-based sentiment analysis
spellingShingle AISiyu
CHENHailong
CUIXinying
ANRui
Aspect-Based Sentiment Analysis Model for Short Text with Interactive Dependent Multi-head Graph Attention
Journal of Harbin University of Science and Technology
dependent multi-head graph attention
interactive attention
short text
aspect-based sentiment analysis
title Aspect-Based Sentiment Analysis Model for Short Text with Interactive Dependent Multi-head Graph Attention
title_full Aspect-Based Sentiment Analysis Model for Short Text with Interactive Dependent Multi-head Graph Attention
title_fullStr Aspect-Based Sentiment Analysis Model for Short Text with Interactive Dependent Multi-head Graph Attention
title_full_unstemmed Aspect-Based Sentiment Analysis Model for Short Text with Interactive Dependent Multi-head Graph Attention
title_short Aspect-Based Sentiment Analysis Model for Short Text with Interactive Dependent Multi-head Graph Attention
title_sort aspect based sentiment analysis model for short text with interactive dependent multi head graph attention
topic dependent multi-head graph attention
interactive attention
short text
aspect-based sentiment analysis
url https://hlgxb.hrbust.edu.cn/#/digest?ArticleID=2362
work_keys_str_mv AT aisiyu aspectbasedsentimentanalysismodelforshorttextwithinteractivedependentmultiheadgraphattention
AT chenhailong aspectbasedsentimentanalysismodelforshorttextwithinteractivedependentmultiheadgraphattention
AT cuixinying aspectbasedsentimentanalysismodelforshorttextwithinteractivedependentmultiheadgraphattention
AT anrui aspectbasedsentimentanalysismodelforshorttextwithinteractivedependentmultiheadgraphattention