Knowledge Graph-Driven Approach in Aspect-Based Sentiment Analysis: Exploring the Impact of Embedding Techniques
Despite the high performance of the existing embedding approaches for Aspect-Based Sentiment Analysis (ABSA), such as Word2Vec and GloVe, they still have several limitations, mainly in contextual understanding and relational insights of natural language, especially in complex and long sentences. Thi...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/11026004/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850157204635648000 |
|---|---|
| author | Souha Al Katat Chamseddine Zaki Hussein Hazimeh Ibrahim El Bitar Rafael Angarita Lionel Trojman |
| author_facet | Souha Al Katat Chamseddine Zaki Hussein Hazimeh Ibrahim El Bitar Rafael Angarita Lionel Trojman |
| author_sort | Souha Al Katat |
| collection | DOAJ |
| description | Despite the high performance of the existing embedding approaches for Aspect-Based Sentiment Analysis (ABSA), such as Word2Vec and GloVe, they still have several limitations, mainly in contextual understanding and relational insights of natural language, especially in complex and long sentences. This paper presents a novel approach that enhances ABSA by integrating knowledge graphs into a transformer model, where the graphs are automatically built from raw text without requiring external resources, making the system adaptable and fully data-driven. Our approach allows a better understanding of context and relationships between entities, by combining of the contextual understanding of BERT with the relational insights provided by Node2Vec, a graph-based embedding technique. In this paper, we benchmark our hybrid embedding technique with the existing state-of-the-art embedding techniques. Specifically, we compare traditional embeddings, such as Word2Vec and GloVe, against BERT for textual input, while also exploring Word2Vec and Node2Vec for graph-based embeddings. Our experiments demonstrate that combining BERT’s deep contextual embeddings with the structural insights of Node2Vec leads to promising improvements in sentiment classification performance. Our model achieved 98% accuracy on SemEval2015 Restaurant dataset. These results demonstrate that integrating both contextual and relational information significantly enhances the performance of ABSA models, thereby making them more effective at capturing nuanced sentiment relationships. The proposed model’s modular design also allows flexible integration of alternative embeddings or graph configurations, making it suitable for broader sentiment analysis applications beyond the benchmark datasets. |
| format | Article |
| id | doaj-art-a06c4e9111c34b60b739717c5e097f31 |
| institution | OA Journals |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-a06c4e9111c34b60b739717c5e097f312025-08-20T02:24:15ZengIEEEIEEE Access2169-35362025-01-011310255310256310.1109/ACCESS.2025.357704811026004Knowledge Graph-Driven Approach in Aspect-Based Sentiment Analysis: Exploring the Impact of Embedding TechniquesSouha Al Katat0https://orcid.org/0009-0008-2783-6840Chamseddine Zaki1https://orcid.org/0000-0002-9232-3901Hussein Hazimeh2Ibrahim El Bitar3https://orcid.org/0000-0001-9081-7994Rafael Angarita4https://orcid.org/0000-0002-2025-2489Lionel Trojman5https://orcid.org/0000-0003-2316-4959Isep, Laboratory of Informatics, Signal, Image, Telecommunication, and Electronics (LISITE), Issy-les-Moulineaux, FranceCollege of Engineering and Technology, American University of the Middle East, Kuwait, Egaila, KuwaitComputer Science Department, Faculty of Sciences, Lebanese University, Beirut, LebanonLIP6, Sorbonne University, Paris, FranceParis Nanterre University, Nanterre, FranceIsep, Laboratory of Informatics, Signal, Image, Telecommunication, and Electronics (LISITE), Issy-les-Moulineaux, FranceDespite the high performance of the existing embedding approaches for Aspect-Based Sentiment Analysis (ABSA), such as Word2Vec and GloVe, they still have several limitations, mainly in contextual understanding and relational insights of natural language, especially in complex and long sentences. This paper presents a novel approach that enhances ABSA by integrating knowledge graphs into a transformer model, where the graphs are automatically built from raw text without requiring external resources, making the system adaptable and fully data-driven. Our approach allows a better understanding of context and relationships between entities, by combining of the contextual understanding of BERT with the relational insights provided by Node2Vec, a graph-based embedding technique. In this paper, we benchmark our hybrid embedding technique with the existing state-of-the-art embedding techniques. Specifically, we compare traditional embeddings, such as Word2Vec and GloVe, against BERT for textual input, while also exploring Word2Vec and Node2Vec for graph-based embeddings. Our experiments demonstrate that combining BERT’s deep contextual embeddings with the structural insights of Node2Vec leads to promising improvements in sentiment classification performance. Our model achieved 98% accuracy on SemEval2015 Restaurant dataset. These results demonstrate that integrating both contextual and relational information significantly enhances the performance of ABSA models, thereby making them more effective at capturing nuanced sentiment relationships. The proposed model’s modular design also allows flexible integration of alternative embeddings or graph configurations, making it suitable for broader sentiment analysis applications beyond the benchmark datasets.https://ieeexplore.ieee.org/document/11026004/Sentiment analysisABSAtransformersknowledge graphNLP |
| spellingShingle | Souha Al Katat Chamseddine Zaki Hussein Hazimeh Ibrahim El Bitar Rafael Angarita Lionel Trojman Knowledge Graph-Driven Approach in Aspect-Based Sentiment Analysis: Exploring the Impact of Embedding Techniques IEEE Access Sentiment analysis ABSA transformers knowledge graph NLP |
| title | Knowledge Graph-Driven Approach in Aspect-Based Sentiment Analysis: Exploring the Impact of Embedding Techniques |
| title_full | Knowledge Graph-Driven Approach in Aspect-Based Sentiment Analysis: Exploring the Impact of Embedding Techniques |
| title_fullStr | Knowledge Graph-Driven Approach in Aspect-Based Sentiment Analysis: Exploring the Impact of Embedding Techniques |
| title_full_unstemmed | Knowledge Graph-Driven Approach in Aspect-Based Sentiment Analysis: Exploring the Impact of Embedding Techniques |
| title_short | Knowledge Graph-Driven Approach in Aspect-Based Sentiment Analysis: Exploring the Impact of Embedding Techniques |
| title_sort | knowledge graph driven approach in aspect based sentiment analysis exploring the impact of embedding techniques |
| topic | Sentiment analysis ABSA transformers knowledge graph NLP |
| url | https://ieeexplore.ieee.org/document/11026004/ |
| work_keys_str_mv | AT souhaalkatat knowledgegraphdrivenapproachinaspectbasedsentimentanalysisexploringtheimpactofembeddingtechniques AT chamseddinezaki knowledgegraphdrivenapproachinaspectbasedsentimentanalysisexploringtheimpactofembeddingtechniques AT husseinhazimeh knowledgegraphdrivenapproachinaspectbasedsentimentanalysisexploringtheimpactofembeddingtechniques AT ibrahimelbitar knowledgegraphdrivenapproachinaspectbasedsentimentanalysisexploringtheimpactofembeddingtechniques AT rafaelangarita knowledgegraphdrivenapproachinaspectbasedsentimentanalysisexploringtheimpactofembeddingtechniques AT lioneltrojman knowledgegraphdrivenapproachinaspectbasedsentimentanalysisexploringtheimpactofembeddingtechniques |