A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid
Discourse coherence is strongly associated with text quality, making it important to natural language generation and understanding. However, existing coherence models focus on measuring individual aspects of coherence, such as lexical overlap, entity centralization, rhetorical structure, etc., lacki...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2021-01-01
|
| Series: | Complexity |
| Online Access: | http://dx.doi.org/10.1155/2021/6654925 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832547007148851200 |
|---|---|
| author | Lanlan Jiang Shengjun Yuan Jun Li |
| author_facet | Lanlan Jiang Shengjun Yuan Jun Li |
| author_sort | Lanlan Jiang |
| collection | DOAJ |
| description | Discourse coherence is strongly associated with text quality, making it important to natural language generation and understanding. However, existing coherence models focus on measuring individual aspects of coherence, such as lexical overlap, entity centralization, rhetorical structure, etc., lacking measurement of the semantics of text. In this paper, we propose a discourse coherence analysis method combining sentence embedding and the dimension grid, we obtain sentence-level vector representation by deep learning, and we introduce a coherence model that captures the fine-grained semantic transitions in text. Our work is based on the hypothesis that each dimension in the embedding vector is exactly assigned a stated certainty and specific semantic. We take every dimension as an equal grid and compute its transition probabilities. The document feature vector is also enriched to model the coherence. Finally, the experimental results demonstrate that our method achieves excellent performance on two coherence-related tasks. |
| format | Article |
| id | doaj-art-50980c0e8a68459093f46e6c3bca8eac |
| institution | Kabale University |
| issn | 1099-0526 |
| language | English |
| publishDate | 2021-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Complexity |
| spelling | doaj-art-50980c0e8a68459093f46e6c3bca8eac2025-02-03T06:46:24ZengWileyComplexity1099-05262021-01-01202110.1155/2021/6654925A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension GridLanlan Jiang0Shengjun Yuan1Jun Li2School of BusinessSchool of BusinessSchool of Computer Science and Information SecurityDiscourse coherence is strongly associated with text quality, making it important to natural language generation and understanding. However, existing coherence models focus on measuring individual aspects of coherence, such as lexical overlap, entity centralization, rhetorical structure, etc., lacking measurement of the semantics of text. In this paper, we propose a discourse coherence analysis method combining sentence embedding and the dimension grid, we obtain sentence-level vector representation by deep learning, and we introduce a coherence model that captures the fine-grained semantic transitions in text. Our work is based on the hypothesis that each dimension in the embedding vector is exactly assigned a stated certainty and specific semantic. We take every dimension as an equal grid and compute its transition probabilities. The document feature vector is also enriched to model the coherence. Finally, the experimental results demonstrate that our method achieves excellent performance on two coherence-related tasks.http://dx.doi.org/10.1155/2021/6654925 |
| spellingShingle | Lanlan Jiang Shengjun Yuan Jun Li A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid Complexity |
| title | A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid |
| title_full | A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid |
| title_fullStr | A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid |
| title_full_unstemmed | A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid |
| title_short | A Discourse Coherence Analysis Method Combining Sentence Embedding and Dimension Grid |
| title_sort | discourse coherence analysis method combining sentence embedding and dimension grid |
| url | http://dx.doi.org/10.1155/2021/6654925 |
| work_keys_str_mv | AT lanlanjiang adiscoursecoherenceanalysismethodcombiningsentenceembeddinganddimensiongrid AT shengjunyuan adiscoursecoherenceanalysismethodcombiningsentenceembeddinganddimensiongrid AT junli adiscoursecoherenceanalysismethodcombiningsentenceembeddinganddimensiongrid AT lanlanjiang discoursecoherenceanalysismethodcombiningsentenceembeddinganddimensiongrid AT shengjunyuan discoursecoherenceanalysismethodcombiningsentenceembeddinganddimensiongrid AT junli discoursecoherenceanalysismethodcombiningsentenceembeddinganddimensiongrid |