Evaluating Audience Engagement as a Measure of Digital Diplomacy Effectiveness
This article presents relevant tools for analyzing engagement in digital diplomacy, where ‘engagement’ is defined as the two-way interaction between a digital diplomacy channel on social media and its users. Existing methods for evaluating engagement often fail to fully utilize the available data or...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MGIMO University Press
2024-09-01
|
| Series: | Vestnik MGIMO-Universiteta |
| Subjects: | |
| Online Access: | https://www.vestnik.mgimo.ru/jour/article/view/3739 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832579366276562944 |
|---|---|
| author | M. M. Bazlutckaia A. N. Sytnik N. A. Tsvetkova |
| author_facet | M. M. Bazlutckaia A. N. Sytnik N. A. Tsvetkova |
| author_sort | M. M. Bazlutckaia |
| collection | DOAJ |
| description | This article presents relevant tools for analyzing engagement in digital diplomacy, where ‘engagement’ is defined as the two-way interaction between a digital diplomacy channel on social media and its users. Existing methods for evaluating engagement often fail to fully utilize the available data or lack the flexibility needed for specific diplomatic purposes. Using the case study of US digital diplomacy in Russia, this paper addresses two research questions: (1) To what extent are the automated evaluation metrics developed by data aggregator platforms applicable for analyzing engagement in digital diplomacy? (2) Do these metrics help identify significant patterns in digital diplomacy?The findings of our pilot study indicate that the automated engagement metrics provided by the Popsters and TGStat data aggregator services effectively measure engagement in terms of audience reach and expansion, geographic distribution of traffic, overall engagement, and engagement based on content type (text, photo, video, or link) or text length. The analysis of selected metrics reveals two key trends in US digital diplomacy in Russia: since 2022 there has been a notable shift in focus toward Telegram as the primary platform, and while the content partially reaches the existing Russian-speaking audience, it struggles to expand its overall reach.The authors provide six recommendations for diplomatic agencies and consulting firms to enhance the tools for analyzing digital diplomacy engagement: (1) adopt automated engagement metrics that account for the interface differences among social media platforms; (2) incorporate built-in topic modeling of posts; (3) integrate sentiment analysis of comments; (4) develop mechanisms to detect traffic manipulation; (5) track multi-level reposts, the timing and spread of hashtag diplomacy, and audience growth considering these processes; and (6) evaluate digital diplomacy activity concerning responses to comments. The authors advocate for closer collaboration between the academic community and diplomatic practitioners to improve engagement metrics and thereby enhance the effectiveness of digital diplomacy. |
| format | Article |
| id | doaj-art-cda0837bf0d94a83a7baea2cf52a04ee |
| institution | Kabale University |
| issn | 2071-8160 2541-9099 |
| language | English |
| publishDate | 2024-09-01 |
| publisher | MGIMO University Press |
| record_format | Article |
| series | Vestnik MGIMO-Universiteta |
| spelling | doaj-art-cda0837bf0d94a83a7baea2cf52a04ee2025-01-30T12:16:18ZengMGIMO University PressVestnik MGIMO-Universiteta2071-81602541-90992024-09-01174488210.24833/2071-8160-2024-4-97-48-822606Evaluating Audience Engagement as a Measure of Digital Diplomacy EffectivenessM. M. Bazlutckaia0A. N. Sytnik1N. A. Tsvetkova2MGIMO UniversitySt. Petersburg State UniversitySt. Petersburg State UniversityThis article presents relevant tools for analyzing engagement in digital diplomacy, where ‘engagement’ is defined as the two-way interaction between a digital diplomacy channel on social media and its users. Existing methods for evaluating engagement often fail to fully utilize the available data or lack the flexibility needed for specific diplomatic purposes. Using the case study of US digital diplomacy in Russia, this paper addresses two research questions: (1) To what extent are the automated evaluation metrics developed by data aggregator platforms applicable for analyzing engagement in digital diplomacy? (2) Do these metrics help identify significant patterns in digital diplomacy?The findings of our pilot study indicate that the automated engagement metrics provided by the Popsters and TGStat data aggregator services effectively measure engagement in terms of audience reach and expansion, geographic distribution of traffic, overall engagement, and engagement based on content type (text, photo, video, or link) or text length. The analysis of selected metrics reveals two key trends in US digital diplomacy in Russia: since 2022 there has been a notable shift in focus toward Telegram as the primary platform, and while the content partially reaches the existing Russian-speaking audience, it struggles to expand its overall reach.The authors provide six recommendations for diplomatic agencies and consulting firms to enhance the tools for analyzing digital diplomacy engagement: (1) adopt automated engagement metrics that account for the interface differences among social media platforms; (2) incorporate built-in topic modeling of posts; (3) integrate sentiment analysis of comments; (4) develop mechanisms to detect traffic manipulation; (5) track multi-level reposts, the timing and spread of hashtag diplomacy, and audience growth considering these processes; and (6) evaluate digital diplomacy activity concerning responses to comments. The authors advocate for closer collaboration between the academic community and diplomatic practitioners to improve engagement metrics and thereby enhance the effectiveness of digital diplomacy.https://www.vestnik.mgimo.ru/jour/article/view/3739engagementdigital diplomacyusrussiasocial mediatelegramvkeffectivenessmetrics |
| spellingShingle | M. M. Bazlutckaia A. N. Sytnik N. A. Tsvetkova Evaluating Audience Engagement as a Measure of Digital Diplomacy Effectiveness Vestnik MGIMO-Universiteta engagement digital diplomacy us russia social media telegram vk effectiveness metrics |
| title | Evaluating Audience Engagement as a Measure of Digital Diplomacy Effectiveness |
| title_full | Evaluating Audience Engagement as a Measure of Digital Diplomacy Effectiveness |
| title_fullStr | Evaluating Audience Engagement as a Measure of Digital Diplomacy Effectiveness |
| title_full_unstemmed | Evaluating Audience Engagement as a Measure of Digital Diplomacy Effectiveness |
| title_short | Evaluating Audience Engagement as a Measure of Digital Diplomacy Effectiveness |
| title_sort | evaluating audience engagement as a measure of digital diplomacy effectiveness |
| topic | engagement digital diplomacy us russia social media telegram vk effectiveness metrics |
| url | https://www.vestnik.mgimo.ru/jour/article/view/3739 |
| work_keys_str_mv | AT mmbazlutckaia evaluatingaudienceengagementasameasureofdigitaldiplomacyeffectiveness AT ansytnik evaluatingaudienceengagementasameasureofdigitaldiplomacyeffectiveness AT natsvetkova evaluatingaudienceengagementasameasureofdigitaldiplomacyeffectiveness |