Can ChatGPT accurately identify the position of parties? A validation study with an expert survey in France
We evaluate whether ChatGPT can be used to estimate the ideological positions of parties in real time. Compared to other methods, ChatGPT can be used at all times, with minimal cost, no technical skills, and for all parties, including new ones. In a validation exercise, we asked ChatGPT and a group...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SAGE Publishing
2025-04-01
|
| Series: | Research & Politics |
| Online Access: | https://doi.org/10.1177/20531680251335653 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849709699468886016 |
|---|---|
| author | Damien Bol Pierre-Henri Bono |
| author_facet | Damien Bol Pierre-Henri Bono |
| author_sort | Damien Bol |
| collection | DOAJ |
| description | We evaluate whether ChatGPT can be used to estimate the ideological positions of parties in real time. Compared to other methods, ChatGPT can be used at all times, with minimal cost, no technical skills, and for all parties, including new ones. In a validation exercise, we asked ChatGPT and a group of local experts to simultaneously estimate the positions of French political parties in the context of the 2024 European election on a series of issues from the Chapel Hill Expert Survey. We find that ChatGPT’s estimations are generally close to those of the expert survey, especially for major and salient political issues (left-right, European integration, immigration). However, it provides less accurate estimates on fringe issues (free market, asylum policies, urban–rural interests) and specific party characteristics (within-party division, issue blurring). Thus, ChatGPT shows strong potential as an alternative data source for estimating parties’ positions but should be used with caution. |
| format | Article |
| id | doaj-art-1d3548d58c2a410bacd630bbea0ca573 |
| institution | DOAJ |
| issn | 2053-1680 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | SAGE Publishing |
| record_format | Article |
| series | Research & Politics |
| spelling | doaj-art-1d3548d58c2a410bacd630bbea0ca5732025-08-20T03:15:12ZengSAGE PublishingResearch & Politics2053-16802025-04-011210.1177/20531680251335653Can ChatGPT accurately identify the position of parties? A validation study with an expert survey in FranceDamien BolPierre-Henri BonoWe evaluate whether ChatGPT can be used to estimate the ideological positions of parties in real time. Compared to other methods, ChatGPT can be used at all times, with minimal cost, no technical skills, and for all parties, including new ones. In a validation exercise, we asked ChatGPT and a group of local experts to simultaneously estimate the positions of French political parties in the context of the 2024 European election on a series of issues from the Chapel Hill Expert Survey. We find that ChatGPT’s estimations are generally close to those of the expert survey, especially for major and salient political issues (left-right, European integration, immigration). However, it provides less accurate estimates on fringe issues (free market, asylum policies, urban–rural interests) and specific party characteristics (within-party division, issue blurring). Thus, ChatGPT shows strong potential as an alternative data source for estimating parties’ positions but should be used with caution.https://doi.org/10.1177/20531680251335653 |
| spellingShingle | Damien Bol Pierre-Henri Bono Can ChatGPT accurately identify the position of parties? A validation study with an expert survey in France Research & Politics |
| title | Can ChatGPT accurately identify the position of parties? A validation study with an expert survey in France |
| title_full | Can ChatGPT accurately identify the position of parties? A validation study with an expert survey in France |
| title_fullStr | Can ChatGPT accurately identify the position of parties? A validation study with an expert survey in France |
| title_full_unstemmed | Can ChatGPT accurately identify the position of parties? A validation study with an expert survey in France |
| title_short | Can ChatGPT accurately identify the position of parties? A validation study with an expert survey in France |
| title_sort | can chatgpt accurately identify the position of parties a validation study with an expert survey in france |
| url | https://doi.org/10.1177/20531680251335653 |
| work_keys_str_mv | AT damienbol canchatgptaccuratelyidentifythepositionofpartiesavalidationstudywithanexpertsurveyinfrance AT pierrehenribono canchatgptaccuratelyidentifythepositionofpartiesavalidationstudywithanexpertsurveyinfrance |