Effectiveness of AI-generated orthodontic treatment plans compared to expert orthodontist recommendations: a cross-sectional pilot study
ABSTRACT Introduction: Artificial intelligence (AI) has become a prominent focus in orthodontics. Objective: This study aimed to compare treatment plans generated by AI platforms (ChatGPT, Google Bard, Microsoft Bing) with those formulated by an experienced orthodontist. Methods: This observation...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Dental Press Editora
2025-03-01
|
| Series: | Dental Press Journal of Orthodontics |
| Subjects: | |
| Online Access: | http://www.scielo.br/scielo.php?script=sci_arttext&pid=S2176-94512025000100301&tlng=en |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850048621373816832 |
|---|---|
| author | Orlando Motohiro TANAKA Gil Guilherme GASPARELLO Sergio Luiz MOTA-JÚNIOR Mohamad Jamal BARK Jacqueline de Almeida Antunes ROZYSCKI Rafael Bordin WOLANSKI |
| author_facet | Orlando Motohiro TANAKA Gil Guilherme GASPARELLO Sergio Luiz MOTA-JÚNIOR Mohamad Jamal BARK Jacqueline de Almeida Antunes ROZYSCKI Rafael Bordin WOLANSKI |
| author_sort | Orlando Motohiro TANAKA |
| collection | DOAJ |
| description | ABSTRACT Introduction: Artificial intelligence (AI) has become a prominent focus in orthodontics. Objective: This study aimed to compare treatment plans generated by AI platforms (ChatGPT, Google Bard, Microsoft Bing) with those formulated by an experienced orthodontist. Methods: This observational cross-sectional pilot study aims to evaluate the effectiveness of AI-powered platforms in creating orthodontic treatment plans, using a clinical case treated by an experienced orthodontist as a benchmark. A clinical case was selected, and after obtaining informed consent, detailed case information was presented to ChatGPT-3.5, Microsoft Bing Copilot, and Google Bard Gemini for treatment planning. The AI-generated plans, along with the orthodontist’s plan, were evaluated by 34 orthodontists using a questionnaire that included Likert scale and Visual Analog Scale (VAS) items. Statistical analysis was performed to compare the levels of agreement with the proposed treatment plans. Results: Orthodontists exhibited significantly higher levels of agreement with treatment plans proposed by the orthodontist, compared to those generated by AIs platforms (p < 0.001). Both Likert scale and VAS scores indicated increased confidence in the orthodontist’s expertise in formulating treatment plans. No significant differences were found among the AI platforms, though Google Bard received the lowest mean scores. Conclusions: Orthodontists demonstrated a higher level of acceptance of treatment plans formulated by human counterparts over those generated by AI platforms. While AI offers significant contributions, the clinical judgment and experience of orthodontists remain essential for thorough and effective treatment planning in orthodontics. |
| format | Article |
| id | doaj-art-cd85f90bca1b497d8bb27230fc4664e8 |
| institution | DOAJ |
| issn | 2177-6709 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | Dental Press Editora |
| record_format | Article |
| series | Dental Press Journal of Orthodontics |
| spelling | doaj-art-cd85f90bca1b497d8bb27230fc4664e82025-08-20T02:53:54ZengDental Press EditoraDental Press Journal of Orthodontics2177-67092025-03-0130110.1590/2177-6709.30.1.e2524186.oarEffectiveness of AI-generated orthodontic treatment plans compared to expert orthodontist recommendations: a cross-sectional pilot studyOrlando Motohiro TANAKAhttps://orcid.org/0000-0002-1052-7872Gil Guilherme GASPARELLOhttps://orcid.org/0000-0002-8955-6448Sergio Luiz MOTA-JÚNIORhttps://orcid.org/0000-0003-3601-8264Mohamad Jamal BARKhttps://orcid.org/0000-0002-9862-0894Jacqueline de Almeida Antunes ROZYSCKIhttps://orcid.org/0009-0001-3216-0426Rafael Bordin WOLANSKIhttps://orcid.org/0000-0002-3273-5584ABSTRACT Introduction: Artificial intelligence (AI) has become a prominent focus in orthodontics. Objective: This study aimed to compare treatment plans generated by AI platforms (ChatGPT, Google Bard, Microsoft Bing) with those formulated by an experienced orthodontist. Methods: This observational cross-sectional pilot study aims to evaluate the effectiveness of AI-powered platforms in creating orthodontic treatment plans, using a clinical case treated by an experienced orthodontist as a benchmark. A clinical case was selected, and after obtaining informed consent, detailed case information was presented to ChatGPT-3.5, Microsoft Bing Copilot, and Google Bard Gemini for treatment planning. The AI-generated plans, along with the orthodontist’s plan, were evaluated by 34 orthodontists using a questionnaire that included Likert scale and Visual Analog Scale (VAS) items. Statistical analysis was performed to compare the levels of agreement with the proposed treatment plans. Results: Orthodontists exhibited significantly higher levels of agreement with treatment plans proposed by the orthodontist, compared to those generated by AIs platforms (p < 0.001). Both Likert scale and VAS scores indicated increased confidence in the orthodontist’s expertise in formulating treatment plans. No significant differences were found among the AI platforms, though Google Bard received the lowest mean scores. Conclusions: Orthodontists demonstrated a higher level of acceptance of treatment plans formulated by human counterparts over those generated by AI platforms. While AI offers significant contributions, the clinical judgment and experience of orthodontists remain essential for thorough and effective treatment planning in orthodontics.http://www.scielo.br/scielo.php?script=sci_arttext&pid=S2176-94512025000100301&tlng=enArtificial intelligenceTreatment planDiagnosisOrthodontics |
| spellingShingle | Orlando Motohiro TANAKA Gil Guilherme GASPARELLO Sergio Luiz MOTA-JÚNIOR Mohamad Jamal BARK Jacqueline de Almeida Antunes ROZYSCKI Rafael Bordin WOLANSKI Effectiveness of AI-generated orthodontic treatment plans compared to expert orthodontist recommendations: a cross-sectional pilot study Dental Press Journal of Orthodontics Artificial intelligence Treatment plan Diagnosis Orthodontics |
| title | Effectiveness of AI-generated orthodontic treatment plans compared to expert orthodontist recommendations: a cross-sectional pilot study |
| title_full | Effectiveness of AI-generated orthodontic treatment plans compared to expert orthodontist recommendations: a cross-sectional pilot study |
| title_fullStr | Effectiveness of AI-generated orthodontic treatment plans compared to expert orthodontist recommendations: a cross-sectional pilot study |
| title_full_unstemmed | Effectiveness of AI-generated orthodontic treatment plans compared to expert orthodontist recommendations: a cross-sectional pilot study |
| title_short | Effectiveness of AI-generated orthodontic treatment plans compared to expert orthodontist recommendations: a cross-sectional pilot study |
| title_sort | effectiveness of ai generated orthodontic treatment plans compared to expert orthodontist recommendations a cross sectional pilot study |
| topic | Artificial intelligence Treatment plan Diagnosis Orthodontics |
| url | http://www.scielo.br/scielo.php?script=sci_arttext&pid=S2176-94512025000100301&tlng=en |
| work_keys_str_mv | AT orlandomotohirotanaka effectivenessofaigeneratedorthodontictreatmentplanscomparedtoexpertorthodontistrecommendationsacrosssectionalpilotstudy AT gilguilhermegasparello effectivenessofaigeneratedorthodontictreatmentplanscomparedtoexpertorthodontistrecommendationsacrosssectionalpilotstudy AT sergioluizmotajunior effectivenessofaigeneratedorthodontictreatmentplanscomparedtoexpertorthodontistrecommendationsacrosssectionalpilotstudy AT mohamadjamalbark effectivenessofaigeneratedorthodontictreatmentplanscomparedtoexpertorthodontistrecommendationsacrosssectionalpilotstudy AT jacquelinedealmeidaantunesrozyscki effectivenessofaigeneratedorthodontictreatmentplanscomparedtoexpertorthodontistrecommendationsacrosssectionalpilotstudy AT rafaelbordinwolanski effectivenessofaigeneratedorthodontictreatmentplanscomparedtoexpertorthodontistrecommendationsacrosssectionalpilotstudy |