Can deepseek and ChatGPT be used in the diagnosis of oral pathologies?
Abstract Objective Artificial intelligence (AI) has been widely used in various medical fields to support diagnostic development. The development of different AI techniques has made important contributions to early diagnoses. This research compares and evaluates the diagnostic accuracy of ChatGPT-4o...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2025-04-01
|
| Series: | BMC Oral Health |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12903-025-06034-x |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849311095192289280 |
|---|---|
| author | Ömer Faruk Kaygisiz Mehmet Turhan Teke |
| author_facet | Ömer Faruk Kaygisiz Mehmet Turhan Teke |
| author_sort | Ömer Faruk Kaygisiz |
| collection | DOAJ |
| description | Abstract Objective Artificial intelligence (AI) has been widely used in various medical fields to support diagnostic development. The development of different AI techniques has made important contributions to early diagnoses. This research compares and evaluates the diagnostic accuracy of ChatGPT-4o and Deepseek-v3 AI applications in 16 clinical case scenarios in oral pathologies. Methodology Clinical case scenarios of 16 imaginary oral pathologies were prepared by the authors. The cases were asked to provide 3 possible preliminary diagnoses to two different AI applications, DeepSeek-V3 and ChatGPT-4o, and to reference the literature for these diagnoses. The diagnoses of both AI applications were evaluated with Likert scale by 20 different specialists from two different specialties. Results The mean score for DeepSeek-v3 was 4.02 ± 0.36. For ChatGPT-4o it was 3.15 ± 0.41. According to the average scores, both models performed at a moderate to high level. Also, between the two AI models. DeepSeek-v3 was statistically better in 9 out of 16 clinical scenarios, while ChatGPT-4o was statistically better in 1 question. In general, DeepSeek-v3 was statistically more successful in the comparison of the two models (p = 0.024). In terms of references, ChatGPT-4o showed 62 references and 50 of them were fake, while 8 out of 48 references were fake in DeepSeek-v3. Conclusions Chatbot applications have the potential to become a valuable consultant for clinicians in the future thanks to its fast-processing ability. It is clear that it can help healthcare services by reducing the workload of clinicians. It can be said that the Deepseek-v3 model produces better results compared to ChatGPT-4o, but both applications need to be improved for routine use. It is thought that the release of versions of AI models that can only perform scans in the medical field and respond to clinicians by providing more reliable resources may make these models more valuable. |
| format | Article |
| id | doaj-art-5b5baa30c28849e2810a63a0078b6826 |
| institution | Kabale University |
| issn | 1472-6831 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Oral Health |
| spelling | doaj-art-5b5baa30c28849e2810a63a0078b68262025-08-20T03:53:32ZengBMCBMC Oral Health1472-68312025-04-012511810.1186/s12903-025-06034-xCan deepseek and ChatGPT be used in the diagnosis of oral pathologies?Ömer Faruk Kaygisiz0Mehmet Turhan Teke1Department of Oral and Maxillofacial Surgery, Faculty of Dentistry, Gaziantep UniversityDepartment of Oral and Maxillofacial Surgery, Faculty of Dentistry, Gaziantep UniversityAbstract Objective Artificial intelligence (AI) has been widely used in various medical fields to support diagnostic development. The development of different AI techniques has made important contributions to early diagnoses. This research compares and evaluates the diagnostic accuracy of ChatGPT-4o and Deepseek-v3 AI applications in 16 clinical case scenarios in oral pathologies. Methodology Clinical case scenarios of 16 imaginary oral pathologies were prepared by the authors. The cases were asked to provide 3 possible preliminary diagnoses to two different AI applications, DeepSeek-V3 and ChatGPT-4o, and to reference the literature for these diagnoses. The diagnoses of both AI applications were evaluated with Likert scale by 20 different specialists from two different specialties. Results The mean score for DeepSeek-v3 was 4.02 ± 0.36. For ChatGPT-4o it was 3.15 ± 0.41. According to the average scores, both models performed at a moderate to high level. Also, between the two AI models. DeepSeek-v3 was statistically better in 9 out of 16 clinical scenarios, while ChatGPT-4o was statistically better in 1 question. In general, DeepSeek-v3 was statistically more successful in the comparison of the two models (p = 0.024). In terms of references, ChatGPT-4o showed 62 references and 50 of them were fake, while 8 out of 48 references were fake in DeepSeek-v3. Conclusions Chatbot applications have the potential to become a valuable consultant for clinicians in the future thanks to its fast-processing ability. It is clear that it can help healthcare services by reducing the workload of clinicians. It can be said that the Deepseek-v3 model produces better results compared to ChatGPT-4o, but both applications need to be improved for routine use. It is thought that the release of versions of AI models that can only perform scans in the medical field and respond to clinicians by providing more reliable resources may make these models more valuable.https://doi.org/10.1186/s12903-025-06034-xArtificial intelligentChatGPT-4oDeepseek-V3Oral lesion |
| spellingShingle | Ömer Faruk Kaygisiz Mehmet Turhan Teke Can deepseek and ChatGPT be used in the diagnosis of oral pathologies? BMC Oral Health Artificial intelligent ChatGPT-4o Deepseek-V3 Oral lesion |
| title | Can deepseek and ChatGPT be used in the diagnosis of oral pathologies? |
| title_full | Can deepseek and ChatGPT be used in the diagnosis of oral pathologies? |
| title_fullStr | Can deepseek and ChatGPT be used in the diagnosis of oral pathologies? |
| title_full_unstemmed | Can deepseek and ChatGPT be used in the diagnosis of oral pathologies? |
| title_short | Can deepseek and ChatGPT be used in the diagnosis of oral pathologies? |
| title_sort | can deepseek and chatgpt be used in the diagnosis of oral pathologies |
| topic | Artificial intelligent ChatGPT-4o Deepseek-V3 Oral lesion |
| url | https://doi.org/10.1186/s12903-025-06034-x |
| work_keys_str_mv | AT omerfarukkaygisiz candeepseekandchatgptbeusedinthediagnosisoforalpathologies AT mehmetturhanteke candeepseekandchatgptbeusedinthediagnosisoforalpathologies |