The Advanced Reasoning Capabilities of Large Language Models for Detecting Contraindicated Options in Medical Exams
AbstractEnhancing clinical reasoning and reducing diagnostic errors are essential in medical practice; OpenAI-o1, with advanced reasoning capabilities, performed better than GPT-4 on 15 Japanese National Medical Licensing Examination questions (accuracy: 100% vs 80%; contraindicated optio...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-05-01
|
| Series: | JMIR Medical Informatics |
| Online Access: | https://medinform.jmir.org/2025/1/e68527 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850271501265141760 |
|---|---|
| author | Yuichiro Yano Mizuki Ohashi Taiju Miyagami Hirotake Mori Yuji Nishizaki Hiroyuki Daida Toshio Naito |
| author_facet | Yuichiro Yano Mizuki Ohashi Taiju Miyagami Hirotake Mori Yuji Nishizaki Hiroyuki Daida Toshio Naito |
| author_sort | Yuichiro Yano |
| collection | DOAJ |
| description |
AbstractEnhancing clinical reasoning and reducing diagnostic errors are essential in medical practice; OpenAI-o1, with advanced reasoning capabilities, performed better than GPT-4 on 15 Japanese National Medical Licensing Examination questions (accuracy: 100% vs 80%; contraindicated option detection: 87% vs 73%), though findings are preliminary due to the small sample size. |
| format | Article |
| id | doaj-art-7ea2a0d8bede48628e39814a45415c0d |
| institution | OA Journals |
| issn | 2291-9694 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Medical Informatics |
| spelling | doaj-art-7ea2a0d8bede48628e39814a45415c0d2025-08-20T01:52:12ZengJMIR PublicationsJMIR Medical Informatics2291-96942025-05-0113e68527e6852710.2196/68527The Advanced Reasoning Capabilities of Large Language Models for Detecting Contraindicated Options in Medical ExamsYuichiro Yanohttp://orcid.org/0000-0002-2565-7290Mizuki Ohashihttp://orcid.org/0000-0001-7770-5656Taiju Miyagamihttp://orcid.org/0000-0002-4893-2224Hirotake Morihttp://orcid.org/0000-0002-7988-5758Yuji Nishizakihttp://orcid.org/0000-0002-6964-6702Hiroyuki Daidahttp://orcid.org/0000-0002-3867-0961Toshio Naitohttp://orcid.org/0000-0003-1646-9930 AbstractEnhancing clinical reasoning and reducing diagnostic errors are essential in medical practice; OpenAI-o1, with advanced reasoning capabilities, performed better than GPT-4 on 15 Japanese National Medical Licensing Examination questions (accuracy: 100% vs 80%; contraindicated option detection: 87% vs 73%), though findings are preliminary due to the small sample size.https://medinform.jmir.org/2025/1/e68527 |
| spellingShingle | Yuichiro Yano Mizuki Ohashi Taiju Miyagami Hirotake Mori Yuji Nishizaki Hiroyuki Daida Toshio Naito The Advanced Reasoning Capabilities of Large Language Models for Detecting Contraindicated Options in Medical Exams JMIR Medical Informatics |
| title | The Advanced Reasoning Capabilities of Large Language Models for Detecting Contraindicated Options in Medical Exams |
| title_full | The Advanced Reasoning Capabilities of Large Language Models for Detecting Contraindicated Options in Medical Exams |
| title_fullStr | The Advanced Reasoning Capabilities of Large Language Models for Detecting Contraindicated Options in Medical Exams |
| title_full_unstemmed | The Advanced Reasoning Capabilities of Large Language Models for Detecting Contraindicated Options in Medical Exams |
| title_short | The Advanced Reasoning Capabilities of Large Language Models for Detecting Contraindicated Options in Medical Exams |
| title_sort | advanced reasoning capabilities of large language models for detecting contraindicated options in medical exams |
| url | https://medinform.jmir.org/2025/1/e68527 |
| work_keys_str_mv | AT yuichiroyano theadvancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT mizukiohashi theadvancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT taijumiyagami theadvancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT hirotakemori theadvancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT yujinishizaki theadvancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT hiroyukidaida theadvancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT toshionaito theadvancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT yuichiroyano advancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT mizukiohashi advancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT taijumiyagami advancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT hirotakemori advancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT yujinishizaki advancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT hiroyukidaida advancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams AT toshionaito advancedreasoningcapabilitiesoflargelanguagemodelsfordetectingcontraindicatedoptionsinmedicalexams |