Generative Artificial Intelligence and Risk Appetite in Medical Decisions in Rheumatoid Arthritis
With Generative AI (GenAI) entering medicine, understanding its decision-making under uncertainty is important. It is well known that human subjective risk appetite influences medical decisions. This study investigated whether the risk appetite of GenAI can be evaluated and if established human risk...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-05-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/15/10/5700 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850257427862126592 |
|---|---|
| author | Florian Berghea Dan Andras Elena Camelia Berghea |
| author_facet | Florian Berghea Dan Andras Elena Camelia Berghea |
| author_sort | Florian Berghea |
| collection | DOAJ |
| description | With Generative AI (GenAI) entering medicine, understanding its decision-making under uncertainty is important. It is well known that human subjective risk appetite influences medical decisions. This study investigated whether the risk appetite of GenAI can be evaluated and if established human risk assessment tools are applicable for this purpose in a medical context. Five GenAI systems (ChatGPT 4.5, Gemini 2.0, Qwen 2.5 MAX, DeepSeek-V3, and Perplexity) were evaluated using Rheumatoid Arthritis (RA) clinical scenarios. We employed two methods adapted from human risk assessment: the General Risk Propensity Scale (GRiPS) and the Time Trade-Off (TTO) technique. Queries involving RA cases with varying prognoses and hypothetical treatment choices were posed repeatedly to assess risk profiles and response consistency. All GenAIs consistently identified the same RA cases for the best and worst prognoses. However, the two risk assessment methodologies yielded varied results. The adapted GRiPS showed significant differences in general risk propensity among GenAIs (ChatGPT being the least risk-averse and Qwen/DeepSeek the most), though these differences diminished in specific prognostic contexts. Conversely, the TTO method indicated a strong general risk aversion (unwillingness to trade lifespan for pain relief) across systems yet revealed Perplexity as significantly more risk-tolerant than Gemini. The variability in risk profiles obtained using the GRiPS versus the TTO for the same AI systems raises questions about tool applicability. This discrepancy suggests that these human-centric instruments may not adequately or consistently capture the nuances of risk processing in Artificial Intelligence. The findings imply that current tools might be insufficient, highlighting the need for methodologies specifically tailored for evaluating AI decision-making under medical uncertainty. |
| format | Article |
| id | doaj-art-4b7f108b09fe4004bf2bab4fcf938eae |
| institution | OA Journals |
| issn | 2076-3417 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj-art-4b7f108b09fe4004bf2bab4fcf938eae2025-08-20T01:56:25ZengMDPI AGApplied Sciences2076-34172025-05-011510570010.3390/app15105700Generative Artificial Intelligence and Risk Appetite in Medical Decisions in Rheumatoid ArthritisFlorian Berghea0Dan Andras1Elena Camelia Berghea2Faculty of Medicine, Carol Davila University of Medicine and Pharmacy Bucharest, 050474 București, RomaniaFaculty of Medicine, Carol Davila University of Medicine and Pharmacy Bucharest, 050474 București, RomaniaFaculty of Medicine, Carol Davila University of Medicine and Pharmacy Bucharest, 050474 București, RomaniaWith Generative AI (GenAI) entering medicine, understanding its decision-making under uncertainty is important. It is well known that human subjective risk appetite influences medical decisions. This study investigated whether the risk appetite of GenAI can be evaluated and if established human risk assessment tools are applicable for this purpose in a medical context. Five GenAI systems (ChatGPT 4.5, Gemini 2.0, Qwen 2.5 MAX, DeepSeek-V3, and Perplexity) were evaluated using Rheumatoid Arthritis (RA) clinical scenarios. We employed two methods adapted from human risk assessment: the General Risk Propensity Scale (GRiPS) and the Time Trade-Off (TTO) technique. Queries involving RA cases with varying prognoses and hypothetical treatment choices were posed repeatedly to assess risk profiles and response consistency. All GenAIs consistently identified the same RA cases for the best and worst prognoses. However, the two risk assessment methodologies yielded varied results. The adapted GRiPS showed significant differences in general risk propensity among GenAIs (ChatGPT being the least risk-averse and Qwen/DeepSeek the most), though these differences diminished in specific prognostic contexts. Conversely, the TTO method indicated a strong general risk aversion (unwillingness to trade lifespan for pain relief) across systems yet revealed Perplexity as significantly more risk-tolerant than Gemini. The variability in risk profiles obtained using the GRiPS versus the TTO for the same AI systems raises questions about tool applicability. This discrepancy suggests that these human-centric instruments may not adequately or consistently capture the nuances of risk processing in Artificial Intelligence. The findings imply that current tools might be insufficient, highlighting the need for methodologies specifically tailored for evaluating AI decision-making under medical uncertainty.https://www.mdpi.com/2076-3417/15/10/5700machine learningpersonalized medicinenatural language processing (NLP)risk aversionrheumatoid arthritis |
| spellingShingle | Florian Berghea Dan Andras Elena Camelia Berghea Generative Artificial Intelligence and Risk Appetite in Medical Decisions in Rheumatoid Arthritis Applied Sciences machine learning personalized medicine natural language processing (NLP) risk aversion rheumatoid arthritis |
| title | Generative Artificial Intelligence and Risk Appetite in Medical Decisions in Rheumatoid Arthritis |
| title_full | Generative Artificial Intelligence and Risk Appetite in Medical Decisions in Rheumatoid Arthritis |
| title_fullStr | Generative Artificial Intelligence and Risk Appetite in Medical Decisions in Rheumatoid Arthritis |
| title_full_unstemmed | Generative Artificial Intelligence and Risk Appetite in Medical Decisions in Rheumatoid Arthritis |
| title_short | Generative Artificial Intelligence and Risk Appetite in Medical Decisions in Rheumatoid Arthritis |
| title_sort | generative artificial intelligence and risk appetite in medical decisions in rheumatoid arthritis |
| topic | machine learning personalized medicine natural language processing (NLP) risk aversion rheumatoid arthritis |
| url | https://www.mdpi.com/2076-3417/15/10/5700 |
| work_keys_str_mv | AT florianberghea generativeartificialintelligenceandriskappetiteinmedicaldecisionsinrheumatoidarthritis AT danandras generativeartificialintelligenceandriskappetiteinmedicaldecisionsinrheumatoidarthritis AT elenacameliaberghea generativeartificialintelligenceandriskappetiteinmedicaldecisionsinrheumatoidarthritis |