Mitigated deployment strategy for ethical AI in clinical settings
Clinical diagnostic tools can disadvantage subgroups due to poor model generalisability, which can be caused by unrepresentative training data. Practical deployment solutions to mitigate harm for subgroups from models with differential performance have yet to be established. This paper will build on...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMJ Publishing Group
2025-07-01
|
| Series: | BMJ Health & Care Informatics |
| Online Access: | https://informatics.bmj.com/content/32/1/e101363.full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850114060494831616 |
|---|---|
| author | Sahar Abdulrahman Markus Trengove |
| author_facet | Sahar Abdulrahman Markus Trengove |
| author_sort | Sahar Abdulrahman |
| collection | DOAJ |
| description | Clinical diagnostic tools can disadvantage subgroups due to poor model generalisability, which can be caused by unrepresentative training data. Practical deployment solutions to mitigate harm for subgroups from models with differential performance have yet to be established. This paper will build on existing work that considers a selective deployment approach where poorly performing subgroups are excluded from deployments. Alternatively, the proposed ‘mitigated deployment’ strategy requires safety nets to be built into clinical workflows to safeguard under-represented groups in a universal deployment. This approach relies on human–artificial intelligence collaboration and postmarket evaluation to continually improve model performance across subgroups with real-world data. Using a real-world case study, the benefits and limitations of mitigated deployment are explored. This will add to the tools available to healthcare organisations when considering how to safely deploy models with differential performance across subgroups. |
| format | Article |
| id | doaj-art-e273645ebc1746daa68cec16f3677648 |
| institution | OA Journals |
| issn | 2632-1009 |
| language | English |
| publishDate | 2025-07-01 |
| publisher | BMJ Publishing Group |
| record_format | Article |
| series | BMJ Health & Care Informatics |
| spelling | doaj-art-e273645ebc1746daa68cec16f36776482025-08-20T02:36:59ZengBMJ Publishing GroupBMJ Health & Care Informatics2632-10092025-07-0132110.1136/bmjhci-2024-101363Mitigated deployment strategy for ethical AI in clinical settingsSahar Abdulrahman0Markus Trengove1GSK, London, UKGSK, London, UKClinical diagnostic tools can disadvantage subgroups due to poor model generalisability, which can be caused by unrepresentative training data. Practical deployment solutions to mitigate harm for subgroups from models with differential performance have yet to be established. This paper will build on existing work that considers a selective deployment approach where poorly performing subgroups are excluded from deployments. Alternatively, the proposed ‘mitigated deployment’ strategy requires safety nets to be built into clinical workflows to safeguard under-represented groups in a universal deployment. This approach relies on human–artificial intelligence collaboration and postmarket evaluation to continually improve model performance across subgroups with real-world data. Using a real-world case study, the benefits and limitations of mitigated deployment are explored. This will add to the tools available to healthcare organisations when considering how to safely deploy models with differential performance across subgroups.https://informatics.bmj.com/content/32/1/e101363.full |
| spellingShingle | Sahar Abdulrahman Markus Trengove Mitigated deployment strategy for ethical AI in clinical settings BMJ Health & Care Informatics |
| title | Mitigated deployment strategy for ethical AI in clinical settings |
| title_full | Mitigated deployment strategy for ethical AI in clinical settings |
| title_fullStr | Mitigated deployment strategy for ethical AI in clinical settings |
| title_full_unstemmed | Mitigated deployment strategy for ethical AI in clinical settings |
| title_short | Mitigated deployment strategy for ethical AI in clinical settings |
| title_sort | mitigated deployment strategy for ethical ai in clinical settings |
| url | https://informatics.bmj.com/content/32/1/e101363.full |
| work_keys_str_mv | AT saharabdulrahman mitigateddeploymentstrategyforethicalaiinclinicalsettings AT markustrengove mitigateddeploymentstrategyforethicalaiinclinicalsettings |