Potential role of ChatGPT in simplifying and improving informed consent forms for vaccination: a pilot study conducted in Italy

Objectives Informed consent forms are important for assisting patients in making informed choices regarding medical procedures. Because of their lengthy nature, complexity and specialised terminology, consent forms usually prove challenging for the general public to comprehend. This pilot study aims...

Full description

Saved in:
Bibliographic Details
Main Authors: Chiara Lorini, Guglielmo Bonaccorsi, Marco Del Riccio, Claudia Cosma, Alessio Radi, Rachele Cattano, Patrizio Zanobini
Format: Article
Language:English
Published: BMJ Publishing Group 2025-02-01
Series:BMJ Health & Care Informatics
Online Access:https://informatics.bmj.com/content/32/1/e101248.full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850046326297853952
author Chiara Lorini
Guglielmo Bonaccorsi
Marco Del Riccio
Claudia Cosma
Alessio Radi
Rachele Cattano
Patrizio Zanobini
author_facet Chiara Lorini
Guglielmo Bonaccorsi
Marco Del Riccio
Claudia Cosma
Alessio Radi
Rachele Cattano
Patrizio Zanobini
author_sort Chiara Lorini
collection DOAJ
description Objectives Informed consent forms are important for assisting patients in making informed choices regarding medical procedures. Because of their lengthy nature, complexity and specialised terminology, consent forms usually prove challenging for the general public to comprehend. This pilot study aims to use Chat Generative Pretrained Transformer (ChatGPT), a large language model (LLM), to improve the readability and understandability of a consent form for vaccination.Methods The study was conducted in Italy, within the Central Tuscany Local Health Unit. Three different consent forms were selected and approved: the standard consent form currently in use (A), a new form totally generated by ChatGPT (B) and a modified version of the standard form created by ChatGPT (C). Healthcare professionals in the vaccination unit were asked to evaluate the consent forms regarding adequacy, comprehensibility and completeness and to give an overall judgement. The Kruskal–Wallis test and Dunn’s test were used to evaluate the median scores of the consent forms across these variables.Results Consent forms A and C achieved the top scores in every category; consent form B obtained the lowest score. The median scores were 4.0 for adequacy on consent forms A and C and 3.0 on consent form B. Consent forms A and C received high overall judgement ratings with median scores of 4.0, whereas consent form B received a median score of 3.0.Conclusions The findings indicate that LLM tools such as ChatGPT could enhance healthcare communication by improving the clarity and accessibility of consent forms, but the best results are seen when these tools are combined with human knowledge and supervision.
format Article
id doaj-art-61aaaca504254c0cbeedb367c46aacc7
institution DOAJ
issn 2632-1009
language English
publishDate 2025-02-01
publisher BMJ Publishing Group
record_format Article
series BMJ Health & Care Informatics
spelling doaj-art-61aaaca504254c0cbeedb367c46aacc72025-08-20T02:54:29ZengBMJ Publishing GroupBMJ Health & Care Informatics2632-10092025-02-0132110.1136/bmjhci-2024-101248Potential role of ChatGPT in simplifying and improving informed consent forms for vaccination: a pilot study conducted in ItalyChiara Lorini0Guglielmo Bonaccorsi1Marco Del Riccio2Claudia Cosma3Alessio Radi4Rachele Cattano5Patrizio Zanobini6Department of Health Sciences, University of Florence, Florence, ItalyDepartment of Health Sciences, University of Florence, Florence, ItalyDepartment of Health Sciences, University of Florence, Florence, ItalyDepartment of Health Sciences, University of Florence, Florence, ItalyDepartment of Health Sciences, University of Florence, Florence, ItalyCentral Tuscany Local Health Unit, 50142 Florence, ItalyDepartment of Health Sciences, University of Florence, Florence, ItalyObjectives Informed consent forms are important for assisting patients in making informed choices regarding medical procedures. Because of their lengthy nature, complexity and specialised terminology, consent forms usually prove challenging for the general public to comprehend. This pilot study aims to use Chat Generative Pretrained Transformer (ChatGPT), a large language model (LLM), to improve the readability and understandability of a consent form for vaccination.Methods The study was conducted in Italy, within the Central Tuscany Local Health Unit. Three different consent forms were selected and approved: the standard consent form currently in use (A), a new form totally generated by ChatGPT (B) and a modified version of the standard form created by ChatGPT (C). Healthcare professionals in the vaccination unit were asked to evaluate the consent forms regarding adequacy, comprehensibility and completeness and to give an overall judgement. The Kruskal–Wallis test and Dunn’s test were used to evaluate the median scores of the consent forms across these variables.Results Consent forms A and C achieved the top scores in every category; consent form B obtained the lowest score. The median scores were 4.0 for adequacy on consent forms A and C and 3.0 on consent form B. Consent forms A and C received high overall judgement ratings with median scores of 4.0, whereas consent form B received a median score of 3.0.Conclusions The findings indicate that LLM tools such as ChatGPT could enhance healthcare communication by improving the clarity and accessibility of consent forms, but the best results are seen when these tools are combined with human knowledge and supervision.https://informatics.bmj.com/content/32/1/e101248.full
spellingShingle Chiara Lorini
Guglielmo Bonaccorsi
Marco Del Riccio
Claudia Cosma
Alessio Radi
Rachele Cattano
Patrizio Zanobini
Potential role of ChatGPT in simplifying and improving informed consent forms for vaccination: a pilot study conducted in Italy
BMJ Health & Care Informatics
title Potential role of ChatGPT in simplifying and improving informed consent forms for vaccination: a pilot study conducted in Italy
title_full Potential role of ChatGPT in simplifying and improving informed consent forms for vaccination: a pilot study conducted in Italy
title_fullStr Potential role of ChatGPT in simplifying and improving informed consent forms for vaccination: a pilot study conducted in Italy
title_full_unstemmed Potential role of ChatGPT in simplifying and improving informed consent forms for vaccination: a pilot study conducted in Italy
title_short Potential role of ChatGPT in simplifying and improving informed consent forms for vaccination: a pilot study conducted in Italy
title_sort potential role of chatgpt in simplifying and improving informed consent forms for vaccination a pilot study conducted in italy
url https://informatics.bmj.com/content/32/1/e101248.full
work_keys_str_mv AT chiaralorini potentialroleofchatgptinsimplifyingandimprovinginformedconsentformsforvaccinationapilotstudyconductedinitaly
AT guglielmobonaccorsi potentialroleofchatgptinsimplifyingandimprovinginformedconsentformsforvaccinationapilotstudyconductedinitaly
AT marcodelriccio potentialroleofchatgptinsimplifyingandimprovinginformedconsentformsforvaccinationapilotstudyconductedinitaly
AT claudiacosma potentialroleofchatgptinsimplifyingandimprovinginformedconsentformsforvaccinationapilotstudyconductedinitaly
AT alessioradi potentialroleofchatgptinsimplifyingandimprovinginformedconsentformsforvaccinationapilotstudyconductedinitaly
AT rachelecattano potentialroleofchatgptinsimplifyingandimprovinginformedconsentformsforvaccinationapilotstudyconductedinitaly
AT patriziozanobini potentialroleofchatgptinsimplifyingandimprovinginformedconsentformsforvaccinationapilotstudyconductedinitaly