Evaluating Artificial Intelligence’s Role in Developing Research Questions in Head and Neck Reconstruction
Summary:. Generative artificial intelligence (AI) large language models are an emerging technology, with ChatGPT and Gemini being 2 well-known examples. The current literature discusses clinical applications and limitations of AI, but its role in research has not yet been extensively evaluated. This...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wolters Kluwer
2025-08-01
|
| Series: | Plastic and Reconstructive Surgery, Global Open |
| Online Access: | http://journals.lww.com/prsgo/fulltext/10.1097/GOX.0000000000007057 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849222733505757184 |
|---|---|
| author | Sebastian Holm, MD Mario Zambrana, MD Juan E. Berner, MD, PhD Reza Tabrisi, MD Fredrik Landström, MD, PhD Dhafir Hanoon, MD Johann Zdolsek, MD, PhD |
| author_facet | Sebastian Holm, MD Mario Zambrana, MD Juan E. Berner, MD, PhD Reza Tabrisi, MD Fredrik Landström, MD, PhD Dhafir Hanoon, MD Johann Zdolsek, MD, PhD |
| author_sort | Sebastian Holm, MD |
| collection | DOAJ |
| description | Summary:. Generative artificial intelligence (AI) large language models are an emerging technology, with ChatGPT and Gemini being 2 well-known examples. The current literature discusses clinical applications and limitations of AI, but its role in research has not yet been extensively evaluated. This study aimed to assess the role of ChatGPT and Gemini in developing novel and clinically relevant research ideas (RIs) for systematic reviews (SRs) in head and neck reconstruction. ChatGPT and Gemini were prompted to provide 10 novel and clinically relevant RIs for SRs in the following domains: head and neck reconstruction in general, microsurgery, and complications in reconstructive head and neck procedures. A comprehensive search was then performed for SRs in MEDLINE, Cochrane Library, and Embase to determine the novelty of the RIs generated. A total of 60 RIs were generated, with half created by ChatGPT and the other half by Gemini. Overall, 3613 entries were found through the literature search. After deduplication and screening, a total of 50 studies that partially addressed the AI-generated RIs were identified and were included in the present review. Out of the 60 AI-generated RIs, 42 had not been previously studied and were therefore considered novel. No statistically significant differences were found between the outputs generated by Gemini and ChatGPT. Both ChatGPT and Gemini were able to effectively generate novel and clinically relevant RIs for SRs, although their suggestions were generally broad. This study demonstrated that AI could potentially aid in the process of conducting novel SRs. |
| format | Article |
| id | doaj-art-002369fce11b4d439be5717d2211bb81 |
| institution | Kabale University |
| issn | 2169-7574 |
| language | English |
| publishDate | 2025-08-01 |
| publisher | Wolters Kluwer |
| record_format | Article |
| series | Plastic and Reconstructive Surgery, Global Open |
| spelling | doaj-art-002369fce11b4d439be5717d2211bb812025-08-26T03:24:29ZengWolters KluwerPlastic and Reconstructive Surgery, Global Open2169-75742025-08-01138e705710.1097/GOX.0000000000007057202508000-00045Evaluating Artificial Intelligence’s Role in Developing Research Questions in Head and Neck ReconstructionSebastian Holm, MD0Mario Zambrana, MD1Juan E. Berner, MD, PhD2Reza Tabrisi, MD3Fredrik Landström, MD, PhD4Dhafir Hanoon, MD5Johann Zdolsek, MD, PhD6From the * Department of Plastic and Reconstructive Surgery, Örebro University Hospital, Örebro, SwedenFrom the * Department of Plastic and Reconstructive Surgery, Örebro University Hospital, Örebro, Sweden‡ Division of Plastic Surgery, Department of Surgery, University of Texas Health Science Center at San Antonio, San Antonio, TXFrom the * Department of Plastic and Reconstructive Surgery, Örebro University Hospital, Örebro, SwedenFrom the * Department of Plastic and Reconstructive Surgery, Örebro University Hospital, Örebro, SwedenFrom the * Department of Plastic and Reconstructive Surgery, Örebro University Hospital, Örebro, SwedenFrom the * Department of Plastic and Reconstructive Surgery, Örebro University Hospital, Örebro, SwedenSummary:. Generative artificial intelligence (AI) large language models are an emerging technology, with ChatGPT and Gemini being 2 well-known examples. The current literature discusses clinical applications and limitations of AI, but its role in research has not yet been extensively evaluated. This study aimed to assess the role of ChatGPT and Gemini in developing novel and clinically relevant research ideas (RIs) for systematic reviews (SRs) in head and neck reconstruction. ChatGPT and Gemini were prompted to provide 10 novel and clinically relevant RIs for SRs in the following domains: head and neck reconstruction in general, microsurgery, and complications in reconstructive head and neck procedures. A comprehensive search was then performed for SRs in MEDLINE, Cochrane Library, and Embase to determine the novelty of the RIs generated. A total of 60 RIs were generated, with half created by ChatGPT and the other half by Gemini. Overall, 3613 entries were found through the literature search. After deduplication and screening, a total of 50 studies that partially addressed the AI-generated RIs were identified and were included in the present review. Out of the 60 AI-generated RIs, 42 had not been previously studied and were therefore considered novel. No statistically significant differences were found between the outputs generated by Gemini and ChatGPT. Both ChatGPT and Gemini were able to effectively generate novel and clinically relevant RIs for SRs, although their suggestions were generally broad. This study demonstrated that AI could potentially aid in the process of conducting novel SRs.http://journals.lww.com/prsgo/fulltext/10.1097/GOX.0000000000007057 |
| spellingShingle | Sebastian Holm, MD Mario Zambrana, MD Juan E. Berner, MD, PhD Reza Tabrisi, MD Fredrik Landström, MD, PhD Dhafir Hanoon, MD Johann Zdolsek, MD, PhD Evaluating Artificial Intelligence’s Role in Developing Research Questions in Head and Neck Reconstruction Plastic and Reconstructive Surgery, Global Open |
| title | Evaluating Artificial Intelligence’s Role in Developing Research Questions in Head and Neck Reconstruction |
| title_full | Evaluating Artificial Intelligence’s Role in Developing Research Questions in Head and Neck Reconstruction |
| title_fullStr | Evaluating Artificial Intelligence’s Role in Developing Research Questions in Head and Neck Reconstruction |
| title_full_unstemmed | Evaluating Artificial Intelligence’s Role in Developing Research Questions in Head and Neck Reconstruction |
| title_short | Evaluating Artificial Intelligence’s Role in Developing Research Questions in Head and Neck Reconstruction |
| title_sort | evaluating artificial intelligence s role in developing research questions in head and neck reconstruction |
| url | http://journals.lww.com/prsgo/fulltext/10.1097/GOX.0000000000007057 |
| work_keys_str_mv | AT sebastianholmmd evaluatingartificialintelligencesroleindevelopingresearchquestionsinheadandneckreconstruction AT mariozambranamd evaluatingartificialintelligencesroleindevelopingresearchquestionsinheadandneckreconstruction AT juanebernermdphd evaluatingartificialintelligencesroleindevelopingresearchquestionsinheadandneckreconstruction AT rezatabrisimd evaluatingartificialintelligencesroleindevelopingresearchquestionsinheadandneckreconstruction AT fredriklandstrommdphd evaluatingartificialintelligencesroleindevelopingresearchquestionsinheadandneckreconstruction AT dhafirhanoonmd evaluatingartificialintelligencesroleindevelopingresearchquestionsinheadandneckreconstruction AT johannzdolsekmdphd evaluatingartificialintelligencesroleindevelopingresearchquestionsinheadandneckreconstruction |