Applying ChatGPT and AI-Powered Tools to Accelerate Evidence Reviews
Artificial intelligence (AI) tools have been used to improve the productivity of evidence review and synthesis since at least 2016, with EPPI-Reviewer and Abstrackr being two prominent examples. However, since the release of ChatGPT by OpenAI in late 2022, the use of generative AI for research, espe...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2024-01-01
|
| Series: | Human Behavior and Emerging Technologies |
| Online Access: | http://dx.doi.org/10.1155/2024/8815424 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850110376375484416 |
|---|---|
| author | Kien Nguyen-Trung Alexander K. Saeri Stefan Kaufman |
| author_facet | Kien Nguyen-Trung Alexander K. Saeri Stefan Kaufman |
| author_sort | Kien Nguyen-Trung |
| collection | DOAJ |
| description | Artificial intelligence (AI) tools have been used to improve the productivity of evidence review and synthesis since at least 2016, with EPPI-Reviewer and Abstrackr being two prominent examples. However, since the release of ChatGPT by OpenAI in late 2022, the use of generative AI for research, especially for text-based data analysis, has exploded. In this article, we used a critical reflection approach to document and evaluate the capacity of different generative AI tools such as ChatGPT, GPT for Google Sheets and Docs, Casper AI, and ChatPDF to assist in the early stages of a rapid evidence review process. Our results demonstrate that these tools can boost research productivity in formulating search strings and screening literature, but they have some notable weaknesses, including producing inconsistent results and occasional errors. We recommend that researchers exercise caution when using generative AI technologies by designing a thorough research strategy and review protocol to ensure effective monitoring and quality control. |
| format | Article |
| id | doaj-art-14c71096c8d8427c8fee7eb2d0e11e62 |
| institution | OA Journals |
| issn | 2578-1863 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Human Behavior and Emerging Technologies |
| spelling | doaj-art-14c71096c8d8427c8fee7eb2d0e11e622025-08-20T02:37:51ZengWileyHuman Behavior and Emerging Technologies2578-18632024-01-01202410.1155/2024/8815424Applying ChatGPT and AI-Powered Tools to Accelerate Evidence ReviewsKien Nguyen-Trung0Alexander K. Saeri1Stefan Kaufman2Water Sensitive Cities AustraliaMIT FutureTechBehaviourWorks AustraliaArtificial intelligence (AI) tools have been used to improve the productivity of evidence review and synthesis since at least 2016, with EPPI-Reviewer and Abstrackr being two prominent examples. However, since the release of ChatGPT by OpenAI in late 2022, the use of generative AI for research, especially for text-based data analysis, has exploded. In this article, we used a critical reflection approach to document and evaluate the capacity of different generative AI tools such as ChatGPT, GPT for Google Sheets and Docs, Casper AI, and ChatPDF to assist in the early stages of a rapid evidence review process. Our results demonstrate that these tools can boost research productivity in formulating search strings and screening literature, but they have some notable weaknesses, including producing inconsistent results and occasional errors. We recommend that researchers exercise caution when using generative AI technologies by designing a thorough research strategy and review protocol to ensure effective monitoring and quality control.http://dx.doi.org/10.1155/2024/8815424 |
| spellingShingle | Kien Nguyen-Trung Alexander K. Saeri Stefan Kaufman Applying ChatGPT and AI-Powered Tools to Accelerate Evidence Reviews Human Behavior and Emerging Technologies |
| title | Applying ChatGPT and AI-Powered Tools to Accelerate Evidence Reviews |
| title_full | Applying ChatGPT and AI-Powered Tools to Accelerate Evidence Reviews |
| title_fullStr | Applying ChatGPT and AI-Powered Tools to Accelerate Evidence Reviews |
| title_full_unstemmed | Applying ChatGPT and AI-Powered Tools to Accelerate Evidence Reviews |
| title_short | Applying ChatGPT and AI-Powered Tools to Accelerate Evidence Reviews |
| title_sort | applying chatgpt and ai powered tools to accelerate evidence reviews |
| url | http://dx.doi.org/10.1155/2024/8815424 |
| work_keys_str_mv | AT kiennguyentrung applyingchatgptandaipoweredtoolstoaccelerateevidencereviews AT alexanderksaeri applyingchatgptandaipoweredtoolstoaccelerateevidencereviews AT stefankaufman applyingchatgptandaipoweredtoolstoaccelerateevidencereviews |