Insights from Self-Reported Student Experiences on using ChatBots
Background and Aim: The development of conversational artificial intelligence tools (ChatBots) provide new ways to access information. Our study aimed to explore if and how medical students utilize chatbots to understand the role of artificial intelligence-powered tools in medical education and the...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Iuliu Hatieganu University of Medicine and Pharmacy, Cluj-Napoca
2025-05-01
|
| Series: | Applied Medical Informatics |
| Subjects: | |
| Online Access: | https://ami.info.umfcluj.ro/index.php/AMI/article/view/1107 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849335271115456512 |
|---|---|
| author | Alexandra-Iulia PĂUCEAN Sorana D. BOLBOACĂ |
| author_facet | Alexandra-Iulia PĂUCEAN Sorana D. BOLBOACĂ |
| author_sort | Alexandra-Iulia PĂUCEAN |
| collection | DOAJ |
| description |
Background and Aim: The development of conversational artificial intelligence tools (ChatBots) provide new ways to access information. Our study aimed to explore if and how medical students utilize chatbots to understand the role of artificial intelligence-powered tools in medical education and their implications for future training and practice. Materials and Methods: The target population was represented by medical students, regardless of specialization, who study at the Iuliu Haţieganu university of Medicine and Pharmacy Cluj-Napoca, Romania. An online questionnaire was developed, and students were invited to participate. The questionnaire was open between 10 October 2024 and 31 January 2025. Results: Ninety-two students, half up to 21 years, 74% female filled the survey. Sixteen percentage of respondents does not use ChatBots, with similar frequency used for learning (45%) or searching medical information (39%). The top three ChatBots are ChatGPT (84%), Gemini (11%) and Copilot (5%). Half of those who use ChatBots (47, 51.1%) considered that ChatBots help them much or very much to understand medical concepts and pathologies. Most participants (61, 79%) considered that the used of ChatBots positively influenced their abilities to ask educational questions. While majority of respondents acknowledged that the retrieved information is sometimes accurate (72, 94%), only 41.3% of respondents check the accuracy at least in 75% of cases; 62% did not check the accuracy at the last interrogation. ChatBots are seen as tools with impact on approaching academic tasks, providing clear and quick explanations to questions (60.9%), organizing information more efficiently (50.0%), or managing time for academic tasks (40.2%). Most respondents (59%) would published the results generated by ChatBots in personal projects or academic papers. Most respondents seen the ChatBots as useful “as long as we do not take over the content word for word, verifying the data and through other reliable sources”. Conclusion: Our results showed that undergraduate medical students used ChatBots, recognize that the retrieved information is only sometimes accurate but unfortunately, they verify the accuracy in less than half interrogations. The main acknowledge benefit is clear and quick explanations to specific questions.
|
| format | Article |
| id | doaj-art-6fc87e4a2d5d42d287b3c759002f4f49 |
| institution | Kabale University |
| issn | 2067-7855 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | Iuliu Hatieganu University of Medicine and Pharmacy, Cluj-Napoca |
| record_format | Article |
| series | Applied Medical Informatics |
| spelling | doaj-art-6fc87e4a2d5d42d287b3c759002f4f492025-08-20T03:45:19ZengIuliu Hatieganu University of Medicine and Pharmacy, Cluj-NapocaApplied Medical Informatics2067-78552025-05-0147Suppl. 1Insights from Self-Reported Student Experiences on using ChatBotsAlexandra-Iulia PĂUCEAN 0Sorana D. BOLBOACĂ1Iuliu Hațieganu University of Medicine and Pharmacy Cluj-Napoca"Iuliu Hatieganu" University of Medicine and Pharmacy Cluj-Napoca Background and Aim: The development of conversational artificial intelligence tools (ChatBots) provide new ways to access information. Our study aimed to explore if and how medical students utilize chatbots to understand the role of artificial intelligence-powered tools in medical education and their implications for future training and practice. Materials and Methods: The target population was represented by medical students, regardless of specialization, who study at the Iuliu Haţieganu university of Medicine and Pharmacy Cluj-Napoca, Romania. An online questionnaire was developed, and students were invited to participate. The questionnaire was open between 10 October 2024 and 31 January 2025. Results: Ninety-two students, half up to 21 years, 74% female filled the survey. Sixteen percentage of respondents does not use ChatBots, with similar frequency used for learning (45%) or searching medical information (39%). The top three ChatBots are ChatGPT (84%), Gemini (11%) and Copilot (5%). Half of those who use ChatBots (47, 51.1%) considered that ChatBots help them much or very much to understand medical concepts and pathologies. Most participants (61, 79%) considered that the used of ChatBots positively influenced their abilities to ask educational questions. While majority of respondents acknowledged that the retrieved information is sometimes accurate (72, 94%), only 41.3% of respondents check the accuracy at least in 75% of cases; 62% did not check the accuracy at the last interrogation. ChatBots are seen as tools with impact on approaching academic tasks, providing clear and quick explanations to questions (60.9%), organizing information more efficiently (50.0%), or managing time for academic tasks (40.2%). Most respondents (59%) would published the results generated by ChatBots in personal projects or academic papers. Most respondents seen the ChatBots as useful “as long as we do not take over the content word for word, verifying the data and through other reliable sources”. Conclusion: Our results showed that undergraduate medical students used ChatBots, recognize that the retrieved information is only sometimes accurate but unfortunately, they verify the accuracy in less than half interrogations. The main acknowledge benefit is clear and quick explanations to specific questions. https://ami.info.umfcluj.ro/index.php/AMI/article/view/1107ChatBotsConversational AI (Artificial Intelligence)Medical Education |
| spellingShingle | Alexandra-Iulia PĂUCEAN Sorana D. BOLBOACĂ Insights from Self-Reported Student Experiences on using ChatBots Applied Medical Informatics ChatBots Conversational AI (Artificial Intelligence) Medical Education |
| title | Insights from Self-Reported Student Experiences on using ChatBots |
| title_full | Insights from Self-Reported Student Experiences on using ChatBots |
| title_fullStr | Insights from Self-Reported Student Experiences on using ChatBots |
| title_full_unstemmed | Insights from Self-Reported Student Experiences on using ChatBots |
| title_short | Insights from Self-Reported Student Experiences on using ChatBots |
| title_sort | insights from self reported student experiences on using chatbots |
| topic | ChatBots Conversational AI (Artificial Intelligence) Medical Education |
| url | https://ami.info.umfcluj.ro/index.php/AMI/article/view/1107 |
| work_keys_str_mv | AT alexandraiuliapaucean insightsfromselfreportedstudentexperiencesonusingchatbots AT soranadbolboaca insightsfromselfreportedstudentexperiencesonusingchatbots |