A Bibliometric Exposition and Review on Leveraging LLMs for Programming Education
The world is experiencing an AI revolution, with large language models (LLMs) transforming various industries, including education. Academics are striving to harness the potential of LLMs while also contending with their risks. This paper presents the first bibliometric analysis focused on LLM resea...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10938596/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850264982894149632 |
|---|---|
| author | Joanah Pwanedo Amos Oluwatosin Ahmed Amodu Raja Azlina Raja Mahmood Akanbi Bolakale Abdulqudus Anies Faziehan Zakaria Abimbola Rhoda Iyanda Umar Ali Bukar Zurina Mohd Hanapi |
| author_facet | Joanah Pwanedo Amos Oluwatosin Ahmed Amodu Raja Azlina Raja Mahmood Akanbi Bolakale Abdulqudus Anies Faziehan Zakaria Abimbola Rhoda Iyanda Umar Ali Bukar Zurina Mohd Hanapi |
| author_sort | Joanah Pwanedo Amos |
| collection | DOAJ |
| description | The world is experiencing an AI revolution, with large language models (LLMs) transforming various industries, including education. Academics are striving to harness the potential of LLMs while also contending with their risks. This paper presents the first bibliometric analysis focused on LLM research in programming education, identifying leading countries, authors, and institutions while analyzing key terms and popular keywords in this field. Additionally, it highlights influential studies on topics such as introductory programming, computer science, computing, programming education, and prompt engineering, discussing key insights from these works. Findings indicate that LLMs could play a significant role in programming education and may be integrated into computer science curricula. However, careful consideration is needed to ensure their benefits outweigh their risks across various use cases. This study specifically examines ChatGPT as a representative LLM, exploring its benefits and limitations as both a learning aid for students and a support tool for professionals. It also evaluates the quality of ChatGPT-generated code and its effectiveness in simplifying programming concepts for beginners. Furthermore, the ethical implications of increasing reliance on LLMs for programming tasks, including concerns about dependency, plagiarism, and potential effects on critical thinking, are addressed. By contributing to the ongoing discourse on integrating AI tools like ChatGPT in programming education, this research emphasizes the importance of responsible and ethical usage to maximize benefits for students, educators, and the broader educational community. |
| format | Article |
| id | doaj-art-119c3f0a4003457fa9c5cd5915eab3b0 |
| institution | OA Journals |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-119c3f0a4003457fa9c5cd5915eab3b02025-08-20T01:54:34ZengIEEEIEEE Access2169-35362025-01-0113583645839310.1109/ACCESS.2025.355462710938596A Bibliometric Exposition and Review on Leveraging LLMs for Programming EducationJoanah Pwanedo Amos0Oluwatosin Ahmed Amodu1https://orcid.org/0000-0002-4078-6066Raja Azlina Raja Mahmood2https://orcid.org/0000-0002-1169-4226Akanbi Bolakale Abdulqudus3Anies Faziehan Zakaria4https://orcid.org/0000-0002-6215-422XAbimbola Rhoda Iyanda5https://orcid.org/0000-0002-3470-0115Umar Ali Bukar6https://orcid.org/0000-0002-3983-6919Zurina Mohd Hanapi7https://orcid.org/0000-0002-8079-1791Information and Communication Engineering Department, Elizade University, Ilara-Mokin, NigeriaInformation and Communication Engineering Department, Elizade University, Ilara-Mokin, NigeriaDepartment of Communication Technology and Network, Universiti Putra Malaysia (UPM), Serdang, Selangor, MalaysiaDepartment of Mathematics and Computer Science, Elizade University, Ilara-Mokin, NigeriaDepartment of Engineering Education, Faculty of Engineering and Built Environment, Universiti Kebangsaan Malaysia, Bangi, MalaysiaComputer Science and Engineering Department, Obafemi Awolowo University, Ile-Ife, NigeriaDepartment of Computer Science, Faculty of Computing and Artificial Intelligence, Taraba State University, Jalingo, NigeriaDepartment of Communication Technology and Network, Universiti Putra Malaysia (UPM), Serdang, Selangor, MalaysiaThe world is experiencing an AI revolution, with large language models (LLMs) transforming various industries, including education. Academics are striving to harness the potential of LLMs while also contending with their risks. This paper presents the first bibliometric analysis focused on LLM research in programming education, identifying leading countries, authors, and institutions while analyzing key terms and popular keywords in this field. Additionally, it highlights influential studies on topics such as introductory programming, computer science, computing, programming education, and prompt engineering, discussing key insights from these works. Findings indicate that LLMs could play a significant role in programming education and may be integrated into computer science curricula. However, careful consideration is needed to ensure their benefits outweigh their risks across various use cases. This study specifically examines ChatGPT as a representative LLM, exploring its benefits and limitations as both a learning aid for students and a support tool for professionals. It also evaluates the quality of ChatGPT-generated code and its effectiveness in simplifying programming concepts for beginners. Furthermore, the ethical implications of increasing reliance on LLMs for programming tasks, including concerns about dependency, plagiarism, and potential effects on critical thinking, are addressed. By contributing to the ongoing discourse on integrating AI tools like ChatGPT in programming education, this research emphasizes the importance of responsible and ethical usage to maximize benefits for students, educators, and the broader educational community.https://ieeexplore.ieee.org/document/10938596/ChatGPTcode generationethical concernslarge language models (LLMs)introductory programmingprogramming education |
| spellingShingle | Joanah Pwanedo Amos Oluwatosin Ahmed Amodu Raja Azlina Raja Mahmood Akanbi Bolakale Abdulqudus Anies Faziehan Zakaria Abimbola Rhoda Iyanda Umar Ali Bukar Zurina Mohd Hanapi A Bibliometric Exposition and Review on Leveraging LLMs for Programming Education IEEE Access ChatGPT code generation ethical concerns large language models (LLMs) introductory programming programming education |
| title | A Bibliometric Exposition and Review on Leveraging LLMs for Programming Education |
| title_full | A Bibliometric Exposition and Review on Leveraging LLMs for Programming Education |
| title_fullStr | A Bibliometric Exposition and Review on Leveraging LLMs for Programming Education |
| title_full_unstemmed | A Bibliometric Exposition and Review on Leveraging LLMs for Programming Education |
| title_short | A Bibliometric Exposition and Review on Leveraging LLMs for Programming Education |
| title_sort | bibliometric exposition and review on leveraging llms for programming education |
| topic | ChatGPT code generation ethical concerns large language models (LLMs) introductory programming programming education |
| url | https://ieeexplore.ieee.org/document/10938596/ |
| work_keys_str_mv | AT joanahpwanedoamos abibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT oluwatosinahmedamodu abibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT rajaazlinarajamahmood abibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT akanbibolakaleabdulqudus abibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT aniesfaziehanzakaria abibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT abimbolarhodaiyanda abibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT umaralibukar abibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT zurinamohdhanapi abibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT joanahpwanedoamos bibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT oluwatosinahmedamodu bibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT rajaazlinarajamahmood bibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT akanbibolakaleabdulqudus bibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT aniesfaziehanzakaria bibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT abimbolarhodaiyanda bibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT umaralibukar bibliometricexpositionandreviewonleveragingllmsforprogrammingeducation AT zurinamohdhanapi bibliometricexpositionandreviewonleveragingllmsforprogrammingeducation |