The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysis
Abstract As a new type of artificial intelligence, ChatGPT is becoming widely used in learning. However, academic consensus regarding its efficacy remains elusive. This study aimed to assess the effectiveness of ChatGPT in improving students’ learning performance, learning perception, and higher-ord...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Springer Nature
2025-05-01
|
| Series: | Humanities & Social Sciences Communications |
| Online Access: | https://doi.org/10.1057/s41599-025-04787-y |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849728343626219520 |
|---|---|
| author | Jin Wang Wenxiang Fan |
| author_facet | Jin Wang Wenxiang Fan |
| author_sort | Jin Wang |
| collection | DOAJ |
| description | Abstract As a new type of artificial intelligence, ChatGPT is becoming widely used in learning. However, academic consensus regarding its efficacy remains elusive. This study aimed to assess the effectiveness of ChatGPT in improving students’ learning performance, learning perception, and higher-order thinking through a meta-analysis of 51 research studies published between November 2022 and February 2025. The results indicate that ChatGPT has a large positive impact on improving learning performance (g = 0.867) and a moderately positive impact on enhancing learning perception (g = 0.456) and fostering higher-order thinking (g = 0.457). The impact of ChatGPT on learning performance was moderated by type of course (Q B = 64.249, P < 0.001), learning model (Q B = 76.220, P < 0.001), and duration (Q B = 55.998, P < 0.001); its effect on learning perception was moderated by duration (Q B = 19.839, P < 0.001); and its influence on the development of higher-order thinking was moderated by type of course (Q B = 7.811, P < 0.05) and the role played by ChatGPT (Q B = 4.872, P < 0.05). This study suggests that: (1) appropriate learning scaffolds or educational frameworks (e.g., Bloom’s taxonomy) should be provided when using ChatGPT to develop students’ higher-order thinking; (2) the broad use of ChatGPT at various grade levels and in different types of courses should be encouraged to support diverse learning needs; (3) ChatGPT should be actively integrated into different learning modes to enhance student learning, especially in problem-based learning; (4) continuous use of ChatGPT should be ensured to support student learning, with a recommended duration of 4–8 weeks for more stable effects; (5) ChatGPT should be flexibly integrated into teaching as an intelligent tutor, learning partner, and educational tool. Finally, due to the limited sample size for learning perception and higher-order thinking, and the moderately positive effect, future studies with expanded scope should further explore how to use ChatGPT more effectively to cultivate students’ learning perception and higher-order thinking. |
| format | Article |
| id | doaj-art-dd23fc101626488ba13e7576961c8d2c |
| institution | DOAJ |
| issn | 2662-9992 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | Springer Nature |
| record_format | Article |
| series | Humanities & Social Sciences Communications |
| spelling | doaj-art-dd23fc101626488ba13e7576961c8d2c2025-08-20T03:09:34ZengSpringer NatureHumanities & Social Sciences Communications2662-99922025-05-0112112110.1057/s41599-025-04787-yThe effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysisJin Wang0Wenxiang Fan1Jing Hengyi School of Education, Hangzhou Normal UniversityJing Hengyi School of Education, Hangzhou Normal UniversityAbstract As a new type of artificial intelligence, ChatGPT is becoming widely used in learning. However, academic consensus regarding its efficacy remains elusive. This study aimed to assess the effectiveness of ChatGPT in improving students’ learning performance, learning perception, and higher-order thinking through a meta-analysis of 51 research studies published between November 2022 and February 2025. The results indicate that ChatGPT has a large positive impact on improving learning performance (g = 0.867) and a moderately positive impact on enhancing learning perception (g = 0.456) and fostering higher-order thinking (g = 0.457). The impact of ChatGPT on learning performance was moderated by type of course (Q B = 64.249, P < 0.001), learning model (Q B = 76.220, P < 0.001), and duration (Q B = 55.998, P < 0.001); its effect on learning perception was moderated by duration (Q B = 19.839, P < 0.001); and its influence on the development of higher-order thinking was moderated by type of course (Q B = 7.811, P < 0.05) and the role played by ChatGPT (Q B = 4.872, P < 0.05). This study suggests that: (1) appropriate learning scaffolds or educational frameworks (e.g., Bloom’s taxonomy) should be provided when using ChatGPT to develop students’ higher-order thinking; (2) the broad use of ChatGPT at various grade levels and in different types of courses should be encouraged to support diverse learning needs; (3) ChatGPT should be actively integrated into different learning modes to enhance student learning, especially in problem-based learning; (4) continuous use of ChatGPT should be ensured to support student learning, with a recommended duration of 4–8 weeks for more stable effects; (5) ChatGPT should be flexibly integrated into teaching as an intelligent tutor, learning partner, and educational tool. Finally, due to the limited sample size for learning perception and higher-order thinking, and the moderately positive effect, future studies with expanded scope should further explore how to use ChatGPT more effectively to cultivate students’ learning perception and higher-order thinking.https://doi.org/10.1057/s41599-025-04787-y |
| spellingShingle | Jin Wang Wenxiang Fan The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysis Humanities & Social Sciences Communications |
| title | The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysis |
| title_full | The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysis |
| title_fullStr | The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysis |
| title_full_unstemmed | The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysis |
| title_short | The effect of ChatGPT on students’ learning performance, learning perception, and higher-order thinking: insights from a meta-analysis |
| title_sort | effect of chatgpt on students learning performance learning perception and higher order thinking insights from a meta analysis |
| url | https://doi.org/10.1057/s41599-025-04787-y |
| work_keys_str_mv | AT jinwang theeffectofchatgptonstudentslearningperformancelearningperceptionandhigherorderthinkinginsightsfromametaanalysis AT wenxiangfan theeffectofchatgptonstudentslearningperformancelearningperceptionandhigherorderthinkinginsightsfromametaanalysis AT jinwang effectofchatgptonstudentslearningperformancelearningperceptionandhigherorderthinkinginsightsfromametaanalysis AT wenxiangfan effectofchatgptonstudentslearningperformancelearningperceptionandhigherorderthinkinginsightsfromametaanalysis |