ARTIFICIAL INTELLIGENCE-DRIVEN TESTING IN EFL/ESP CLASSROOMS
This article explores the application of Artificial Intelligence (AI)-driven tools, particularly ChatGPT, for creating vocabulary test tasks in EFL/ESP classrooms. The research aims to evaluate the quality of vocabulary test tasks generated by ChatGPT by applying established criteria, including rel...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Institute for Digitalisation of Education of the NAES of Ukraine
2025-04-01
|
| Series: | Інформаційні технології і засоби навчання |
| Subjects: | |
| Online Access: | https://journal.iitta.gov.ua/index.php/itlt/article/view/5957 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850176394345054208 |
|---|---|
| author | Olena Zhyhadlo Inna Zaiarna |
| author_facet | Olena Zhyhadlo Inna Zaiarna |
| author_sort | Olena Zhyhadlo |
| collection | DOAJ |
| description |
This article explores the application of Artificial Intelligence (AI)-driven tools, particularly ChatGPT, for creating vocabulary test tasks in EFL/ESP classrooms. The research aims to evaluate the quality of vocabulary test tasks generated by ChatGPT by applying established criteria, including relevance, reliability, interactiveness, practicality, and impact. It investigates how ChatGPT-generated tasks meet these criteria and provides practical recommendations for educators to optimize the quality of AI-generated assessments. The authors indicate that criteria such as relevance, practicality, interactivity, and impact can be fully satisfied in ChatGPT-generated tests. However, the research identifies challenges with the reliability of AI-generated test tasks, primarily due to ambiguities in response choices.
The article emphasizes the pivotal role of human intervention in guiding and refining AI-generated outputs. Detailed and context-specific prompts crafted by educators are critical to maximizing the potential of ChatGPT while mitigating its limitations. To support EFL/ESP teachers, the study offers detailed recommendations for enhancing ChatGPT-generated test tasks, such as developing precise prompts, setting clear contexts, assigning specific roles to ChatGPT, and iteratively refining outputs. These strategies improve the reliability and effectiveness of AI-generated assessments and align them with pedagogical standards. The authors emphasise the importance of integrating human oversight with AI tools to maintain the validity and usefulness of language tests. This research contributes to the broader discourse on integrating AI in education by demonstrating how educators can leverage ChatGPT for test design while addressing its limitations. Future directions include evaluating the effectiveness of other types of AI-generated test tasks, exploring AI’s role in automated assessment and feedback, and examining the long-term impact of AI-driven assessments on teaching methodologies and students’ vocabulary acquisition in ESP contexts.
|
| format | Article |
| id | doaj-art-9409fa6d9dba449aae9508593a2cb42c |
| institution | OA Journals |
| issn | 2076-8184 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | Institute for Digitalisation of Education of the NAES of Ukraine |
| record_format | Article |
| series | Інформаційні технології і засоби навчання |
| spelling | doaj-art-9409fa6d9dba449aae9508593a2cb42c2025-08-20T02:19:16ZengInstitute for Digitalisation of Education of the NAES of UkraineІнформаційні технології і засоби навчання2076-81842025-04-01106210.33407/itlt.v106i2.5957ARTIFICIAL INTELLIGENCE-DRIVEN TESTING IN EFL/ESP CLASSROOMSOlena Zhyhadlo0https://orcid.org/0000-0002-1605-7242Inna Zaiarna1https://orcid.org/0000-0002-9464-096XTaras Shevchenko National University of Kyiv, Kyiv, UkraineTaras Shevchenko National University of Kyiv, Kyiv, Ukraine; Institute for Digitalisation of Education of the National Academy of Educational Sciences of Ukraine, Kyiv, Ukraine This article explores the application of Artificial Intelligence (AI)-driven tools, particularly ChatGPT, for creating vocabulary test tasks in EFL/ESP classrooms. The research aims to evaluate the quality of vocabulary test tasks generated by ChatGPT by applying established criteria, including relevance, reliability, interactiveness, practicality, and impact. It investigates how ChatGPT-generated tasks meet these criteria and provides practical recommendations for educators to optimize the quality of AI-generated assessments. The authors indicate that criteria such as relevance, practicality, interactivity, and impact can be fully satisfied in ChatGPT-generated tests. However, the research identifies challenges with the reliability of AI-generated test tasks, primarily due to ambiguities in response choices. The article emphasizes the pivotal role of human intervention in guiding and refining AI-generated outputs. Detailed and context-specific prompts crafted by educators are critical to maximizing the potential of ChatGPT while mitigating its limitations. To support EFL/ESP teachers, the study offers detailed recommendations for enhancing ChatGPT-generated test tasks, such as developing precise prompts, setting clear contexts, assigning specific roles to ChatGPT, and iteratively refining outputs. These strategies improve the reliability and effectiveness of AI-generated assessments and align them with pedagogical standards. The authors emphasise the importance of integrating human oversight with AI tools to maintain the validity and usefulness of language tests. This research contributes to the broader discourse on integrating AI in education by demonstrating how educators can leverage ChatGPT for test design while addressing its limitations. Future directions include evaluating the effectiveness of other types of AI-generated test tasks, exploring AI’s role in automated assessment and feedback, and examining the long-term impact of AI-driven assessments on teaching methodologies and students’ vocabulary acquisition in ESP contexts. https://journal.iitta.gov.ua/index.php/itlt/article/view/5957Artificial IntelligenceChatGPTVocabulary Test DesignEFL/ESP ClassroomsAI-Generated AssessmentsLanguage Testing Criteria |
| spellingShingle | Olena Zhyhadlo Inna Zaiarna ARTIFICIAL INTELLIGENCE-DRIVEN TESTING IN EFL/ESP CLASSROOMS Інформаційні технології і засоби навчання Artificial Intelligence ChatGPT Vocabulary Test Design EFL/ESP Classrooms AI-Generated Assessments Language Testing Criteria |
| title | ARTIFICIAL INTELLIGENCE-DRIVEN TESTING IN EFL/ESP CLASSROOMS |
| title_full | ARTIFICIAL INTELLIGENCE-DRIVEN TESTING IN EFL/ESP CLASSROOMS |
| title_fullStr | ARTIFICIAL INTELLIGENCE-DRIVEN TESTING IN EFL/ESP CLASSROOMS |
| title_full_unstemmed | ARTIFICIAL INTELLIGENCE-DRIVEN TESTING IN EFL/ESP CLASSROOMS |
| title_short | ARTIFICIAL INTELLIGENCE-DRIVEN TESTING IN EFL/ESP CLASSROOMS |
| title_sort | artificial intelligence driven testing in efl esp classrooms |
| topic | Artificial Intelligence ChatGPT Vocabulary Test Design EFL/ESP Classrooms AI-Generated Assessments Language Testing Criteria |
| url | https://journal.iitta.gov.ua/index.php/itlt/article/view/5957 |
| work_keys_str_mv | AT olenazhyhadlo artificialintelligencedriventestingineflespclassrooms AT innazaiarna artificialintelligencedriventestingineflespclassrooms |