Evaluating AI-Generated Language as Models for Strategic Competence in English Language Teaching

Strategic competence, the ability to use communication strategies (CS) to overcome challenges and enhance communication effectiveness, is crucial in language learning. However, the coverage of these strategies as well as target models to teach them remain scarce in current instructional materials. T...

Full description

Saved in:
Bibliographic Details
Main Author: Phuong-Anh Nguyen
Format: Article
Language:English
Published: The International Academic Forum 2024-12-01
Series:IAFOR Journal of Education
Subjects:
Online Access:https://iafor.org/journal/iafor-journal-of-education/volume-12-issue-3/article-13/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841550812649619456
author Phuong-Anh Nguyen
author_facet Phuong-Anh Nguyen
author_sort Phuong-Anh Nguyen
collection DOAJ
description Strategic competence, the ability to use communication strategies (CS) to overcome challenges and enhance communication effectiveness, is crucial in language learning. However, the coverage of these strategies as well as target models to teach them remain scarce in current instructional materials. This paper represents the first attempt to examine the application of ChatGPT in providing target models of CSs and facilitate L2 learners' strategic competence. ChatGPT-4 was used to generate transcripts of monologues and dialogues around a description task following two types of prompts: with and without a taxonomy of communication strategies (structured and unstructured prompts). Preliminary findings suggest Chat-GPT’s considerable potential in modeling communication strategies. Across the two prompting conditions, the chatbot was able to present a wide range of CSs, including achievement, self-monitoring, time-gaining, and interactive strategies. The highest CS content was found in the structured-prompt dialogue which utilized 9 out of 10 CS sub-types, a more diverse range than typically covered in textbooks, with approximation, circumlocution, and time gaining being most frequently used. In terms of linguistic presentation, the AI-generated transcripts demonstrated appropriate use of CSs, though their linguistic realizations were limited in range. The article concludes with implications for leveraging Chat-GPT to contextualize communication strategies, considerations for prompt engineering, strategy training to proficiency levels, and AI-teacher collaboration.
format Article
id doaj-art-f99e8e8121354197809218670b7d96c2
institution Kabale University
issn 2187-0594
language English
publishDate 2024-12-01
publisher The International Academic Forum
record_format Article
series IAFOR Journal of Education
spelling doaj-art-f99e8e8121354197809218670b7d96c22025-01-10T02:34:58ZengThe International Academic ForumIAFOR Journal of Education2187-05942024-12-0112332534910.22492/ije.12.3.13Evaluating AI-Generated Language as Models for Strategic Competence in English Language TeachingPhuong-Anh Nguyen0Hanoi University, VietnamStrategic competence, the ability to use communication strategies (CS) to overcome challenges and enhance communication effectiveness, is crucial in language learning. However, the coverage of these strategies as well as target models to teach them remain scarce in current instructional materials. This paper represents the first attempt to examine the application of ChatGPT in providing target models of CSs and facilitate L2 learners' strategic competence. ChatGPT-4 was used to generate transcripts of monologues and dialogues around a description task following two types of prompts: with and without a taxonomy of communication strategies (structured and unstructured prompts). Preliminary findings suggest Chat-GPT’s considerable potential in modeling communication strategies. Across the two prompting conditions, the chatbot was able to present a wide range of CSs, including achievement, self-monitoring, time-gaining, and interactive strategies. The highest CS content was found in the structured-prompt dialogue which utilized 9 out of 10 CS sub-types, a more diverse range than typically covered in textbooks, with approximation, circumlocution, and time gaining being most frequently used. In terms of linguistic presentation, the AI-generated transcripts demonstrated appropriate use of CSs, though their linguistic realizations were limited in range. The article concludes with implications for leveraging Chat-GPT to contextualize communication strategies, considerations for prompt engineering, strategy training to proficiency levels, and AI-teacher collaboration.https://iafor.org/journal/iafor-journal-of-education/volume-12-issue-3/article-13/aichatgptcommunication strategiesstrategic competence
spellingShingle Phuong-Anh Nguyen
Evaluating AI-Generated Language as Models for Strategic Competence in English Language Teaching
IAFOR Journal of Education
ai
chatgpt
communication strategies
strategic competence
title Evaluating AI-Generated Language as Models for Strategic Competence in English Language Teaching
title_full Evaluating AI-Generated Language as Models for Strategic Competence in English Language Teaching
title_fullStr Evaluating AI-Generated Language as Models for Strategic Competence in English Language Teaching
title_full_unstemmed Evaluating AI-Generated Language as Models for Strategic Competence in English Language Teaching
title_short Evaluating AI-Generated Language as Models for Strategic Competence in English Language Teaching
title_sort evaluating ai generated language as models for strategic competence in english language teaching
topic ai
chatgpt
communication strategies
strategic competence
url https://iafor.org/journal/iafor-journal-of-education/volume-12-issue-3/article-13/
work_keys_str_mv AT phuonganhnguyen evaluatingaigeneratedlanguageasmodelsforstrategiccompetenceinenglishlanguageteaching