Development and Prospects of National Intelligent System for Testing General Language Competencies Deployed Through Neural Network Solutions
The article presents the results of approbation of the intellectual system for testing general language competences (ISTOK) developed by testologists, linguists, specialists in methodology of teaching foreign languages and in artificial intelligence. This system includes a range of tests assessing l...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Moscow Polytechnic University
2023-09-01
|
| Series: | Высшее образование в России |
| Subjects: | |
| Online Access: | https://vovr.elpub.ru/jour/article/view/4550 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832574413118111744 |
|---|---|
| author | E. M. Bazanova A. V. Gorizontova N. N. Gribova T. M. Chikake A. V. Samosyuk |
| author_facet | E. M. Bazanova A. V. Gorizontova N. N. Gribova T. M. Chikake A. V. Samosyuk |
| author_sort | E. M. Bazanova |
| collection | DOAJ |
| description | The article presents the results of approbation of the intellectual system for testing general language competences (ISTOK) developed by testologists, linguists, specialists in methodology of teaching foreign languages and in artificial intelligence. This system includes a range of tests assessing language ability at levels from A2 to C1 of the Common European Framework of Reference (CEFR), as well as an adaptive placement test. All test materials are calibrated according to the CEFR. ISTOK is an adaptive testing system deployed through neural network solutions and providing assessment of receptive and productive language skills (reading, listening, speaking and writing) by using artificial intelligence and/or neurolinguistic models. The process of ISTOK development implied, apart from writing test items, putting together databases of writing and speaking assignments marked by professional assessors and assessment criteria for productive skills, as well as algorithms to identify various types of mistakes with the help of artificial intelligence. The results of various testing cohorts with the total number of test takers exceeding 5,000 demonstrated high reliability and objectified test validity. The new approach to language skills testing can be used for various purposes in higher education institutions, as well and to identify and/or confirm language proficiency of personnel in different organisations and businesses, while the principles of training and practical use of neurolinguistic models will find wide application in various fields of applied research. |
| format | Article |
| id | doaj-art-f203f20fa7fc4db6995b7afe370fc480 |
| institution | Kabale University |
| issn | 0869-3617 2072-0459 |
| language | English |
| publishDate | 2023-09-01 |
| publisher | Moscow Polytechnic University |
| record_format | Article |
| series | Высшее образование в России |
| spelling | doaj-art-f203f20fa7fc4db6995b7afe370fc4802025-02-01T13:14:32ZengMoscow Polytechnic UniversityВысшее образование в России0869-36172072-04592023-09-01328-914716610.31992/0869-3617-2023-32-8-9-147-1662413Development and Prospects of National Intelligent System for Testing General Language Competencies Deployed Through Neural Network SolutionsE. M. Bazanova0A. V. Gorizontova1N. N. Gribova2T. M. Chikake3A. V. Samosyuk4Moscow Institute of Physics and Technology (National Research University)Moscow Institute of Physics and Technology (National Research University)Moscow Institute of Physics and Technology (National Research University)Moscow Institute of Physics and Technology (National Research University)Moscow Institute of Physics and Technology (National Research University)The article presents the results of approbation of the intellectual system for testing general language competences (ISTOK) developed by testologists, linguists, specialists in methodology of teaching foreign languages and in artificial intelligence. This system includes a range of tests assessing language ability at levels from A2 to C1 of the Common European Framework of Reference (CEFR), as well as an adaptive placement test. All test materials are calibrated according to the CEFR. ISTOK is an adaptive testing system deployed through neural network solutions and providing assessment of receptive and productive language skills (reading, listening, speaking and writing) by using artificial intelligence and/or neurolinguistic models. The process of ISTOK development implied, apart from writing test items, putting together databases of writing and speaking assignments marked by professional assessors and assessment criteria for productive skills, as well as algorithms to identify various types of mistakes with the help of artificial intelligence. The results of various testing cohorts with the total number of test takers exceeding 5,000 demonstrated high reliability and objectified test validity. The new approach to language skills testing can be used for various purposes in higher education institutions, as well and to identify and/or confirm language proficiency of personnel in different organisations and businesses, while the principles of training and practical use of neurolinguistic models will find wide application in various fields of applied research.https://vovr.elpub.ru/jour/article/view/4550language testinglanguage assessmentlanguage skills testingadaptive testingmachine learningneuro-linguistic modellinguistic corpusdatabasesneural network solutionsintellectual system of testing common language competencies |
| spellingShingle | E. M. Bazanova A. V. Gorizontova N. N. Gribova T. M. Chikake A. V. Samosyuk Development and Prospects of National Intelligent System for Testing General Language Competencies Deployed Through Neural Network Solutions Высшее образование в России language testing language assessment language skills testing adaptive testing machine learning neuro-linguistic model linguistic corpus databases neural network solutions intellectual system of testing common language competencies |
| title | Development and Prospects of National Intelligent System for Testing General Language Competencies Deployed Through Neural Network Solutions |
| title_full | Development and Prospects of National Intelligent System for Testing General Language Competencies Deployed Through Neural Network Solutions |
| title_fullStr | Development and Prospects of National Intelligent System for Testing General Language Competencies Deployed Through Neural Network Solutions |
| title_full_unstemmed | Development and Prospects of National Intelligent System for Testing General Language Competencies Deployed Through Neural Network Solutions |
| title_short | Development and Prospects of National Intelligent System for Testing General Language Competencies Deployed Through Neural Network Solutions |
| title_sort | development and prospects of national intelligent system for testing general language competencies deployed through neural network solutions |
| topic | language testing language assessment language skills testing adaptive testing machine learning neuro-linguistic model linguistic corpus databases neural network solutions intellectual system of testing common language competencies |
| url | https://vovr.elpub.ru/jour/article/view/4550 |
| work_keys_str_mv | AT embazanova developmentandprospectsofnationalintelligentsystemfortestinggenerallanguagecompetenciesdeployedthroughneuralnetworksolutions AT avgorizontova developmentandprospectsofnationalintelligentsystemfortestinggenerallanguagecompetenciesdeployedthroughneuralnetworksolutions AT nngribova developmentandprospectsofnationalintelligentsystemfortestinggenerallanguagecompetenciesdeployedthroughneuralnetworksolutions AT tmchikake developmentandprospectsofnationalintelligentsystemfortestinggenerallanguagecompetenciesdeployedthroughneuralnetworksolutions AT avsamosyuk developmentandprospectsofnationalintelligentsystemfortestinggenerallanguagecompetenciesdeployedthroughneuralnetworksolutions |