Computerized Adaptive Testing Framework Based on Excitation Block and Gumbel-Softmax
Computerized Adaptive Testing (CAT) is a personalized assessment method that adaptively selects the most suitable questions for students of different abilities based on their response data. Its primary goal is to effectively measure students’ proficiency in a specific subject in a shorter...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10818464/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841554074130972672 |
|---|---|
| author | Chengsong Liu Yan Wei |
| author_facet | Chengsong Liu Yan Wei |
| author_sort | Chengsong Liu |
| collection | DOAJ |
| description | Computerized Adaptive Testing (CAT) is a personalized assessment method that adaptively selects the most suitable questions for students of different abilities based on their response data. Its primary goal is to effectively measure students’ proficiency in a specific subject in a shorter period. The selection algorithm is pivotal in CAT. The current algorithms inadequately consider the impact of knowledge concept weights in question and student potential factors (e.g., memory) on question selection. In addition, most algorithms primarily focus on accurately predicting students’ abilities, neglecting critical factors such as concept diversity and question exposure rate, which are essential for model effectiveness. Therefore, this paper introduces a new framework for CAT, GECAT. It proposes a selection algorithm based on an excitation block to learn the weights of each knowledge concept in the questions and analyze the impact of student potential factors on their answering performance, thereby selecting more suitable questions for students. Additionally, it views CAT as reinforcement learning, introducing Gumbel-Softmax to provide students with diverse, non-repetitive, and valuable test questions. The experimental results on three real-world datasets demonstrate that the proposed CAT framework improves ACC and AUC by 0.71% and 0.86%, respectively, while reducing question exposure rate and overlap rate by 1.33% and 1.59%, respectively. |
| format | Article |
| id | doaj-art-e3b91bc062ca49a589fad44c2e62887c |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-e3b91bc062ca49a589fad44c2e62887c2025-01-09T00:01:33ZengIEEEIEEE Access2169-35362025-01-01133475348410.1109/ACCESS.2024.352400910818464Computerized Adaptive Testing Framework Based on Excitation Block and Gumbel-SoftmaxChengsong Liu0https://orcid.org/0009-0001-0510-8171Yan Wei1https://orcid.org/0000-0001-6094-1935College of Computer and Information Science, Chongqing Normal University, Chongqing, ChinaCollege of Computer and Information Science, Chongqing Normal University, Chongqing, ChinaComputerized Adaptive Testing (CAT) is a personalized assessment method that adaptively selects the most suitable questions for students of different abilities based on their response data. Its primary goal is to effectively measure students’ proficiency in a specific subject in a shorter period. The selection algorithm is pivotal in CAT. The current algorithms inadequately consider the impact of knowledge concept weights in question and student potential factors (e.g., memory) on question selection. In addition, most algorithms primarily focus on accurately predicting students’ abilities, neglecting critical factors such as concept diversity and question exposure rate, which are essential for model effectiveness. Therefore, this paper introduces a new framework for CAT, GECAT. It proposes a selection algorithm based on an excitation block to learn the weights of each knowledge concept in the questions and analyze the impact of student potential factors on their answering performance, thereby selecting more suitable questions for students. Additionally, it views CAT as reinforcement learning, introducing Gumbel-Softmax to provide students with diverse, non-repetitive, and valuable test questions. The experimental results on three real-world datasets demonstrate that the proposed CAT framework improves ACC and AUC by 0.71% and 0.86%, respectively, while reducing question exposure rate and overlap rate by 1.33% and 1.59%, respectively.https://ieeexplore.ieee.org/document/10818464/Computerized adaptive testingGumbel-Softmaxexcitation blockpotential factors |
| spellingShingle | Chengsong Liu Yan Wei Computerized Adaptive Testing Framework Based on Excitation Block and Gumbel-Softmax IEEE Access Computerized adaptive testing Gumbel-Softmax excitation block potential factors |
| title | Computerized Adaptive Testing Framework Based on Excitation Block and Gumbel-Softmax |
| title_full | Computerized Adaptive Testing Framework Based on Excitation Block and Gumbel-Softmax |
| title_fullStr | Computerized Adaptive Testing Framework Based on Excitation Block and Gumbel-Softmax |
| title_full_unstemmed | Computerized Adaptive Testing Framework Based on Excitation Block and Gumbel-Softmax |
| title_short | Computerized Adaptive Testing Framework Based on Excitation Block and Gumbel-Softmax |
| title_sort | computerized adaptive testing framework based on excitation block and gumbel softmax |
| topic | Computerized adaptive testing Gumbel-Softmax excitation block potential factors |
| url | https://ieeexplore.ieee.org/document/10818464/ |
| work_keys_str_mv | AT chengsongliu computerizedadaptivetestingframeworkbasedonexcitationblockandgumbelsoftmax AT yanwei computerizedadaptivetestingframeworkbasedonexcitationblockandgumbelsoftmax |