Deconstructing the Testing Mode Effect: Analyzing the Difference Between Writing and No Writing on the Test
The examination of the testing mode effect has received increased attention as higher education has shifted to remote testing during the Covid-19 pandemic. We argue that the testing mode effect should be broken into four distinct subparts: the ability to physically write on the test, the method of...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Indiana University Office of Scholarly Publishing
2024-06-01
|
| Series: | Journal of the Scholarship of Teaching and Learning |
| Subjects: | |
| Online Access: | https://scholarworks.iu.edu/journals/index.php/josotl/article/view/35209 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823856998545883136 |
|---|---|
| author | Daniel M. Settlage Jim Wollscheid |
| author_facet | Daniel M. Settlage Jim Wollscheid |
| author_sort | Daniel M. Settlage |
| collection | DOAJ |
| description |
The examination of the testing mode effect has received increased attention as higher education has shifted to remote testing during the Covid-19 pandemic. We argue that the testing mode effect should be broken into four distinct subparts: the ability to physically write on the test, the method of answer recording, the proctoring/testing environment, and the effect testing mode has on instructor question selection. This paper examines an area largely neglected by the literature surrounding the testing mode effect, the ability (or lack thereof) to write on the test. Using a normalization technique to control for student aptitude and instructor bias, we find that removing the ability of students to physically write on the test significantly lowers student performance. This finding holds across multiple question types classified by difficulty level, Bloom’s taxonomy, and on figure/graph-based questions, and has implications for testing in both face-to-face and online environments.
|
| format | Article |
| id | doaj-art-a075bd7ab98245c6978233297fc445e5 |
| institution | Kabale University |
| issn | 1527-9316 |
| language | English |
| publishDate | 2024-06-01 |
| publisher | Indiana University Office of Scholarly Publishing |
| record_format | Article |
| series | Journal of the Scholarship of Teaching and Learning |
| spelling | doaj-art-a075bd7ab98245c6978233297fc445e52025-02-12T04:15:11ZengIndiana University Office of Scholarly PublishingJournal of the Scholarship of Teaching and Learning1527-93162024-06-01242Deconstructing the Testing Mode Effect: Analyzing the Difference Between Writing and No Writing on the TestDaniel M. Settlage0Jim Wollscheid1University of Arkansas-Fort SmithUniversity of Arkansas-Fort Smith The examination of the testing mode effect has received increased attention as higher education has shifted to remote testing during the Covid-19 pandemic. We argue that the testing mode effect should be broken into four distinct subparts: the ability to physically write on the test, the method of answer recording, the proctoring/testing environment, and the effect testing mode has on instructor question selection. This paper examines an area largely neglected by the literature surrounding the testing mode effect, the ability (or lack thereof) to write on the test. Using a normalization technique to control for student aptitude and instructor bias, we find that removing the ability of students to physically write on the test significantly lowers student performance. This finding holds across multiple question types classified by difficulty level, Bloom’s taxonomy, and on figure/graph-based questions, and has implications for testing in both face-to-face and online environments. https://scholarworks.iu.edu/journals/index.php/josotl/article/view/35209testing modetest environmentwriting on the testpaper versus computer testingtest construction |
| spellingShingle | Daniel M. Settlage Jim Wollscheid Deconstructing the Testing Mode Effect: Analyzing the Difference Between Writing and No Writing on the Test Journal of the Scholarship of Teaching and Learning testing mode test environment writing on the test paper versus computer testing test construction |
| title | Deconstructing the Testing Mode Effect: Analyzing the Difference Between Writing and No Writing on the Test |
| title_full | Deconstructing the Testing Mode Effect: Analyzing the Difference Between Writing and No Writing on the Test |
| title_fullStr | Deconstructing the Testing Mode Effect: Analyzing the Difference Between Writing and No Writing on the Test |
| title_full_unstemmed | Deconstructing the Testing Mode Effect: Analyzing the Difference Between Writing and No Writing on the Test |
| title_short | Deconstructing the Testing Mode Effect: Analyzing the Difference Between Writing and No Writing on the Test |
| title_sort | deconstructing the testing mode effect analyzing the difference between writing and no writing on the test |
| topic | testing mode test environment writing on the test paper versus computer testing test construction |
| url | https://scholarworks.iu.edu/journals/index.php/josotl/article/view/35209 |
| work_keys_str_mv | AT danielmsettlage deconstructingthetestingmodeeffectanalyzingthedifferencebetweenwritingandnowritingonthetest AT jimwollscheid deconstructingthetestingmodeeffectanalyzingthedifferencebetweenwritingandnowritingonthetest |