A proposed taxonomy of test-taking action and item format in written receptive vocabulary testing

Abstract The functioning of a vocabulary testing instrument rests in part on the test-taking actions made possible for examinees by item format, an aspect of test development that warrants consideration in second-language vocabulary research. For example, although iterations of the written recepti...

Full description

Saved in:
Bibliographic Details
Main Author: Jeffrey Martin
Format: Article
Language:English
Published: Castledown Publishers 2022-04-01
Series:Vocabulary Learning and Instruction
Subjects:
Online Access:https://www.castledown.com/journals/vli/article/view/1798
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850087425907359744
author Jeffrey Martin
author_facet Jeffrey Martin
author_sort Jeffrey Martin
collection DOAJ
description Abstract The functioning of a vocabulary testing instrument rests in part on the test-taking actions made possible for examinees by item format, an aspect of test development that warrants consideration in second-language vocabulary research. For example, although iterations of the written receptive vocabulary levels test (VLT) have integrated improvements in lexis sampling and distractor-item creation (i.e., Beglar & Hunt, 1999, Nation, 1983, 1990, Schmitt et al., 2001, Webb et al., 2017), its clustered form-meaning matching format has remained fundamentally unchanged. This study qualitatively explores the influence of this test item format on test-taking actions observed when taking the updated vocabulary levels test (UVLT, Webb et al, 2017). Data from a think-aloud protocol and retrospective interviewing indicated the predominant use of test-taking strategies for answering test items on the UVLT, such as bidirectional matching and elimination of cluster options, and that these actions enabled correct responses for clusters of target vocabulary about which the test taker demonstrated partial or even no knowledge. This evidence at the interface of test taker and test draws attention to the interconnection of estimating learners’ vocabulary knowledge and the action possibilities provided by item format on vocabulary tests. Such affordances are hierarchically structured in a proposed Taxonomy of Test-taking Actions Afforded by Receptive Vocabulary Test Format as a heuristic to evaluate the influences of test format on written receptive vocabulary assessment.
format Article
id doaj-art-7e04359c6bc345a2ae1c19c930e67826
institution DOAJ
issn 2981-9954
language English
publishDate 2022-04-01
publisher Castledown Publishers
record_format Article
series Vocabulary Learning and Instruction
spelling doaj-art-7e04359c6bc345a2ae1c19c930e678262025-08-20T02:43:13ZengCastledown PublishersVocabulary Learning and Instruction2981-99542022-04-0111110.7820/vli.v11.1.martinA proposed taxonomy of test-taking action and item format in written receptive vocabulary testingJeffrey Martin0Momoyama Gakuin UniversityAbstract The functioning of a vocabulary testing instrument rests in part on the test-taking actions made possible for examinees by item format, an aspect of test development that warrants consideration in second-language vocabulary research. For example, although iterations of the written receptive vocabulary levels test (VLT) have integrated improvements in lexis sampling and distractor-item creation (i.e., Beglar & Hunt, 1999, Nation, 1983, 1990, Schmitt et al., 2001, Webb et al., 2017), its clustered form-meaning matching format has remained fundamentally unchanged. This study qualitatively explores the influence of this test item format on test-taking actions observed when taking the updated vocabulary levels test (UVLT, Webb et al, 2017). Data from a think-aloud protocol and retrospective interviewing indicated the predominant use of test-taking strategies for answering test items on the UVLT, such as bidirectional matching and elimination of cluster options, and that these actions enabled correct responses for clusters of target vocabulary about which the test taker demonstrated partial or even no knowledge. This evidence at the interface of test taker and test draws attention to the interconnection of estimating learners’ vocabulary knowledge and the action possibilities provided by item format on vocabulary tests. Such affordances are hierarchically structured in a proposed Taxonomy of Test-taking Actions Afforded by Receptive Vocabulary Test Format as a heuristic to evaluate the influences of test format on written receptive vocabulary assessment. https://www.castledown.com/journals/vli/article/view/1798affordanceheuristicreceptive vocabulary knowledgetest modalitythink-aloud protocol
spellingShingle Jeffrey Martin
A proposed taxonomy of test-taking action and item format in written receptive vocabulary testing
Vocabulary Learning and Instruction
affordance
heuristic
receptive vocabulary knowledge
test modality
think-aloud protocol
title A proposed taxonomy of test-taking action and item format in written receptive vocabulary testing
title_full A proposed taxonomy of test-taking action and item format in written receptive vocabulary testing
title_fullStr A proposed taxonomy of test-taking action and item format in written receptive vocabulary testing
title_full_unstemmed A proposed taxonomy of test-taking action and item format in written receptive vocabulary testing
title_short A proposed taxonomy of test-taking action and item format in written receptive vocabulary testing
title_sort proposed taxonomy of test taking action and item format in written receptive vocabulary testing
topic affordance
heuristic
receptive vocabulary knowledge
test modality
think-aloud protocol
url https://www.castledown.com/journals/vli/article/view/1798
work_keys_str_mv AT jeffreymartin aproposedtaxonomyoftesttakingactionanditemformatinwrittenreceptivevocabularytesting
AT jeffreymartin proposedtaxonomyoftesttakingactionanditemformatinwrittenreceptivevocabularytesting