Research of the factorial knowledge assessment paradigm efficiency illustrated by an example of testing students in the automatic control theory

An algorithm for constructing test materials and the test results evaluation techniques that allow combining high estimate rate and test objectivity are developed. The test system in this case can be considered as an assessment tool for the knowledge level under investigating the appropriate modules...

Full description

Saved in:
Bibliographic Details
Main Authors: Rudolf A. Neydorf, Elena N. Obukhova
Format: Article
Language:Russian
Published: Don State Technical University 2015-09-01
Series:Advanced Engineering Research
Subjects:
Online Access:https://www.vestnik-donstu.ru/jour/article/view/30
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849690488916934656
author Rudolf A. Neydorf
Elena N. Obukhova
author_facet Rudolf A. Neydorf
Elena N. Obukhova
author_sort Rudolf A. Neydorf
collection DOAJ
description An algorithm for constructing test materials and the test results evaluation techniques that allow combining high estimate rate and test objectivity are developed. The test system in this case can be considered as an assessment tool for the knowledge level under investigating the appropriate modules. The decomposition of knowledge into lots of sections is conducted for the knowledge systematization. At that, each section is associated to a set of sub-sections which, in turn, consists of a subset of questions, the answers to which reveal the level of knowledge of each section. The test assignment is formulated in such a way that upon answer, a set of responses revealing the knowledge level of a certain subsection is to be given. Since the test development process is considered as a construction of multivariable dependence, it is proposed to approach the problem from the perspective of planning multifactor experiments. In this case, a set of answers is presented as a set of factors taking on certain values. With their varying on two levels, the problem is reduced to the construction of the experiment that implements all possible combinations of factors, i.e. to a complete factorial experiment. The technique of applying the technology of two-level multifactor experiment planning that allows formalizing the evaluation of partially incomplete knowledge, and implementing the formation of the multifactor tests of different kinds of complexity is offered. To illustrate this technique, the examples of the construction of tests for the discipline “Automatic control theory” assessing the degree of the knowledge level formation are considered. The statistical analysis of the test results has shown the knowledge level of the testees, as well as the credibility of this knowledge.
format Article
id doaj-art-397d239eca9743a38bbfe63e22a1cb7b
institution DOAJ
issn 2687-1653
language Russian
publishDate 2015-09-01
publisher Don State Technical University
record_format Article
series Advanced Engineering Research
spelling doaj-art-397d239eca9743a38bbfe63e22a1cb7b2025-08-20T03:21:18ZrusDon State Technical UniversityAdvanced Engineering Research2687-16532015-09-01153546410.12737/1259630Research of the factorial knowledge assessment paradigm efficiency illustrated by an example of testing students in the automatic control theoryRudolf A. Neydorf0Elena N. Obukhova1Don State Technical UniversityDon State Technical UniversityAn algorithm for constructing test materials and the test results evaluation techniques that allow combining high estimate rate and test objectivity are developed. The test system in this case can be considered as an assessment tool for the knowledge level under investigating the appropriate modules. The decomposition of knowledge into lots of sections is conducted for the knowledge systematization. At that, each section is associated to a set of sub-sections which, in turn, consists of a subset of questions, the answers to which reveal the level of knowledge of each section. The test assignment is formulated in such a way that upon answer, a set of responses revealing the knowledge level of a certain subsection is to be given. Since the test development process is considered as a construction of multivariable dependence, it is proposed to approach the problem from the perspective of planning multifactor experiments. In this case, a set of answers is presented as a set of factors taking on certain values. With their varying on two levels, the problem is reduced to the construction of the experiment that implements all possible combinations of factors, i.e. to a complete factorial experiment. The technique of applying the technology of two-level multifactor experiment planning that allows formalizing the evaluation of partially incomplete knowledge, and implementing the formation of the multifactor tests of different kinds of complexity is offered. To illustrate this technique, the examples of the construction of tests for the discipline “Automatic control theory” assessing the degree of the knowledge level formation are considered. The statistical analysis of the test results has shown the knowledge level of the testees, as well as the credibility of this knowledge.https://www.vestnik-donstu.ru/jour/article/view/30тестированиефактор знаниятестовый вопросоценка ответавариативность ответанеравномерность знанийtestingknowledge factortest questionanswer markanswer variabilityknowledge irregularity
spellingShingle Rudolf A. Neydorf
Elena N. Obukhova
Research of the factorial knowledge assessment paradigm efficiency illustrated by an example of testing students in the automatic control theory
Advanced Engineering Research
тестирование
фактор знания
тестовый вопрос
оценка ответа
вариативность ответа
неравномерность знаний
testing
knowledge factor
test question
answer mark
answer variability
knowledge irregularity
title Research of the factorial knowledge assessment paradigm efficiency illustrated by an example of testing students in the automatic control theory
title_full Research of the factorial knowledge assessment paradigm efficiency illustrated by an example of testing students in the automatic control theory
title_fullStr Research of the factorial knowledge assessment paradigm efficiency illustrated by an example of testing students in the automatic control theory
title_full_unstemmed Research of the factorial knowledge assessment paradigm efficiency illustrated by an example of testing students in the automatic control theory
title_short Research of the factorial knowledge assessment paradigm efficiency illustrated by an example of testing students in the automatic control theory
title_sort research of the factorial knowledge assessment paradigm efficiency illustrated by an example of testing students in the automatic control theory
topic тестирование
фактор знания
тестовый вопрос
оценка ответа
вариативность ответа
неравномерность знаний
testing
knowledge factor
test question
answer mark
answer variability
knowledge irregularity
url https://www.vestnik-donstu.ru/jour/article/view/30
work_keys_str_mv AT rudolfaneydorf researchofthefactorialknowledgeassessmentparadigmefficiencyillustratedbyanexampleoftestingstudentsintheautomaticcontroltheory
AT elenanobukhova researchofthefactorialknowledgeassessmentparadigmefficiencyillustratedbyanexampleoftestingstudentsintheautomaticcontroltheory