Development and Validation of a Game-Based Assessment for Complex Problem Solving

Complex problem solving (CPS) refers to a set of higher-order capacities that allow an individual to interact with a dynamic environment and solve complex problems. The purpose of this study was to develop and validate Sokoban, a game-based assessment of the planning–execution stage of the CPS frame...

Full description

Saved in:
Bibliographic Details
Main Authors: Jian Li, Yi Ming Li, Yun-Xuan Xing, Bo Zhang, Yun Tang, Fritz Drasgow
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Journal of Intelligence
Subjects:
Online Access:https://www.mdpi.com/2079-3200/13/1/9
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832588271206531072
author Jian Li
Yi Ming Li
Yun-Xuan Xing
Bo Zhang
Yun Tang
Fritz Drasgow
author_facet Jian Li
Yi Ming Li
Yun-Xuan Xing
Bo Zhang
Yun Tang
Fritz Drasgow
author_sort Jian Li
collection DOAJ
description Complex problem solving (CPS) refers to a set of higher-order capacities that allow an individual to interact with a dynamic environment and solve complex problems. The purpose of this study was to develop and validate Sokoban, a game-based assessment of the planning–execution stage of the CPS framework proposed by PISA 2012. The psychometric properties of this instrument were examined in a large sample of Chinese students (<i>n</i> = 1145) ranging from elementary to tertiary education. The results supported the two-faceted nature of Sokoban, as well as providing preliminary evidence about criterion-related and predictive validity for the planning–execution stages of complex problem solving. These empirical results lend support to the validity of this game-based assessment, as well as its practical implications in educational settings.
format Article
id doaj-art-4a9bf745a1db4debb57d8adbd72d81a8
institution Kabale University
issn 2079-3200
language English
publishDate 2025-01-01
publisher MDPI AG
record_format Article
series Journal of Intelligence
spelling doaj-art-4a9bf745a1db4debb57d8adbd72d81a82025-01-24T13:36:23ZengMDPI AGJournal of Intelligence2079-32002025-01-01131910.3390/jintelligence13010009Development and Validation of a Game-Based Assessment for Complex Problem SolvingJian Li0Yi Ming Li1Yun-Xuan Xing2Bo Zhang3Yun Tang4Fritz Drasgow5Faculty of Psychology, Beijing Normal University, Beijing 100875, ChinaSchool of Ideological and Political Education and Moral Education, Beijing Institute of Education, Beijing 100120, ChinaFaculty of Psychology, Beijing Normal University, Beijing 100875, ChinaSchool of Labor and Employment Relations, University of Illinois Urbana-Champaign, Champaign, IL 61820, USASchool of Psychology, Central China Normal University, Wuhan 430079, ChinaSchool of Labor and Employment Relations, University of Illinois Urbana-Champaign, Champaign, IL 61820, USAComplex problem solving (CPS) refers to a set of higher-order capacities that allow an individual to interact with a dynamic environment and solve complex problems. The purpose of this study was to develop and validate Sokoban, a game-based assessment of the planning–execution stage of the CPS framework proposed by PISA 2012. The psychometric properties of this instrument were examined in a large sample of Chinese students (<i>n</i> = 1145) ranging from elementary to tertiary education. The results supported the two-faceted nature of Sokoban, as well as providing preliminary evidence about criterion-related and predictive validity for the planning–execution stages of complex problem solving. These empirical results lend support to the validity of this game-based assessment, as well as its practical implications in educational settings.https://www.mdpi.com/2079-3200/13/1/9complex problem solvingplanning–executionmetacognitiongame-based assessmentachievementSokoban task
spellingShingle Jian Li
Yi Ming Li
Yun-Xuan Xing
Bo Zhang
Yun Tang
Fritz Drasgow
Development and Validation of a Game-Based Assessment for Complex Problem Solving
Journal of Intelligence
complex problem solving
planning–execution
metacognition
game-based assessment
achievement
Sokoban task
title Development and Validation of a Game-Based Assessment for Complex Problem Solving
title_full Development and Validation of a Game-Based Assessment for Complex Problem Solving
title_fullStr Development and Validation of a Game-Based Assessment for Complex Problem Solving
title_full_unstemmed Development and Validation of a Game-Based Assessment for Complex Problem Solving
title_short Development and Validation of a Game-Based Assessment for Complex Problem Solving
title_sort development and validation of a game based assessment for complex problem solving
topic complex problem solving
planning–execution
metacognition
game-based assessment
achievement
Sokoban task
url https://www.mdpi.com/2079-3200/13/1/9
work_keys_str_mv AT jianli developmentandvalidationofagamebasedassessmentforcomplexproblemsolving
AT yimingli developmentandvalidationofagamebasedassessmentforcomplexproblemsolving
AT yunxuanxing developmentandvalidationofagamebasedassessmentforcomplexproblemsolving
AT bozhang developmentandvalidationofagamebasedassessmentforcomplexproblemsolving
AT yuntang developmentandvalidationofagamebasedassessmentforcomplexproblemsolving
AT fritzdrasgow developmentandvalidationofagamebasedassessmentforcomplexproblemsolving