Teacher-led and technology-based handwriting evaluations: A mixed-method study among Thai students in Chinese language classes

The structural complexity of Chinese characters presents significant challenges in handwriting evaluation, particularly in educational contexts where accuracy and efficiency are paramount. To address the limitations of traditional assessment methods and explore the potential of technological solutio...

Full description

Saved in:
Bibliographic Details
Main Authors: Katematu Duangmanee, Suppat Rungraungsilp, Krittiya Duangmanee
Format: Article
Language:English
Published: Elsevier 2025-01-01
Series:Social Sciences and Humanities Open
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2590291125001019
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849685816728616960
author Katematu Duangmanee
Suppat Rungraungsilp
Krittiya Duangmanee
author_facet Katematu Duangmanee
Suppat Rungraungsilp
Krittiya Duangmanee
author_sort Katematu Duangmanee
collection DOAJ
description The structural complexity of Chinese characters presents significant challenges in handwriting evaluation, particularly in educational contexts where accuracy and efficiency are paramount. To address the limitations of traditional assessment methods and explore the potential of technological solutions, this study compared teacher-led and Optical Character Recognition (OCR)-based assessments of Chinese handwriting, focusing on time efficiency, scoring accuracy, and teachers' perspectives on the evaluation process. Utilizing a sequential mixed-methods explanatory design, the research involved 50 Thai 12th-grade students majoring in Chinese at a public high school in Thailand, as well as three experienced Chinese language teachers. Quantitative data were collected through a paired sample t-test, which revealed that OCR assessments were significantly faster than teacher-led evaluations (Mean = .36 vs. 5.39 min; t (49) = 16.56, p < 0.001) but consistently scored lower (Mean = 24.36 vs. 31.36; t (49) = 7.3, p < 0.001). Qualitative data from thematic analysis of teacher narratives emphasized the efficiency and physical ease provided by OCR technology, though concerns were raised about its reliance on internet connectivity and inability to interpret nuanced handwriting features. Teachers expressed contrasting views, with some advocating for manual evaluation's accuracy and others favoring the hybrid use of OCR as a preliminary tool to optimize efficiency without compromising precision. The findings accentuate the potential of integrating OCR technology into handwriting assessment while addressing its limitations, offering practical implications for enhancing Chinese language instruction and evaluation in diverse educational contexts.
format Article
id doaj-art-4d75e6e3c0414b70b4105b3ca3271623
institution DOAJ
issn 2590-2911
language English
publishDate 2025-01-01
publisher Elsevier
record_format Article
series Social Sciences and Humanities Open
spelling doaj-art-4d75e6e3c0414b70b4105b3ca32716232025-08-20T03:22:58ZengElsevierSocial Sciences and Humanities Open2590-29112025-01-011110137410.1016/j.ssaho.2025.101374Teacher-led and technology-based handwriting evaluations: A mixed-method study among Thai students in Chinese language classesKatematu Duangmanee0Suppat Rungraungsilp1Krittiya Duangmanee2School of Liberal Arts, Walailak University, ThailandSchool of Infomatics, Walailak University, ThailandFaculty of Commerce and Management, Prince of Songkla University, Thailand; Corresponding author.The structural complexity of Chinese characters presents significant challenges in handwriting evaluation, particularly in educational contexts where accuracy and efficiency are paramount. To address the limitations of traditional assessment methods and explore the potential of technological solutions, this study compared teacher-led and Optical Character Recognition (OCR)-based assessments of Chinese handwriting, focusing on time efficiency, scoring accuracy, and teachers' perspectives on the evaluation process. Utilizing a sequential mixed-methods explanatory design, the research involved 50 Thai 12th-grade students majoring in Chinese at a public high school in Thailand, as well as three experienced Chinese language teachers. Quantitative data were collected through a paired sample t-test, which revealed that OCR assessments were significantly faster than teacher-led evaluations (Mean = .36 vs. 5.39 min; t (49) = 16.56, p < 0.001) but consistently scored lower (Mean = 24.36 vs. 31.36; t (49) = 7.3, p < 0.001). Qualitative data from thematic analysis of teacher narratives emphasized the efficiency and physical ease provided by OCR technology, though concerns were raised about its reliance on internet connectivity and inability to interpret nuanced handwriting features. Teachers expressed contrasting views, with some advocating for manual evaluation's accuracy and others favoring the hybrid use of OCR as a preliminary tool to optimize efficiency without compromising precision. The findings accentuate the potential of integrating OCR technology into handwriting assessment while addressing its limitations, offering practical implications for enhancing Chinese language instruction and evaluation in diverse educational contexts.http://www.sciencedirect.com/science/article/pii/S2590291125001019Chinese charactersAssessmentsOCR programsThai Chinese teachers
spellingShingle Katematu Duangmanee
Suppat Rungraungsilp
Krittiya Duangmanee
Teacher-led and technology-based handwriting evaluations: A mixed-method study among Thai students in Chinese language classes
Social Sciences and Humanities Open
Chinese characters
Assessments
OCR programs
Thai Chinese teachers
title Teacher-led and technology-based handwriting evaluations: A mixed-method study among Thai students in Chinese language classes
title_full Teacher-led and technology-based handwriting evaluations: A mixed-method study among Thai students in Chinese language classes
title_fullStr Teacher-led and technology-based handwriting evaluations: A mixed-method study among Thai students in Chinese language classes
title_full_unstemmed Teacher-led and technology-based handwriting evaluations: A mixed-method study among Thai students in Chinese language classes
title_short Teacher-led and technology-based handwriting evaluations: A mixed-method study among Thai students in Chinese language classes
title_sort teacher led and technology based handwriting evaluations a mixed method study among thai students in chinese language classes
topic Chinese characters
Assessments
OCR programs
Thai Chinese teachers
url http://www.sciencedirect.com/science/article/pii/S2590291125001019
work_keys_str_mv AT katematuduangmanee teacherledandtechnologybasedhandwritingevaluationsamixedmethodstudyamongthaistudentsinchineselanguageclasses
AT suppatrungraungsilp teacherledandtechnologybasedhandwritingevaluationsamixedmethodstudyamongthaistudentsinchineselanguageclasses
AT krittiyaduangmanee teacherledandtechnologybasedhandwritingevaluationsamixedmethodstudyamongthaistudentsinchineselanguageclasses