AUTOMATIC SCORING OF KNOWLEDGE GAINED AND SHARED THROUGH DISCUSSION FORUMS: BASED ON THE COMMUNITY OF INQUIRY MODEL
The Community of Inquiry (CoI) framework has been widely employed for the past two decades to assess the knowledge gained and shared through online discussion forums. The cognitive presence component of the CoI framework helps identify the evidence of thoughtful knowledge reconstructions through me...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Institute for Digitalisation of Education of the NAES of Ukraine
2025-02-01
|
| Series: | Інформаційні технології і засоби навчання |
| Subjects: | |
| Online Access: | https://journal.iitta.gov.ua/index.php/itlt/article/view/5912 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850233308548431872 |
|---|---|
| author | P.A.L. Nadeesha T.A. Weerasinghe W.R.N.S Abeyweera |
| author_facet | P.A.L. Nadeesha T.A. Weerasinghe W.R.N.S Abeyweera |
| author_sort | P.A.L. Nadeesha |
| collection | DOAJ |
| description |
The Community of Inquiry (CoI) framework has been widely employed for the past two decades to assess the knowledge gained and shared through online discussion forums. The cognitive presence component of the CoI framework helps identify the evidence of thoughtful knowledge reconstructions through meaning-making during inquiry-based learning. Identifying and scoring these cognitive presences is essential for assessing the students’ learning achievements through online discussion forums. Considering the difficulties associated with manual coding and identifying cognitive presences in discussion forums and the limitations in the existing techniques for auto-identifying and scoring cognitive presences, this research attempted to develop a more efficient tool to identify and score cognitive presences in online discussion forums. The research employed the constructive research approach. The methodology integrated Random Forest (RF) classification with TF-IDF feature extraction and Support Vector Machine (SVM) classification with Word2Vec embedding. A rule-based classifier, constructed upon indicator mappings, enriched the classification process. A weighted voting ensemble method was employed to combine the outputs of the individual classifiers. Our approach was trained and tested on two datasets comprising 781 messages containing 47,592 words. This ensemble method demonstrated notable efficacy, achieving a 69% accuracy rate in classification tasks. This highlights the robustness of the combined approach in enhancing classification performance. Furthermore, the study introduces a scoring model that calculates individual student scores based on post categories, enabling detailed evaluations of student engagement and participation. By assigning scores reflective of discussion contributions, this model advances comprehensive assessments of online learning interactions. Our work contributes to the ongoing conversation on leveraging machine learning for cognitive analysis in online learning environments, highlighting the importance of context-specific methodologies in advancing educational assessment practices.
|
| format | Article |
| id | doaj-art-cbe1d5d1f78c4ebfb4517568a786ee06 |
| institution | OA Journals |
| issn | 2076-8184 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Institute for Digitalisation of Education of the NAES of Ukraine |
| record_format | Article |
| series | Інформаційні технології і засоби навчання |
| spelling | doaj-art-cbe1d5d1f78c4ebfb4517568a786ee062025-08-20T02:02:57ZengInstitute for Digitalisation of Education of the NAES of UkraineІнформаційні технології і засоби навчання2076-81842025-02-01105110.33407/itlt.v105i1.5912AUTOMATIC SCORING OF KNOWLEDGE GAINED AND SHARED THROUGH DISCUSSION FORUMS: BASED ON THE COMMUNITY OF INQUIRY MODELP.A.L. Nadeesha0https://orcid.org/0009-0005-6329-9091T.A. Weerasinghe1https://orcid.org/0000-0002-7379-3916W.R.N.S Abeyweera2https://orcid.org/0009-0009-9425-4450University of Colombo School of Computing, Colombo, Sri LankaUniversity of Colombo School of Computing, Colombo, Sri LankaUniversity of Colombo School of Computing, Colombo, Sri Lanka The Community of Inquiry (CoI) framework has been widely employed for the past two decades to assess the knowledge gained and shared through online discussion forums. The cognitive presence component of the CoI framework helps identify the evidence of thoughtful knowledge reconstructions through meaning-making during inquiry-based learning. Identifying and scoring these cognitive presences is essential for assessing the students’ learning achievements through online discussion forums. Considering the difficulties associated with manual coding and identifying cognitive presences in discussion forums and the limitations in the existing techniques for auto-identifying and scoring cognitive presences, this research attempted to develop a more efficient tool to identify and score cognitive presences in online discussion forums. The research employed the constructive research approach. The methodology integrated Random Forest (RF) classification with TF-IDF feature extraction and Support Vector Machine (SVM) classification with Word2Vec embedding. A rule-based classifier, constructed upon indicator mappings, enriched the classification process. A weighted voting ensemble method was employed to combine the outputs of the individual classifiers. Our approach was trained and tested on two datasets comprising 781 messages containing 47,592 words. This ensemble method demonstrated notable efficacy, achieving a 69% accuracy rate in classification tasks. This highlights the robustness of the combined approach in enhancing classification performance. Furthermore, the study introduces a scoring model that calculates individual student scores based on post categories, enabling detailed evaluations of student engagement and participation. By assigning scores reflective of discussion contributions, this model advances comprehensive assessments of online learning interactions. Our work contributes to the ongoing conversation on leveraging machine learning for cognitive analysis in online learning environments, highlighting the importance of context-specific methodologies in advancing educational assessment practices. https://journal.iitta.gov.ua/index.php/itlt/article/view/5912Cognitive presenceCommunity of InquiryMachine LearningNatural Language Processing Classification |
| spellingShingle | P.A.L. Nadeesha T.A. Weerasinghe W.R.N.S Abeyweera AUTOMATIC SCORING OF KNOWLEDGE GAINED AND SHARED THROUGH DISCUSSION FORUMS: BASED ON THE COMMUNITY OF INQUIRY MODEL Інформаційні технології і засоби навчання Cognitive presence Community of Inquiry Machine Learning Natural Language Processing Classification |
| title | AUTOMATIC SCORING OF KNOWLEDGE GAINED AND SHARED THROUGH DISCUSSION FORUMS: BASED ON THE COMMUNITY OF INQUIRY MODEL |
| title_full | AUTOMATIC SCORING OF KNOWLEDGE GAINED AND SHARED THROUGH DISCUSSION FORUMS: BASED ON THE COMMUNITY OF INQUIRY MODEL |
| title_fullStr | AUTOMATIC SCORING OF KNOWLEDGE GAINED AND SHARED THROUGH DISCUSSION FORUMS: BASED ON THE COMMUNITY OF INQUIRY MODEL |
| title_full_unstemmed | AUTOMATIC SCORING OF KNOWLEDGE GAINED AND SHARED THROUGH DISCUSSION FORUMS: BASED ON THE COMMUNITY OF INQUIRY MODEL |
| title_short | AUTOMATIC SCORING OF KNOWLEDGE GAINED AND SHARED THROUGH DISCUSSION FORUMS: BASED ON THE COMMUNITY OF INQUIRY MODEL |
| title_sort | automatic scoring of knowledge gained and shared through discussion forums based on the community of inquiry model |
| topic | Cognitive presence Community of Inquiry Machine Learning Natural Language Processing Classification |
| url | https://journal.iitta.gov.ua/index.php/itlt/article/view/5912 |
| work_keys_str_mv | AT palnadeesha automaticscoringofknowledgegainedandsharedthroughdiscussionforumsbasedonthecommunityofinquirymodel AT taweerasinghe automaticscoringofknowledgegainedandsharedthroughdiscussionforumsbasedonthecommunityofinquirymodel AT wrnsabeyweera automaticscoringofknowledgegainedandsharedthroughdiscussionforumsbasedonthecommunityofinquirymodel |