Using Rasch Analysis for Validation of Knowledge and Perception of Orthopedic Workplace-Based Assessment among Postgraduate Orthopedic Trainees’ Questionnaire
Introduction/Background: Workplace-based assessment (WPBA) was formally introduced into orthopedic postgraduate training in Malaysia as of December 2022. Understanding users' knowledge and perception (KAP) of WPBA is essential for ensuring its effective implementation. A systematic review is ne...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wolters Kluwer Medknow Publications
2025-10-01
|
| Series: | Journal of Pharmacy and Bioallied Sciences |
| Subjects: | |
| Online Access: | https://journals.lww.com/10.4103/jpbs.jpbs_629_24 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850188452003315712 |
|---|---|
| author | Ahmad Anas Abdulmajid Kamarul Ariffin Khalid |
| author_facet | Ahmad Anas Abdulmajid Kamarul Ariffin Khalid |
| author_sort | Ahmad Anas Abdulmajid |
| collection | DOAJ |
| description | Introduction/Background:
Workplace-based assessment (WPBA) was formally introduced into orthopedic postgraduate training in Malaysia as of December 2022. Understanding users' knowledge and perception (KAP) of WPBA is essential for ensuring its effective implementation. A systematic review is needed to evaluate whether WPBA is meeting educational expectations.
Objective:
This study aimed to validate a questionnaire designed to assess the knowledge and perception of WPBA among postgraduate orthopedic trainees.
Materials and Methods:
A pilot study was conducted from Aug 1, 2022 to May 31, 2023 involving a 28-item questionnaire that had undergone thorough face and content validation. The questionnaire was distributed to orthopedic postgraduate trainees at the Department of Orthopaedics, Traumatology and Rehabilitation, Kulliyyah of Medicine, International Islamic University Malaysia (IIUM). Rasch analysis was performed to evaluate the psychometric properties of the instrument.
Results:
The Rasch analysis revealed a person reliability index of 0.93 and a separation index of 3.62, while the item reliability index was 0.99 with a separation index of 8.32. The mean infit and outfit mean square (MNSQ) values were 0.99 and 0.96 respectively, with Z-standard (Z-STD) values of 0.24 and -0.35. Several misfitting items fell outside the acceptable range (0.6–1.4) and were subsequently removed from the questionnaire.
Conclusions:
The validation and reliability testing confirmed that the orthopedic WPBA KAP questionnaire recently developed is both reliable and valid for assessing postgraduate trainees' understanding of WPBA. |
| format | Article |
| id | doaj-art-bfc763cfe8ed40198de965dda9350ed2 |
| institution | OA Journals |
| issn | 0976-4879 0975-7406 |
| language | English |
| publishDate | 2025-10-01 |
| publisher | Wolters Kluwer Medknow Publications |
| record_format | Article |
| series | Journal of Pharmacy and Bioallied Sciences |
| spelling | doaj-art-bfc763cfe8ed40198de965dda9350ed22025-08-20T02:15:53ZengWolters Kluwer Medknow PublicationsJournal of Pharmacy and Bioallied Sciences0976-48790975-74062025-10-0116412612910.4103/jpbs.jpbs_629_24Using Rasch Analysis for Validation of Knowledge and Perception of Orthopedic Workplace-Based Assessment among Postgraduate Orthopedic Trainees’ QuestionnaireAhmad Anas AbdulmajidKamarul Ariffin KhalidIntroduction/Background: Workplace-based assessment (WPBA) was formally introduced into orthopedic postgraduate training in Malaysia as of December 2022. Understanding users' knowledge and perception (KAP) of WPBA is essential for ensuring its effective implementation. A systematic review is needed to evaluate whether WPBA is meeting educational expectations. Objective: This study aimed to validate a questionnaire designed to assess the knowledge and perception of WPBA among postgraduate orthopedic trainees. Materials and Methods: A pilot study was conducted from Aug 1, 2022 to May 31, 2023 involving a 28-item questionnaire that had undergone thorough face and content validation. The questionnaire was distributed to orthopedic postgraduate trainees at the Department of Orthopaedics, Traumatology and Rehabilitation, Kulliyyah of Medicine, International Islamic University Malaysia (IIUM). Rasch analysis was performed to evaluate the psychometric properties of the instrument. Results: The Rasch analysis revealed a person reliability index of 0.93 and a separation index of 3.62, while the item reliability index was 0.99 with a separation index of 8.32. The mean infit and outfit mean square (MNSQ) values were 0.99 and 0.96 respectively, with Z-standard (Z-STD) values of 0.24 and -0.35. Several misfitting items fell outside the acceptable range (0.6–1.4) and were subsequently removed from the questionnaire. Conclusions: The validation and reliability testing confirmed that the orthopedic WPBA KAP questionnaire recently developed is both reliable and valid for assessing postgraduate trainees' understanding of WPBA.https://journals.lww.com/10.4103/jpbs.jpbs_629_24item reliability indexmean infit mean squareorthopedicperson reliability indexrash analysisworkplace-based assessment |
| spellingShingle | Ahmad Anas Abdulmajid Kamarul Ariffin Khalid Using Rasch Analysis for Validation of Knowledge and Perception of Orthopedic Workplace-Based Assessment among Postgraduate Orthopedic Trainees’ Questionnaire Journal of Pharmacy and Bioallied Sciences item reliability index mean infit mean square orthopedic person reliability index rash analysis workplace-based assessment |
| title | Using Rasch Analysis for Validation of Knowledge and Perception of Orthopedic Workplace-Based Assessment among Postgraduate Orthopedic Trainees’ Questionnaire |
| title_full | Using Rasch Analysis for Validation of Knowledge and Perception of Orthopedic Workplace-Based Assessment among Postgraduate Orthopedic Trainees’ Questionnaire |
| title_fullStr | Using Rasch Analysis for Validation of Knowledge and Perception of Orthopedic Workplace-Based Assessment among Postgraduate Orthopedic Trainees’ Questionnaire |
| title_full_unstemmed | Using Rasch Analysis for Validation of Knowledge and Perception of Orthopedic Workplace-Based Assessment among Postgraduate Orthopedic Trainees’ Questionnaire |
| title_short | Using Rasch Analysis for Validation of Knowledge and Perception of Orthopedic Workplace-Based Assessment among Postgraduate Orthopedic Trainees’ Questionnaire |
| title_sort | using rasch analysis for validation of knowledge and perception of orthopedic workplace based assessment among postgraduate orthopedic trainees questionnaire |
| topic | item reliability index mean infit mean square orthopedic person reliability index rash analysis workplace-based assessment |
| url | https://journals.lww.com/10.4103/jpbs.jpbs_629_24 |
| work_keys_str_mv | AT ahmadanasabdulmajid usingraschanalysisforvalidationofknowledgeandperceptionoforthopedicworkplacebasedassessmentamongpostgraduateorthopedictraineesquestionnaire AT kamarulariffinkhalid usingraschanalysisforvalidationofknowledgeandperceptionoforthopedicworkplacebasedassessmentamongpostgraduateorthopedictraineesquestionnaire |