The development, implementation and evaluation of a short course in objective structured clinical examination (OSCE) skills
Background: Objective structured clinical examination (OSCE) examiner training is widely employed to address some of the reliability and validity issues that accompany the use of this assessment tool. An OSCE skills course was developed and implemented at the Stellenbosch Faculty of Health Sciences...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
AOSIS
2012-02-01
|
| Series: | South African Family Practice |
| Subjects: | |
| Online Access: | https://safpj.co.za/index.php/safpj/article/view/1734 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849234240647987200 |
|---|---|
| author | A. de Villiers E. Archer |
| author_facet | A. de Villiers E. Archer |
| author_sort | A. de Villiers |
| collection | DOAJ |
| description | Background: Objective structured clinical examination (OSCE) examiner training is widely employed to address some of the reliability and validity issues that accompany the use of this assessment tool. An OSCE skills course was developed and implemented at the Stellenbosch Faculty of Health Sciences and its influence on participants (clinicians) evaluated.
Method: Participants attended the OSCE skills course, which included theoretical sessions concerning topics such as standard setting, examiner influence and assessment instruments, as well as two staged OSCEs, one at the beginning and the other at the end of the course. During the latter, each participant examined a student role-player performing a technical skill while being video recorded. Participants’ behaviour and assessment results from the two OSCEs were evaluated, as well as the feedback from participants regarding the course and group interviews with student role players.
Results: There was a significant improvement in inter-rater reliability as well as a slight decrease in inappropriate examiner behaviour, such as teaching and prompting during assessment of students. Furthermore, overall feedback from participants and perceptions of student role players was positive.
Conclusions: In this study, examiner conduct and inter-rater reliability was positively influenced by the following interventions: examiner briefing, involvement of examiners in constructing assessment instruments, as well as examiners viewing (on DVD) and reflecting on their assessment behaviour. This study proposes that the development and implementation of an OSCE skills course is a worthwhile endeavour in improving validity and reliability of the OSCE as an assessment tool. |
| format | Article |
| id | doaj-art-59899fe9b6fc44aa8961049d39eb2521 |
| institution | Kabale University |
| issn | 2078-6190 2078-6204 |
| language | English |
| publishDate | 2012-02-01 |
| publisher | AOSIS |
| record_format | Article |
| series | South African Family Practice |
| spelling | doaj-art-59899fe9b6fc44aa8961049d39eb25212025-08-20T04:03:13ZengAOSISSouth African Family Practice2078-61902078-62042012-02-0154110.1080/20786204.2012.108741754798The development, implementation and evaluation of a short course in objective structured clinical examination (OSCE) skillsA. de Villiers0E. Archer1Centre for Health Sciences Education, Faculty of Health Sciences, Stellenbosch UniversityCentre for Health Sciences Education, Faculty of Health Sciences, Stellenbosch UniversityBackground: Objective structured clinical examination (OSCE) examiner training is widely employed to address some of the reliability and validity issues that accompany the use of this assessment tool. An OSCE skills course was developed and implemented at the Stellenbosch Faculty of Health Sciences and its influence on participants (clinicians) evaluated. Method: Participants attended the OSCE skills course, which included theoretical sessions concerning topics such as standard setting, examiner influence and assessment instruments, as well as two staged OSCEs, one at the beginning and the other at the end of the course. During the latter, each participant examined a student role-player performing a technical skill while being video recorded. Participants’ behaviour and assessment results from the two OSCEs were evaluated, as well as the feedback from participants regarding the course and group interviews with student role players. Results: There was a significant improvement in inter-rater reliability as well as a slight decrease in inappropriate examiner behaviour, such as teaching and prompting during assessment of students. Furthermore, overall feedback from participants and perceptions of student role players was positive. Conclusions: In this study, examiner conduct and inter-rater reliability was positively influenced by the following interventions: examiner briefing, involvement of examiners in constructing assessment instruments, as well as examiners viewing (on DVD) and reflecting on their assessment behaviour. This study proposes that the development and implementation of an OSCE skills course is a worthwhile endeavour in improving validity and reliability of the OSCE as an assessment tool.https://safpj.co.za/index.php/safpj/article/view/1734osceobjective structured clinical examinationexaminer trainingexaminer conductinter-rater reliabilityinter-rater agreement |
| spellingShingle | A. de Villiers E. Archer The development, implementation and evaluation of a short course in objective structured clinical examination (OSCE) skills South African Family Practice osce objective structured clinical examination examiner training examiner conduct inter-rater reliability inter-rater agreement |
| title | The development, implementation and evaluation of a short course in objective structured clinical examination (OSCE) skills |
| title_full | The development, implementation and evaluation of a short course in objective structured clinical examination (OSCE) skills |
| title_fullStr | The development, implementation and evaluation of a short course in objective structured clinical examination (OSCE) skills |
| title_full_unstemmed | The development, implementation and evaluation of a short course in objective structured clinical examination (OSCE) skills |
| title_short | The development, implementation and evaluation of a short course in objective structured clinical examination (OSCE) skills |
| title_sort | development implementation and evaluation of a short course in objective structured clinical examination osce skills |
| topic | osce objective structured clinical examination examiner training examiner conduct inter-rater reliability inter-rater agreement |
| url | https://safpj.co.za/index.php/safpj/article/view/1734 |
| work_keys_str_mv | AT adevilliers thedevelopmentimplementationandevaluationofashortcourseinobjectivestructuredclinicalexaminationosceskills AT earcher thedevelopmentimplementationandevaluationofashortcourseinobjectivestructuredclinicalexaminationosceskills AT adevilliers developmentimplementationandevaluationofashortcourseinobjectivestructuredclinicalexaminationosceskills AT earcher developmentimplementationandevaluationofashortcourseinobjectivestructuredclinicalexaminationosceskills |