An evaluation of the assessment tool used for extensive mini-dissertations in the Master’s Degree in Family Medicine, University of the Free State
Background: Family Medicine became a speciality in South Africa in 2007. Postgraduate studies in Family Medicine changed from part-time Master of Family Medicine (MFamMed) to a full-time Master of Medicine (Family Medicine) [MMed(Fam)] degree, with changes in the curriculum and assessment criteria....
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
AOSIS
2014-05-01
|
| Series: | South African Family Practice |
| Subjects: | |
| Online Access: | https://safpj.co.za/index.php/safpj/article/view/3766 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849737471926992896 |
|---|---|
| author | H. Brits J. Bezuidenhout W.J. Steinberg G. Joubert |
| author_facet | H. Brits J. Bezuidenhout W.J. Steinberg G. Joubert |
| author_sort | H. Brits |
| collection | DOAJ |
| description | Background: Family Medicine became a speciality in South Africa in 2007. Postgraduate studies in Family Medicine changed from part-time Master of Family Medicine (MFamMed) to a full-time Master of Medicine (Family Medicine) [MMed(Fam)] degree, with changes in the curriculum and assessment criteria. The overall goal of this study was to evaluate the current assessment tool for extensive mini-dissertations in the postgraduate programme for Family Medicine, at the University of the Free State, and if necessary, to produce a valid and reliable assessment tool that is user-friendly.
Method: An action research approach was used in this study, using mixed methods. Firstly, marks given by 15 assessors for four mini-dissertations using the current assessment tool were analysed quantitatively. In Phase 2, the regulation of the assessment bodies and the quantitative results of Phase 1 were discussed by assessors during a focus group interview, and data were analysed qualitatively. An adapted, improved assessment tool (Phase 3) was developed and re-evaluated in Phase 4.
Results: The current assessment tool complied with the regulations of the assessment bodies. The scores allocated to specific categories varied with a median coefficient of variation of more than 15% in four of the possible 12 assessment categories. During the focus group interview, reasons for this were identified and the assessment tool adapted accordingly. During reassessment of the tool, individual assessors were identified as the reason for poor reliability.
Conclusion: The current assessment tool was found to be valid, but was not reliable for all assessment categories. The adapted assessment tool addressed these areas, but identified lack of training and experience in the assessment of extensive mini-dissertations by certain assessors as the main reason for unreliable assessment. |
| format | Article |
| id | doaj-art-c1c2d31543fc4efd97b114a2d3556ef4 |
| institution | DOAJ |
| issn | 2078-6190 2078-6204 |
| language | English |
| publishDate | 2014-05-01 |
| publisher | AOSIS |
| record_format | Article |
| series | South African Family Practice |
| spelling | doaj-art-c1c2d31543fc4efd97b114a2d3556ef42025-08-20T03:06:54ZengAOSISSouth African Family Practice2078-61902078-62042014-05-0156210.1080/20786204.2014.108553504499An evaluation of the assessment tool used for extensive mini-dissertations in the Master’s Degree in Family Medicine, University of the Free StateH. Brits0J. Bezuidenhout1W.J. Steinberg2G. Joubert3Department of Family Medicine, Faculty of Health Sciences University of the Free StateDivision Health Sciences Education, Faculty of Health Sciences, University of the Free StateDepartment of Family Medicine, Faculty of Health Sciences, University of the Free StateDepartment of Biostatistics, Faculty of Health Sciences, University of the Free StateBackground: Family Medicine became a speciality in South Africa in 2007. Postgraduate studies in Family Medicine changed from part-time Master of Family Medicine (MFamMed) to a full-time Master of Medicine (Family Medicine) [MMed(Fam)] degree, with changes in the curriculum and assessment criteria. The overall goal of this study was to evaluate the current assessment tool for extensive mini-dissertations in the postgraduate programme for Family Medicine, at the University of the Free State, and if necessary, to produce a valid and reliable assessment tool that is user-friendly. Method: An action research approach was used in this study, using mixed methods. Firstly, marks given by 15 assessors for four mini-dissertations using the current assessment tool were analysed quantitatively. In Phase 2, the regulation of the assessment bodies and the quantitative results of Phase 1 were discussed by assessors during a focus group interview, and data were analysed qualitatively. An adapted, improved assessment tool (Phase 3) was developed and re-evaluated in Phase 4. Results: The current assessment tool complied with the regulations of the assessment bodies. The scores allocated to specific categories varied with a median coefficient of variation of more than 15% in four of the possible 12 assessment categories. During the focus group interview, reasons for this were identified and the assessment tool adapted accordingly. During reassessment of the tool, individual assessors were identified as the reason for poor reliability. Conclusion: The current assessment tool was found to be valid, but was not reliable for all assessment categories. The adapted assessment tool addressed these areas, but identified lack of training and experience in the assessment of extensive mini-dissertations by certain assessors as the main reason for unreliable assessment.https://safpj.co.za/index.php/safpj/article/view/3766mini-dissertationassessment tool |
| spellingShingle | H. Brits J. Bezuidenhout W.J. Steinberg G. Joubert An evaluation of the assessment tool used for extensive mini-dissertations in the Master’s Degree in Family Medicine, University of the Free State South African Family Practice mini-dissertation assessment tool |
| title | An evaluation of the assessment tool used for extensive mini-dissertations in the Master’s Degree in Family Medicine, University of the Free State |
| title_full | An evaluation of the assessment tool used for extensive mini-dissertations in the Master’s Degree in Family Medicine, University of the Free State |
| title_fullStr | An evaluation of the assessment tool used for extensive mini-dissertations in the Master’s Degree in Family Medicine, University of the Free State |
| title_full_unstemmed | An evaluation of the assessment tool used for extensive mini-dissertations in the Master’s Degree in Family Medicine, University of the Free State |
| title_short | An evaluation of the assessment tool used for extensive mini-dissertations in the Master’s Degree in Family Medicine, University of the Free State |
| title_sort | evaluation of the assessment tool used for extensive mini dissertations in the master s degree in family medicine university of the free state |
| topic | mini-dissertation assessment tool |
| url | https://safpj.co.za/index.php/safpj/article/view/3766 |
| work_keys_str_mv | AT hbrits anevaluationoftheassessmenttoolusedforextensiveminidissertationsinthemastersdegreeinfamilymedicineuniversityofthefreestate AT jbezuidenhout anevaluationoftheassessmenttoolusedforextensiveminidissertationsinthemastersdegreeinfamilymedicineuniversityofthefreestate AT wjsteinberg anevaluationoftheassessmenttoolusedforextensiveminidissertationsinthemastersdegreeinfamilymedicineuniversityofthefreestate AT gjoubert anevaluationoftheassessmenttoolusedforextensiveminidissertationsinthemastersdegreeinfamilymedicineuniversityofthefreestate AT hbrits evaluationoftheassessmenttoolusedforextensiveminidissertationsinthemastersdegreeinfamilymedicineuniversityofthefreestate AT jbezuidenhout evaluationoftheassessmenttoolusedforextensiveminidissertationsinthemastersdegreeinfamilymedicineuniversityofthefreestate AT wjsteinberg evaluationoftheassessmenttoolusedforextensiveminidissertationsinthemastersdegreeinfamilymedicineuniversityofthefreestate AT gjoubert evaluationoftheassessmenttoolusedforextensiveminidissertationsinthemastersdegreeinfamilymedicineuniversityofthefreestate |