Practical lessons for phone-based assessments of learning
School closures affecting more than 1.5 billion children are designed to prevent the spread of current public health risks from the COVID-19 pandemic, but they simultaneously introduce new short-term and long-term health risks through lost education. Measuring these effects in real time is critical...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMJ Publishing Group
2020-07-01
|
| Series: | BMJ Global Health |
| Online Access: | https://gh.bmj.com/content/5/7/e003030.full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850210525864001536 |
|---|---|
| author | Noam Angrist Peter Bergman David K Evans Susannah Hares Matthew C H Jukes Thato Letsomo |
| author_facet | Noam Angrist Peter Bergman David K Evans Susannah Hares Matthew C H Jukes Thato Letsomo |
| author_sort | Noam Angrist |
| collection | DOAJ |
| description | School closures affecting more than 1.5 billion children are designed to prevent the spread of current public health risks from the COVID-19 pandemic, but they simultaneously introduce new short-term and long-term health risks through lost education. Measuring these effects in real time is critical to inform effective public health responses, and remote phone-based approaches are one of the only viable options with extreme social distancing in place. However, both the health and education literature are sparse on guidance for phone-based assessments. In this article, we draw on our pilot testing of phone-based assessments in Botswana, along with the existing literature on oral testing of reading and mathematics, to propose a series of preliminary practical lessons to guide researchers and service providers as they try phone-based learning assessments. We provide preliminary evidence that phone-based assessments can accurately capture basic numeracy skills. We provide guidance to help teams (1) ensure that children are not put at risk, (2) test the reliability and validity of phone-based measures, (3) use simple instructions and practice items to ensure the assessment is focused on the target skill, not general language and test-taking skills, (4) adapt the items from oral assessments that will be most effective in phone-based assessments, (5) keep assessments brief while still gathering meaningful learning data, (6) use effective strategies to encourage respondents to pick up the phone, (7) build rapport with adult caregivers and youth respondents, (8) choose the most cost-effective medium and (9) account for potential bias in samples. |
| format | Article |
| id | doaj-art-1668246bc8eb433faa6f38137988db9a |
| institution | OA Journals |
| issn | 2059-7908 |
| language | English |
| publishDate | 2020-07-01 |
| publisher | BMJ Publishing Group |
| record_format | Article |
| series | BMJ Global Health |
| spelling | doaj-art-1668246bc8eb433faa6f38137988db9a2025-08-20T02:09:45ZengBMJ Publishing GroupBMJ Global Health2059-79082020-07-015710.1136/bmjgh-2020-003030Practical lessons for phone-based assessments of learningNoam Angrist0Peter Bergman1David K Evans2Susannah Hares3Matthew C H Jukes4Thato Letsomo5University of Oxford, Oxford, Oxfordshire, UKprofessorCenter for Global Development, Washington, DC, USACenter for Global Development, London, UKInternational Education Division, RTI International, London, UKYoung 1ove, Gaborone, BotswanaSchool closures affecting more than 1.5 billion children are designed to prevent the spread of current public health risks from the COVID-19 pandemic, but they simultaneously introduce new short-term and long-term health risks through lost education. Measuring these effects in real time is critical to inform effective public health responses, and remote phone-based approaches are one of the only viable options with extreme social distancing in place. However, both the health and education literature are sparse on guidance for phone-based assessments. In this article, we draw on our pilot testing of phone-based assessments in Botswana, along with the existing literature on oral testing of reading and mathematics, to propose a series of preliminary practical lessons to guide researchers and service providers as they try phone-based learning assessments. We provide preliminary evidence that phone-based assessments can accurately capture basic numeracy skills. We provide guidance to help teams (1) ensure that children are not put at risk, (2) test the reliability and validity of phone-based measures, (3) use simple instructions and practice items to ensure the assessment is focused on the target skill, not general language and test-taking skills, (4) adapt the items from oral assessments that will be most effective in phone-based assessments, (5) keep assessments brief while still gathering meaningful learning data, (6) use effective strategies to encourage respondents to pick up the phone, (7) build rapport with adult caregivers and youth respondents, (8) choose the most cost-effective medium and (9) account for potential bias in samples.https://gh.bmj.com/content/5/7/e003030.full |
| spellingShingle | Noam Angrist Peter Bergman David K Evans Susannah Hares Matthew C H Jukes Thato Letsomo Practical lessons for phone-based assessments of learning BMJ Global Health |
| title | Practical lessons for phone-based assessments of learning |
| title_full | Practical lessons for phone-based assessments of learning |
| title_fullStr | Practical lessons for phone-based assessments of learning |
| title_full_unstemmed | Practical lessons for phone-based assessments of learning |
| title_short | Practical lessons for phone-based assessments of learning |
| title_sort | practical lessons for phone based assessments of learning |
| url | https://gh.bmj.com/content/5/7/e003030.full |
| work_keys_str_mv | AT noamangrist practicallessonsforphonebasedassessmentsoflearning AT peterbergman practicallessonsforphonebasedassessmentsoflearning AT davidkevans practicallessonsforphonebasedassessmentsoflearning AT susannahhares practicallessonsforphonebasedassessmentsoflearning AT matthewchjukes practicallessonsforphonebasedassessmentsoflearning AT thatoletsomo practicallessonsforphonebasedassessmentsoflearning |