The Effect of Changing Fellowship Interview Format on Candidate Ranking Variabilities: The COVID-19 Experience
Purpose. This study investigated the effect of interview format changes (in-person to virtual, one-to-one to multiple-to-one) necessitated by the COVID-19 travel restrictions on preliminary fellowship candidate ranking variabilities. Design. Cross-sectional observational study. Method. In 2018 and 2...
Saved in:
| Main Authors: | , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2022-01-01
|
| Series: | Journal of Ophthalmology |
| Online Access: | http://dx.doi.org/10.1155/2022/7402079 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849309194212081664 |
|---|---|
| author | Ta Chen Chang Elizabeth A. Hodapp Richard K. Parrish Alana L. Grajewski Steven J. Gedde Richard K. Lee Sarah R. Wellik Anna K. Junk Luis Vazquez Swarup S. Swaminathan Elena Bitrian Adam L. Rothman Elizabeth A. Vanner |
| author_facet | Ta Chen Chang Elizabeth A. Hodapp Richard K. Parrish Alana L. Grajewski Steven J. Gedde Richard K. Lee Sarah R. Wellik Anna K. Junk Luis Vazquez Swarup S. Swaminathan Elena Bitrian Adam L. Rothman Elizabeth A. Vanner |
| author_sort | Ta Chen Chang |
| collection | DOAJ |
| description | Purpose. This study investigated the effect of interview format changes (in-person to virtual, one-to-one to multiple-to-one) necessitated by the COVID-19 travel restrictions on preliminary fellowship candidate ranking variabilities. Design. Cross-sectional observational study. Method. In 2018 and 2019, the glaucoma fellowship interviews were conducted in-person in a one-to-one format, whereas in 2020, interviews were virtual and in a multiple (interviewers)-to-one (candidate) format. We compared ranking ranges of interviewers within the same virtual room (WSR) and not within the same virtual room (NWSR) to assess the effect of WSR versus NWSR on ranking variabilities. We also compared ranking categories (“accept,” “alternate,” and “pass”) agreements between 2018, 2019, and 2020 to assess the effect of virtual versus in-person interviews on ranking variabilities. Results. NWSR and WSR mean rankings differed by 1.33 (95% confidence interval difference 0.61 to 2.04, p = 0.0003), with WSR interviewers having less variability than NWSR pairs. The variability between 2018/2019 (in-person interviews) and 2020 (virtual interviews) showed no differences between in-person and virtual interviews (weighted Kappa statistic 0.086 for 2018, 0.158 for 2019, and 0.101 for 2020; p < 0.05 for all years). The overall least attractive candidate has the lowest variability; the most attractive candidate has the second lowest variability. Conclusion. Grouping interviewers WSR during the interview decreased ranking variabilities compared to NWSR, while a change from in-person to virtual interview format did not increase the ranking variabilities. This suggests that the decreased nonverbal interactions in virtual interviews do not decrease interviewers’ perceptions as applied to preliminary rankings. |
| format | Article |
| id | doaj-art-048293e9500a4ec29b73e8297b8765a8 |
| institution | Kabale University |
| issn | 2090-0058 |
| language | English |
| publishDate | 2022-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Journal of Ophthalmology |
| spelling | doaj-art-048293e9500a4ec29b73e8297b8765a82025-08-20T03:54:15ZengWileyJournal of Ophthalmology2090-00582022-01-01202210.1155/2022/7402079The Effect of Changing Fellowship Interview Format on Candidate Ranking Variabilities: The COVID-19 ExperienceTa Chen Chang0Elizabeth A. Hodapp1Richard K. Parrish2Alana L. Grajewski3Steven J. Gedde4Richard K. Lee5Sarah R. Wellik6Anna K. Junk7Luis Vazquez8Swarup S. Swaminathan9Elena Bitrian10Adam L. Rothman11Elizabeth A. Vanner12Bascom Palmer Eye InstituteBascom Palmer Eye InstituteBascom Palmer Eye InstituteBascom Palmer Eye InstituteBascom Palmer Eye InstituteBascom Palmer Eye InstituteBascom Palmer Eye InstituteBascom Palmer Eye InstituteBascom Palmer Eye InstituteBascom Palmer Eye InstituteBascom Palmer Eye InstituteBascom Palmer Eye InstituteBascom Palmer Eye InstitutePurpose. This study investigated the effect of interview format changes (in-person to virtual, one-to-one to multiple-to-one) necessitated by the COVID-19 travel restrictions on preliminary fellowship candidate ranking variabilities. Design. Cross-sectional observational study. Method. In 2018 and 2019, the glaucoma fellowship interviews were conducted in-person in a one-to-one format, whereas in 2020, interviews were virtual and in a multiple (interviewers)-to-one (candidate) format. We compared ranking ranges of interviewers within the same virtual room (WSR) and not within the same virtual room (NWSR) to assess the effect of WSR versus NWSR on ranking variabilities. We also compared ranking categories (“accept,” “alternate,” and “pass”) agreements between 2018, 2019, and 2020 to assess the effect of virtual versus in-person interviews on ranking variabilities. Results. NWSR and WSR mean rankings differed by 1.33 (95% confidence interval difference 0.61 to 2.04, p = 0.0003), with WSR interviewers having less variability than NWSR pairs. The variability between 2018/2019 (in-person interviews) and 2020 (virtual interviews) showed no differences between in-person and virtual interviews (weighted Kappa statistic 0.086 for 2018, 0.158 for 2019, and 0.101 for 2020; p < 0.05 for all years). The overall least attractive candidate has the lowest variability; the most attractive candidate has the second lowest variability. Conclusion. Grouping interviewers WSR during the interview decreased ranking variabilities compared to NWSR, while a change from in-person to virtual interview format did not increase the ranking variabilities. This suggests that the decreased nonverbal interactions in virtual interviews do not decrease interviewers’ perceptions as applied to preliminary rankings.http://dx.doi.org/10.1155/2022/7402079 |
| spellingShingle | Ta Chen Chang Elizabeth A. Hodapp Richard K. Parrish Alana L. Grajewski Steven J. Gedde Richard K. Lee Sarah R. Wellik Anna K. Junk Luis Vazquez Swarup S. Swaminathan Elena Bitrian Adam L. Rothman Elizabeth A. Vanner The Effect of Changing Fellowship Interview Format on Candidate Ranking Variabilities: The COVID-19 Experience Journal of Ophthalmology |
| title | The Effect of Changing Fellowship Interview Format on Candidate Ranking Variabilities: The COVID-19 Experience |
| title_full | The Effect of Changing Fellowship Interview Format on Candidate Ranking Variabilities: The COVID-19 Experience |
| title_fullStr | The Effect of Changing Fellowship Interview Format on Candidate Ranking Variabilities: The COVID-19 Experience |
| title_full_unstemmed | The Effect of Changing Fellowship Interview Format on Candidate Ranking Variabilities: The COVID-19 Experience |
| title_short | The Effect of Changing Fellowship Interview Format on Candidate Ranking Variabilities: The COVID-19 Experience |
| title_sort | effect of changing fellowship interview format on candidate ranking variabilities the covid 19 experience |
| url | http://dx.doi.org/10.1155/2022/7402079 |
| work_keys_str_mv | AT tachenchang theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT elizabethahodapp theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT richardkparrish theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT alanalgrajewski theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT stevenjgedde theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT richardklee theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT sarahrwellik theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT annakjunk theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT luisvazquez theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT swarupsswaminathan theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT elenabitrian theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT adamlrothman theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT elizabethavanner theeffectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT tachenchang effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT elizabethahodapp effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT richardkparrish effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT alanalgrajewski effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT stevenjgedde effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT richardklee effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT sarahrwellik effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT annakjunk effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT luisvazquez effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT swarupsswaminathan effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT elenabitrian effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT adamlrothman effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience AT elizabethavanner effectofchangingfellowshipinterviewformatoncandidaterankingvariabilitiesthecovid19experience |