Using Large Language Models to Assess Burnout Among Health Care Workers in the Context of COVID-19 Vaccine Decisions and Health Beliefs: Retrospective Cohort Study
Abstract BackgroundBurnout among health care workers affects their well-being and decision-making, influencing patient and public health outcomes. Health care workers’ health beliefs and COVID-19 vaccine decisions may affect the risks of burnout. Therefore, understanding the i...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-07-01
|
| Series: | JMIR Nursing |
| Online Access: | https://nursing.jmir.org/2025/1/e73672 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849319695511977984 |
|---|---|
| author | Samaneh Omranian Lu He AkkeNeel Talsma Arielle A J Scoglio Susan McRoy Janet W Rich-Edwards |
| author_facet | Samaneh Omranian Lu He AkkeNeel Talsma Arielle A J Scoglio Susan McRoy Janet W Rich-Edwards |
| author_sort | Samaneh Omranian |
| collection | DOAJ |
| description |
Abstract
BackgroundBurnout among health care workers affects their well-being and decision-making, influencing patient and public health outcomes. Health care workers’ health beliefs and COVID-19 vaccine decisions may affect the risks of burnout. Therefore, understanding the interplay between these crucial factors is essential for identifying at-risk staff, providing targeted support, and addressing workplace challenges to prevent further escalation of burnout-related issues.
ObjectiveThis study examines how burnout is impacted by health beliefs and COVID-19 vaccine decisions among health care workers. Building on our previously developed Health Belief Model (HBM) classifier based on the HBM framework, which explains how individual perceptions of health risks and benefits influence behavior, we focused on key HBM constructs, including the perceived severity of COVID-19, perceived barriers to vaccination, and their relationship to burnout. We aim to leverage natural language processing techniques to automatically identify theoretically grounded burnout symptoms from comments authored by nurses in a large-scale, national survey and assess their associations with vaccine hesitancy and health beliefs.
MethodsWe analyzed 1944 open-ended comments written by 1501 vaccine-hesitant nurses, using data from the Nurses’ Health Study surveys. We fine-tuned LLaMA 3, an open-source large language model with few-shot prompts and enhanced performance with structured annotation guidance and reasoning-aware inference. Comments were classified into burnout dimensions—Emotional Exhaustion, Depersonalization, and Inefficacy—based on the Maslach Burnout Inventory framework.
ResultsThe model achieved a high weighted accuracy of 92% and an F1
ConclusionsThis study highlights the relationship between burnout and vaccine decision-making among health care workers, uncovering areas for further exploration. By exploring the complex interplay between psychological strain and vaccine hesitancy, this study sets the stage for developing transformative interventions and policies that could redefine workforce resilience and public health strategies. |
| format | Article |
| id | doaj-art-4e10d30580cb444eb30db4ceb5d0c96a |
| institution | Kabale University |
| issn | 2562-7600 |
| language | English |
| publishDate | 2025-07-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Nursing |
| spelling | doaj-art-4e10d30580cb444eb30db4ceb5d0c96a2025-08-20T03:50:21ZengJMIR PublicationsJMIR Nursing2562-76002025-07-018e73672e7367210.2196/73672Using Large Language Models to Assess Burnout Among Health Care Workers in the Context of COVID-19 Vaccine Decisions and Health Beliefs: Retrospective Cohort StudySamaneh Omranianhttp://orcid.org/0000-0001-8974-2614Lu Hehttp://orcid.org/0000-0003-0181-018XAkkeNeel Talsmahttp://orcid.org/0000-0001-6110-926XArielle A J Scogliohttp://orcid.org/0000-0002-3680-9405Susan McRoyhttp://orcid.org/0000-0003-4826-0947Janet W Rich-Edwardshttp://orcid.org/0000-0001-5066-8808 Abstract BackgroundBurnout among health care workers affects their well-being and decision-making, influencing patient and public health outcomes. Health care workers’ health beliefs and COVID-19 vaccine decisions may affect the risks of burnout. Therefore, understanding the interplay between these crucial factors is essential for identifying at-risk staff, providing targeted support, and addressing workplace challenges to prevent further escalation of burnout-related issues. ObjectiveThis study examines how burnout is impacted by health beliefs and COVID-19 vaccine decisions among health care workers. Building on our previously developed Health Belief Model (HBM) classifier based on the HBM framework, which explains how individual perceptions of health risks and benefits influence behavior, we focused on key HBM constructs, including the perceived severity of COVID-19, perceived barriers to vaccination, and their relationship to burnout. We aim to leverage natural language processing techniques to automatically identify theoretically grounded burnout symptoms from comments authored by nurses in a large-scale, national survey and assess their associations with vaccine hesitancy and health beliefs. MethodsWe analyzed 1944 open-ended comments written by 1501 vaccine-hesitant nurses, using data from the Nurses’ Health Study surveys. We fine-tuned LLaMA 3, an open-source large language model with few-shot prompts and enhanced performance with structured annotation guidance and reasoning-aware inference. Comments were classified into burnout dimensions—Emotional Exhaustion, Depersonalization, and Inefficacy—based on the Maslach Burnout Inventory framework. ResultsThe model achieved a high weighted accuracy of 92% and an F1 ConclusionsThis study highlights the relationship between burnout and vaccine decision-making among health care workers, uncovering areas for further exploration. By exploring the complex interplay between psychological strain and vaccine hesitancy, this study sets the stage for developing transformative interventions and policies that could redefine workforce resilience and public health strategies.https://nursing.jmir.org/2025/1/e73672 |
| spellingShingle | Samaneh Omranian Lu He AkkeNeel Talsma Arielle A J Scoglio Susan McRoy Janet W Rich-Edwards Using Large Language Models to Assess Burnout Among Health Care Workers in the Context of COVID-19 Vaccine Decisions and Health Beliefs: Retrospective Cohort Study JMIR Nursing |
| title | Using Large Language Models to Assess Burnout Among Health Care Workers in the Context of COVID-19 Vaccine Decisions and Health Beliefs: Retrospective Cohort Study |
| title_full | Using Large Language Models to Assess Burnout Among Health Care Workers in the Context of COVID-19 Vaccine Decisions and Health Beliefs: Retrospective Cohort Study |
| title_fullStr | Using Large Language Models to Assess Burnout Among Health Care Workers in the Context of COVID-19 Vaccine Decisions and Health Beliefs: Retrospective Cohort Study |
| title_full_unstemmed | Using Large Language Models to Assess Burnout Among Health Care Workers in the Context of COVID-19 Vaccine Decisions and Health Beliefs: Retrospective Cohort Study |
| title_short | Using Large Language Models to Assess Burnout Among Health Care Workers in the Context of COVID-19 Vaccine Decisions and Health Beliefs: Retrospective Cohort Study |
| title_sort | using large language models to assess burnout among health care workers in the context of covid 19 vaccine decisions and health beliefs retrospective cohort study |
| url | https://nursing.jmir.org/2025/1/e73672 |
| work_keys_str_mv | AT samanehomranian usinglargelanguagemodelstoassessburnoutamonghealthcareworkersinthecontextofcovid19vaccinedecisionsandhealthbeliefsretrospectivecohortstudy AT luhe usinglargelanguagemodelstoassessburnoutamonghealthcareworkersinthecontextofcovid19vaccinedecisionsandhealthbeliefsretrospectivecohortstudy AT akkeneeltalsma usinglargelanguagemodelstoassessburnoutamonghealthcareworkersinthecontextofcovid19vaccinedecisionsandhealthbeliefsretrospectivecohortstudy AT arielleajscoglio usinglargelanguagemodelstoassessburnoutamonghealthcareworkersinthecontextofcovid19vaccinedecisionsandhealthbeliefsretrospectivecohortstudy AT susanmcroy usinglargelanguagemodelstoassessburnoutamonghealthcareworkersinthecontextofcovid19vaccinedecisionsandhealthbeliefsretrospectivecohortstudy AT janetwrichedwards usinglargelanguagemodelstoassessburnoutamonghealthcareworkersinthecontextofcovid19vaccinedecisionsandhealthbeliefsretrospectivecohortstudy |