The Impact of Stay-At-Home Mandates on Uncertainty and Sentiments: Quasi-Experimental Study
BackgroundAs the spread of the SARS-CoV-2 virus coincided with lockdown measures, it is challenging to distinguish public reactions to lockdowns from responses to COVID-19 itself. Beyond the direct impact on health, lockdowns may have worsened public sentiment toward politics...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-03-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2025/1/e64667 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849707341147013120 |
|---|---|
| author | Carolina Biliotti Nicolò Fraccaroli Michelangelo Puliga Falco J Bargagli-Stoffi Massimo Riccaboni |
| author_facet | Carolina Biliotti Nicolò Fraccaroli Michelangelo Puliga Falco J Bargagli-Stoffi Massimo Riccaboni |
| author_sort | Carolina Biliotti |
| collection | DOAJ |
| description |
BackgroundAs the spread of the SARS-CoV-2 virus coincided with lockdown measures, it is challenging to distinguish public reactions to lockdowns from responses to COVID-19 itself. Beyond the direct impact on health, lockdowns may have worsened public sentiment toward politics and the economy or even heightened dissatisfaction with health care, imposing a significant cost on both the public and policy makers.
ObjectiveThis study aims to analyze the causal effect of COVID-19 lockdown policies on various dimensions of sentiment and uncertainty, using the Italian lockdown of February 2020 as a quasi-experiment. At the time of implementation, communities inside and just outside the lockdown area were equally exposed to COVID-19, enabling a quasi-random distribution of the lockdown. Additionally, both areas had similar socioeconomic and demographic characteristics before the lockdown, suggesting that the delineation of the strict lockdown zone approximates a randomized experiment. This approach allows us to isolate the causal effects of the lockdown on public emotions, distinguishing the impact of the policy itself from changes driven by the virus’s spread.
MethodsWe used Twitter data (N=24,261), natural language models, and a difference-in-differences approach to compare changes in sentiment and uncertainty inside (n=1567) and outside (n=22,694) the lockdown areas before and after the lockdown began. By fine-tuning the AlBERTo (Italian BERT optimized) pretrained model, we analyzed emotions expressed in tweets from 1124 unique users. Additionally, we applied dictionary-based methods to categorize tweets into 4 dimensions—economy, health, politics, and lockdown policy—to assess the corresponding emotional reactions. This approach enabled us to measure the direct impact of local policies on public sentiment using geo-referenced social media and can be easily adapted for other policy impact analyses.
ResultsOur analysis shows that the lockdown had no significant effect on economic uncertainty (b=0.005, SE 0.007, t125=0.70; P=.48) or negative economic sentiment (b=–0.011, SE 0.0089, t125=–1.32; P=.19). However, it increased uncertainty about health (b=0.036, SE 0.0065, t125=5.55; P<.001) and lockdown policy (b=0.026, SE 0.006, t125=4.47; P<.001), as well as negative sentiment toward politics (b=0.025, SE 0.011, t125=2.33; P=.02), indicating that lockdowns have broad externalities beyond health. Our key findings are confirmed through a series of robustness checks.
ConclusionsOur findings reveal that lockdowns have broad externalities extending beyond health. By heightening health concerns and negative political sentiment, policy makers have struggled to secure explicit public support for government measures, which may discourage future leaders from implementing timely stay-at-home policies. These results highlight the need for authorities to leverage such insights to enhance future policies and communication strategies, reducing uncertainty and mitigating social panic. |
| format | Article |
| id | doaj-art-02f2d01b3ab046078bfcd9f0e7324691 |
| institution | DOAJ |
| issn | 1438-8871 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj-art-02f2d01b3ab046078bfcd9f0e73246912025-08-20T03:15:57ZengJMIR PublicationsJournal of Medical Internet Research1438-88712025-03-0127e6466710.2196/64667The Impact of Stay-At-Home Mandates on Uncertainty and Sentiments: Quasi-Experimental StudyCarolina Biliottihttps://orcid.org/0000-0003-3950-8007Nicolò Fraccarolihttps://orcid.org/0000-0003-3635-425XMichelangelo Puligahttps://orcid.org/0000-0003-1386-1849Falco J Bargagli-Stoffihttps://orcid.org/0000-0002-6131-8165Massimo Riccabonihttps://orcid.org/0000-0003-4979-8933 BackgroundAs the spread of the SARS-CoV-2 virus coincided with lockdown measures, it is challenging to distinguish public reactions to lockdowns from responses to COVID-19 itself. Beyond the direct impact on health, lockdowns may have worsened public sentiment toward politics and the economy or even heightened dissatisfaction with health care, imposing a significant cost on both the public and policy makers. ObjectiveThis study aims to analyze the causal effect of COVID-19 lockdown policies on various dimensions of sentiment and uncertainty, using the Italian lockdown of February 2020 as a quasi-experiment. At the time of implementation, communities inside and just outside the lockdown area were equally exposed to COVID-19, enabling a quasi-random distribution of the lockdown. Additionally, both areas had similar socioeconomic and demographic characteristics before the lockdown, suggesting that the delineation of the strict lockdown zone approximates a randomized experiment. This approach allows us to isolate the causal effects of the lockdown on public emotions, distinguishing the impact of the policy itself from changes driven by the virus’s spread. MethodsWe used Twitter data (N=24,261), natural language models, and a difference-in-differences approach to compare changes in sentiment and uncertainty inside (n=1567) and outside (n=22,694) the lockdown areas before and after the lockdown began. By fine-tuning the AlBERTo (Italian BERT optimized) pretrained model, we analyzed emotions expressed in tweets from 1124 unique users. Additionally, we applied dictionary-based methods to categorize tweets into 4 dimensions—economy, health, politics, and lockdown policy—to assess the corresponding emotional reactions. This approach enabled us to measure the direct impact of local policies on public sentiment using geo-referenced social media and can be easily adapted for other policy impact analyses. ResultsOur analysis shows that the lockdown had no significant effect on economic uncertainty (b=0.005, SE 0.007, t125=0.70; P=.48) or negative economic sentiment (b=–0.011, SE 0.0089, t125=–1.32; P=.19). However, it increased uncertainty about health (b=0.036, SE 0.0065, t125=5.55; P<.001) and lockdown policy (b=0.026, SE 0.006, t125=4.47; P<.001), as well as negative sentiment toward politics (b=0.025, SE 0.011, t125=2.33; P=.02), indicating that lockdowns have broad externalities beyond health. Our key findings are confirmed through a series of robustness checks. ConclusionsOur findings reveal that lockdowns have broad externalities extending beyond health. By heightening health concerns and negative political sentiment, policy makers have struggled to secure explicit public support for government measures, which may discourage future leaders from implementing timely stay-at-home policies. These results highlight the need for authorities to leverage such insights to enhance future policies and communication strategies, reducing uncertainty and mitigating social panic.https://www.jmir.org/2025/1/e64667 |
| spellingShingle | Carolina Biliotti Nicolò Fraccaroli Michelangelo Puliga Falco J Bargagli-Stoffi Massimo Riccaboni The Impact of Stay-At-Home Mandates on Uncertainty and Sentiments: Quasi-Experimental Study Journal of Medical Internet Research |
| title | The Impact of Stay-At-Home Mandates on Uncertainty and Sentiments: Quasi-Experimental Study |
| title_full | The Impact of Stay-At-Home Mandates on Uncertainty and Sentiments: Quasi-Experimental Study |
| title_fullStr | The Impact of Stay-At-Home Mandates on Uncertainty and Sentiments: Quasi-Experimental Study |
| title_full_unstemmed | The Impact of Stay-At-Home Mandates on Uncertainty and Sentiments: Quasi-Experimental Study |
| title_short | The Impact of Stay-At-Home Mandates on Uncertainty and Sentiments: Quasi-Experimental Study |
| title_sort | impact of stay at home mandates on uncertainty and sentiments quasi experimental study |
| url | https://www.jmir.org/2025/1/e64667 |
| work_keys_str_mv | AT carolinabiliotti theimpactofstayathomemandatesonuncertaintyandsentimentsquasiexperimentalstudy AT nicolofraccaroli theimpactofstayathomemandatesonuncertaintyandsentimentsquasiexperimentalstudy AT michelangelopuliga theimpactofstayathomemandatesonuncertaintyandsentimentsquasiexperimentalstudy AT falcojbargaglistoffi theimpactofstayathomemandatesonuncertaintyandsentimentsquasiexperimentalstudy AT massimoriccaboni theimpactofstayathomemandatesonuncertaintyandsentimentsquasiexperimentalstudy AT carolinabiliotti impactofstayathomemandatesonuncertaintyandsentimentsquasiexperimentalstudy AT nicolofraccaroli impactofstayathomemandatesonuncertaintyandsentimentsquasiexperimentalstudy AT michelangelopuliga impactofstayathomemandatesonuncertaintyandsentimentsquasiexperimentalstudy AT falcojbargaglistoffi impactofstayathomemandatesonuncertaintyandsentimentsquasiexperimentalstudy AT massimoriccaboni impactofstayathomemandatesonuncertaintyandsentimentsquasiexperimentalstudy |