Expert opinion as priors for random effects in Bayesian prediction models: Subclinical ketosis in dairy cows as an example.
Random effects regression models are routinely used for clustered data in etiological and intervention research. However, in prediction models, the random effects are either neglected or conventionally substituted with zero for new clusters after model development. In this study, we applied a Bayesi...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2021-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0244752&type=printable |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850241067965743104 |
|---|---|
| author | Haifang Ni Irene Klugkist Saskia van der Drift Ruurd Jorritsma Gerrit Hooijer Mirjam Nielen |
| author_facet | Haifang Ni Irene Klugkist Saskia van der Drift Ruurd Jorritsma Gerrit Hooijer Mirjam Nielen |
| author_sort | Haifang Ni |
| collection | DOAJ |
| description | Random effects regression models are routinely used for clustered data in etiological and intervention research. However, in prediction models, the random effects are either neglected or conventionally substituted with zero for new clusters after model development. In this study, we applied a Bayesian prediction modelling method to the subclinical ketosis data previously collected by Van der Drift et al. (2012). Using a dataset of 118 randomly selected Dutch dairy farms participating in a regular milk recording system, the authors proposed a prediction model with milk measures as well as available test-day information as predictors for the diagnosis of subclinical ketosis in dairy cows. While their original model included random effects to correct for the clustering, the random effect term was removed for their final prediction model. With the Bayesian prediction modelling approach, we first used non-informative priors for the random effects for model development as well as for prediction. This approach was evaluated by comparing it to the original frequentist model. In addition, herd level expert opinion was elicited from a bovine health specialist using three different scales of precision and incorporated in the prediction as informative priors for the random effects, resulting in three more Bayesian prediction models. Results showed that the Bayesian approach could naturally take the clustering structure of clusters into account by keeping the random effects in the prediction model. Expert opinion could be explicitly combined with individual level data for prediction. However in this dataset, when elicited expert opinion was incorporated, little improvement was seen at the individual level as well as at the herd level. When the prediction models were applied to the 118 herds, at the individual cow level, with the original frequentist approach we obtained a sensitivity of 82.4% and a specificity of 83.8% at the optimal cutoff, while with the three Bayesian models with elicited expert opinion, we obtained sensitivities ranged from 78.7% to 84.6% and specificities ranged from 75.0% to 83.6%. At the herd level, 30 out of 118 within herd prevalences were correctly predicted by the original frequentist approach, and 31 to 44 herds were correctly predicted by the three Bayesian models with elicited expert opinion. Further investigation in expert opinion and distributional assumption for the random effects was carried out and discussed. |
| format | Article |
| id | doaj-art-2343132bdc7d4e6c8bbe9cf79831a2ab |
| institution | OA Journals |
| issn | 1932-6203 |
| language | English |
| publishDate | 2021-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-2343132bdc7d4e6c8bbe9cf79831a2ab2025-08-20T02:00:42ZengPublic Library of Science (PLoS)PLoS ONE1932-62032021-01-01161e024475210.1371/journal.pone.0244752Expert opinion as priors for random effects in Bayesian prediction models: Subclinical ketosis in dairy cows as an example.Haifang NiIrene KlugkistSaskia van der DriftRuurd JorritsmaGerrit HooijerMirjam NielenRandom effects regression models are routinely used for clustered data in etiological and intervention research. However, in prediction models, the random effects are either neglected or conventionally substituted with zero for new clusters after model development. In this study, we applied a Bayesian prediction modelling method to the subclinical ketosis data previously collected by Van der Drift et al. (2012). Using a dataset of 118 randomly selected Dutch dairy farms participating in a regular milk recording system, the authors proposed a prediction model with milk measures as well as available test-day information as predictors for the diagnosis of subclinical ketosis in dairy cows. While their original model included random effects to correct for the clustering, the random effect term was removed for their final prediction model. With the Bayesian prediction modelling approach, we first used non-informative priors for the random effects for model development as well as for prediction. This approach was evaluated by comparing it to the original frequentist model. In addition, herd level expert opinion was elicited from a bovine health specialist using three different scales of precision and incorporated in the prediction as informative priors for the random effects, resulting in three more Bayesian prediction models. Results showed that the Bayesian approach could naturally take the clustering structure of clusters into account by keeping the random effects in the prediction model. Expert opinion could be explicitly combined with individual level data for prediction. However in this dataset, when elicited expert opinion was incorporated, little improvement was seen at the individual level as well as at the herd level. When the prediction models were applied to the 118 herds, at the individual cow level, with the original frequentist approach we obtained a sensitivity of 82.4% and a specificity of 83.8% at the optimal cutoff, while with the three Bayesian models with elicited expert opinion, we obtained sensitivities ranged from 78.7% to 84.6% and specificities ranged from 75.0% to 83.6%. At the herd level, 30 out of 118 within herd prevalences were correctly predicted by the original frequentist approach, and 31 to 44 herds were correctly predicted by the three Bayesian models with elicited expert opinion. Further investigation in expert opinion and distributional assumption for the random effects was carried out and discussed.https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0244752&type=printable |
| spellingShingle | Haifang Ni Irene Klugkist Saskia van der Drift Ruurd Jorritsma Gerrit Hooijer Mirjam Nielen Expert opinion as priors for random effects in Bayesian prediction models: Subclinical ketosis in dairy cows as an example. PLoS ONE |
| title | Expert opinion as priors for random effects in Bayesian prediction models: Subclinical ketosis in dairy cows as an example. |
| title_full | Expert opinion as priors for random effects in Bayesian prediction models: Subclinical ketosis in dairy cows as an example. |
| title_fullStr | Expert opinion as priors for random effects in Bayesian prediction models: Subclinical ketosis in dairy cows as an example. |
| title_full_unstemmed | Expert opinion as priors for random effects in Bayesian prediction models: Subclinical ketosis in dairy cows as an example. |
| title_short | Expert opinion as priors for random effects in Bayesian prediction models: Subclinical ketosis in dairy cows as an example. |
| title_sort | expert opinion as priors for random effects in bayesian prediction models subclinical ketosis in dairy cows as an example |
| url | https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0244752&type=printable |
| work_keys_str_mv | AT haifangni expertopinionaspriorsforrandomeffectsinbayesianpredictionmodelssubclinicalketosisindairycowsasanexample AT ireneklugkist expertopinionaspriorsforrandomeffectsinbayesianpredictionmodelssubclinicalketosisindairycowsasanexample AT saskiavanderdrift expertopinionaspriorsforrandomeffectsinbayesianpredictionmodelssubclinicalketosisindairycowsasanexample AT ruurdjorritsma expertopinionaspriorsforrandomeffectsinbayesianpredictionmodelssubclinicalketosisindairycowsasanexample AT gerrithooijer expertopinionaspriorsforrandomeffectsinbayesianpredictionmodelssubclinicalketosisindairycowsasanexample AT mirjamnielen expertopinionaspriorsforrandomeffectsinbayesianpredictionmodelssubclinicalketosisindairycowsasanexample |