Application of video surveillance in preclinical safety studies in canines: Understanding the interobserver reliability and validity to recognize clinical behavior.
Preclinical in vivo studies are critical to identify potential adverse effects of drugs under development. However, a significant number of drug candidates are terminated during human clinical trials due to unexpected adverse events which were not predicted or detected in preclinical studies. Video...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2025-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0326916 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850116709026889728 |
|---|---|
| author | Eline Eberhardt Fetene Tekle Greet Teuns Jill Witters Bianca Feyen Sarah De Landtsheer Ivan Kopljar |
| author_facet | Eline Eberhardt Fetene Tekle Greet Teuns Jill Witters Bianca Feyen Sarah De Landtsheer Ivan Kopljar |
| author_sort | Eline Eberhardt |
| collection | DOAJ |
| description | Preclinical in vivo studies are critical to identify potential adverse effects of drugs under development. However, a significant number of drug candidates are terminated during human clinical trials due to unexpected adverse events which were not predicted or detected in preclinical studies. Video surveillance can be a valuable tool to reduce the risk of missing and/or misclassifying adverse clinical observations (COs) in animals. To explore the applicability of detecting COs on video, the agreement between observers (reliability) and agreement between observers and experts (construct validity) of 13 important COs was evaluated. The reliability was investigated by evaluating the interobserver agreement between 23 observers with different experience levels and primary roles on defined COs and normal behavior, recorded on video during preclinical studies in canines. The validity was investigated by comparing the observers' assessments to the ground truth confirmed by three experts. This investigation showed a substantial reliability and validity of the observers' assessments without significant differences between experience levels or primary roles. Normal behavior was challenging to recognize (56% correct), while half of the COs appeared straightforward to identify with a validity of ≥ 90%: salivation, aggressiveness, circling, vomiting, head shaking and convulsions. Other COs were more challenging to detect with lowest scores for limb stiff/hypertonia, tremors and excitation. Regardless of experience-level, observers missed very few COs. This investigation showed the complexity when multiple COs occurred simultaneously, as well as the limitations of differentiating between visually similar COs (tremors vs. twitches; limping vs. limb stiff) on video without the possibility of in-person observation. Given the substantial overall reliability and validity, it is concluded that clinical canine behavior can be accurately detected on video by trained observers. This permits more objective and quantifiable monitoring of animal behavior and application of computer vision for future automatic monitoring of canine studies. |
| format | Article |
| id | doaj-art-aa3a7cd0bfe44b6b9c8828a6c36cbedd |
| institution | OA Journals |
| issn | 1932-6203 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-aa3a7cd0bfe44b6b9c8828a6c36cbedd2025-08-20T02:36:15ZengPublic Library of Science (PLoS)PLoS ONE1932-62032025-01-01206e032691610.1371/journal.pone.0326916Application of video surveillance in preclinical safety studies in canines: Understanding the interobserver reliability and validity to recognize clinical behavior.Eline EberhardtFetene TekleGreet TeunsJill WittersBianca FeyenSarah De LandtsheerIvan KopljarPreclinical in vivo studies are critical to identify potential adverse effects of drugs under development. However, a significant number of drug candidates are terminated during human clinical trials due to unexpected adverse events which were not predicted or detected in preclinical studies. Video surveillance can be a valuable tool to reduce the risk of missing and/or misclassifying adverse clinical observations (COs) in animals. To explore the applicability of detecting COs on video, the agreement between observers (reliability) and agreement between observers and experts (construct validity) of 13 important COs was evaluated. The reliability was investigated by evaluating the interobserver agreement between 23 observers with different experience levels and primary roles on defined COs and normal behavior, recorded on video during preclinical studies in canines. The validity was investigated by comparing the observers' assessments to the ground truth confirmed by three experts. This investigation showed a substantial reliability and validity of the observers' assessments without significant differences between experience levels or primary roles. Normal behavior was challenging to recognize (56% correct), while half of the COs appeared straightforward to identify with a validity of ≥ 90%: salivation, aggressiveness, circling, vomiting, head shaking and convulsions. Other COs were more challenging to detect with lowest scores for limb stiff/hypertonia, tremors and excitation. Regardless of experience-level, observers missed very few COs. This investigation showed the complexity when multiple COs occurred simultaneously, as well as the limitations of differentiating between visually similar COs (tremors vs. twitches; limping vs. limb stiff) on video without the possibility of in-person observation. Given the substantial overall reliability and validity, it is concluded that clinical canine behavior can be accurately detected on video by trained observers. This permits more objective and quantifiable monitoring of animal behavior and application of computer vision for future automatic monitoring of canine studies.https://doi.org/10.1371/journal.pone.0326916 |
| spellingShingle | Eline Eberhardt Fetene Tekle Greet Teuns Jill Witters Bianca Feyen Sarah De Landtsheer Ivan Kopljar Application of video surveillance in preclinical safety studies in canines: Understanding the interobserver reliability and validity to recognize clinical behavior. PLoS ONE |
| title | Application of video surveillance in preclinical safety studies in canines: Understanding the interobserver reliability and validity to recognize clinical behavior. |
| title_full | Application of video surveillance in preclinical safety studies in canines: Understanding the interobserver reliability and validity to recognize clinical behavior. |
| title_fullStr | Application of video surveillance in preclinical safety studies in canines: Understanding the interobserver reliability and validity to recognize clinical behavior. |
| title_full_unstemmed | Application of video surveillance in preclinical safety studies in canines: Understanding the interobserver reliability and validity to recognize clinical behavior. |
| title_short | Application of video surveillance in preclinical safety studies in canines: Understanding the interobserver reliability and validity to recognize clinical behavior. |
| title_sort | application of video surveillance in preclinical safety studies in canines understanding the interobserver reliability and validity to recognize clinical behavior |
| url | https://doi.org/10.1371/journal.pone.0326916 |
| work_keys_str_mv | AT elineeberhardt applicationofvideosurveillanceinpreclinicalsafetystudiesincaninesunderstandingtheinterobserverreliabilityandvaliditytorecognizeclinicalbehavior AT fetenetekle applicationofvideosurveillanceinpreclinicalsafetystudiesincaninesunderstandingtheinterobserverreliabilityandvaliditytorecognizeclinicalbehavior AT greetteuns applicationofvideosurveillanceinpreclinicalsafetystudiesincaninesunderstandingtheinterobserverreliabilityandvaliditytorecognizeclinicalbehavior AT jillwitters applicationofvideosurveillanceinpreclinicalsafetystudiesincaninesunderstandingtheinterobserverreliabilityandvaliditytorecognizeclinicalbehavior AT biancafeyen applicationofvideosurveillanceinpreclinicalsafetystudiesincaninesunderstandingtheinterobserverreliabilityandvaliditytorecognizeclinicalbehavior AT sarahdelandtsheer applicationofvideosurveillanceinpreclinicalsafetystudiesincaninesunderstandingtheinterobserverreliabilityandvaliditytorecognizeclinicalbehavior AT ivankopljar applicationofvideosurveillanceinpreclinicalsafetystudiesincaninesunderstandingtheinterobserverreliabilityandvaliditytorecognizeclinicalbehavior |