The Risk for Violence Screening Tool: a psychometric validation and reliability study

Background: There is a lack of high-quality evidence to support the recommendation of an instrument to screen emergency department patients for their risk for violence. Objective: To demonstrate the content and predictive validity and reliability of the novel Risk for Violence Screening Tool to iden...

Full description

Saved in:
Bibliographic Details
Main Authors: Sheila Mallett-Smith, Alirio Olmedo, Catherine P. Canamar
Format: Article
Language:English
Published: Elsevier 2025-06-01
Series:International Journal of Nursing Studies Advances
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2666142X24001073
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849333774067695616
author Sheila Mallett-Smith
Alirio Olmedo
Catherine P. Canamar
author_facet Sheila Mallett-Smith
Alirio Olmedo
Catherine P. Canamar
author_sort Sheila Mallett-Smith
collection DOAJ
description Background: There is a lack of high-quality evidence to support the recommendation of an instrument to screen emergency department patients for their risk for violence. Objective: To demonstrate the content and predictive validity and reliability of the novel Risk for Violence Screening Tool to identify patients at risk for violence. Design and Setting: This retrospective risk screening study was conducted at a 100-bed emergency department in an urban, academic, safety net trauma center in Southern California. Participants: Nine subject matter expert employees and 22,583 non-critical adult emergency patients. Methods: Subject matter experts rated the relevance of 30 risk items and 10 domains comprising the Risk for Violence Screening Tool. Content Validity Index/Average Content Validity and Universal Agreement analyses determined the tool's content validity. Predictive validity, analyzed with logistic regression, used data from a patient incidence of violence registry (an incident occurred or did not occur), compared with the Risk for Violence Screening Tool screening result (positive or negative). Response agreement among three nurses who independently utilized the Risk for Violence Screening Tool to assess the same patients upon their arrival at the emergency department determined inter-rater reliability. Results: The overall Content Validity Index was 0.84, and the item-level Content Validity Index and the universal agreement scores were 1.00, indicating perfect agreement on item relevance and a unanimous consensus among experts. Patients who screened positive on the Risk of Violence Screening Tool, indicating a high probability of violence, were 27.55 times more likely to commit an act of violence compared to those who screened negative (95 % CI = 24.73 to 30.70). The logistic regression model was statistically significant, (χ2(1) = 1140.29, p < 0.0001), explaining a range from 4.9 % (Cox &amp; Snell R2) to 37.3 % (Nagelkerke R2) of the variance and indicating that the Risk for Violence Screening Tool successfully predicted violent incidents. The calculated area under the curve of 0.843 (95 % confidence interval, 0.812–0.873, p < 0.001) affirmed the Risk for Violence Screening Tool's discriminatory ability to distinguish between individuals with and without a risk for violent behavior. Cohen's Kappa statistic yielded a value of 0.86 (p < 0.001). Conclusions: The Risk for Violence Screening Tool is valid and reliable. This standardized tool can be used in emergency departments as part of a robust violence prevention program, creating a safer workplace for both staff and patients. Tweetable abstract: The Risk for Violence Screening Tool (RVST) is a valid and reliable brief screener to identify emergency department patients at risk for violence. @dhs.lacounty @ijn2024
format Article
id doaj-art-49fef09e1db2402b90502b583d434f08
institution Kabale University
issn 2666-142X
language English
publishDate 2025-06-01
publisher Elsevier
record_format Article
series International Journal of Nursing Studies Advances
spelling doaj-art-49fef09e1db2402b90502b583d434f082025-08-20T03:45:45ZengElsevierInternational Journal of Nursing Studies Advances2666-142X2025-06-01810028010.1016/j.ijnsa.2024.100280The Risk for Violence Screening Tool: a psychometric validation and reliability studySheila Mallett-Smith0Alirio Olmedo1Catherine P. Canamar2Corresponding author at: Los Angeles General Medical Center, 1983 Marengo Street, Los Angeles, California, United States.; Los Angeles General Medical Center, Los Angeles, CA, United StatesLos Angeles General Medical Center, Los Angeles, CA, United StatesLos Angeles General Medical Center, Los Angeles, CA, United StatesBackground: There is a lack of high-quality evidence to support the recommendation of an instrument to screen emergency department patients for their risk for violence. Objective: To demonstrate the content and predictive validity and reliability of the novel Risk for Violence Screening Tool to identify patients at risk for violence. Design and Setting: This retrospective risk screening study was conducted at a 100-bed emergency department in an urban, academic, safety net trauma center in Southern California. Participants: Nine subject matter expert employees and 22,583 non-critical adult emergency patients. Methods: Subject matter experts rated the relevance of 30 risk items and 10 domains comprising the Risk for Violence Screening Tool. Content Validity Index/Average Content Validity and Universal Agreement analyses determined the tool's content validity. Predictive validity, analyzed with logistic regression, used data from a patient incidence of violence registry (an incident occurred or did not occur), compared with the Risk for Violence Screening Tool screening result (positive or negative). Response agreement among three nurses who independently utilized the Risk for Violence Screening Tool to assess the same patients upon their arrival at the emergency department determined inter-rater reliability. Results: The overall Content Validity Index was 0.84, and the item-level Content Validity Index and the universal agreement scores were 1.00, indicating perfect agreement on item relevance and a unanimous consensus among experts. Patients who screened positive on the Risk of Violence Screening Tool, indicating a high probability of violence, were 27.55 times more likely to commit an act of violence compared to those who screened negative (95 % CI = 24.73 to 30.70). The logistic regression model was statistically significant, (χ2(1) = 1140.29, p < 0.0001), explaining a range from 4.9 % (Cox &amp; Snell R2) to 37.3 % (Nagelkerke R2) of the variance and indicating that the Risk for Violence Screening Tool successfully predicted violent incidents. The calculated area under the curve of 0.843 (95 % confidence interval, 0.812–0.873, p < 0.001) affirmed the Risk for Violence Screening Tool's discriminatory ability to distinguish between individuals with and without a risk for violent behavior. Cohen's Kappa statistic yielded a value of 0.86 (p < 0.001). Conclusions: The Risk for Violence Screening Tool is valid and reliable. This standardized tool can be used in emergency departments as part of a robust violence prevention program, creating a safer workplace for both staff and patients. Tweetable abstract: The Risk for Violence Screening Tool (RVST) is a valid and reliable brief screener to identify emergency department patients at risk for violence. @dhs.lacounty @ijn2024http://www.sciencedirect.com/science/article/pii/S2666142X24001073Workplace violenceRisk for violence screening toolPsychometric testingValidityReliabilitySensitivity &amp; specificity
spellingShingle Sheila Mallett-Smith
Alirio Olmedo
Catherine P. Canamar
The Risk for Violence Screening Tool: a psychometric validation and reliability study
International Journal of Nursing Studies Advances
Workplace violence
Risk for violence screening tool
Psychometric testing
Validity
Reliability
Sensitivity &amp; specificity
title The Risk for Violence Screening Tool: a psychometric validation and reliability study
title_full The Risk for Violence Screening Tool: a psychometric validation and reliability study
title_fullStr The Risk for Violence Screening Tool: a psychometric validation and reliability study
title_full_unstemmed The Risk for Violence Screening Tool: a psychometric validation and reliability study
title_short The Risk for Violence Screening Tool: a psychometric validation and reliability study
title_sort risk for violence screening tool a psychometric validation and reliability study
topic Workplace violence
Risk for violence screening tool
Psychometric testing
Validity
Reliability
Sensitivity &amp; specificity
url http://www.sciencedirect.com/science/article/pii/S2666142X24001073
work_keys_str_mv AT sheilamallettsmith theriskforviolencescreeningtoolapsychometricvalidationandreliabilitystudy
AT alirioolmedo theriskforviolencescreeningtoolapsychometricvalidationandreliabilitystudy
AT catherinepcanamar theriskforviolencescreeningtoolapsychometricvalidationandreliabilitystudy
AT sheilamallettsmith riskforviolencescreeningtoolapsychometricvalidationandreliabilitystudy
AT alirioolmedo riskforviolencescreeningtoolapsychometricvalidationandreliabilitystudy
AT catherinepcanamar riskforviolencescreeningtoolapsychometricvalidationandreliabilitystudy