Cargando…

Validity and reliability of the novel three‐item occupational violence patient risk assessment tool

AIM: To develop and psychometrically test an occupational violence (OV) risk assessment tool in the emergency department (ED). DESIGN: Three studies were conducted in phases: content validity, predictive validity and inter‐rater reliability from June 2019 to March 2021. METHODS: For content validity...

Descripción completa

Detalles Bibliográficos
Autores principales: Cabilan, C. J., McRae, Joshua, Learmont, Ben, Taurima, Karen, Galbraith, Sue, Mason, Dale, Eley, Robert, Snoswell, Centaine, Johnston, Amy N. B.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9306479/
https://www.ncbi.nlm.nih.gov/pubmed/35128709
http://dx.doi.org/10.1111/jan.15166
_version_ 1784752546799157248
author Cabilan, C. J.
McRae, Joshua
Learmont, Ben
Taurima, Karen
Galbraith, Sue
Mason, Dale
Eley, Robert
Snoswell, Centaine
Johnston, Amy N. B.
author_facet Cabilan, C. J.
McRae, Joshua
Learmont, Ben
Taurima, Karen
Galbraith, Sue
Mason, Dale
Eley, Robert
Snoswell, Centaine
Johnston, Amy N. B.
author_sort Cabilan, C. J.
collection PubMed
description AIM: To develop and psychometrically test an occupational violence (OV) risk assessment tool in the emergency department (ED). DESIGN: Three studies were conducted in phases: content validity, predictive validity and inter‐rater reliability from June 2019 to March 2021. METHODS: For content validity, ED end users (mainly nurses) were recruited to rate items that would appropriately assess for OV risk. Subsequently, a risk assessment tool was developed and tested for its predictive validity and inter‐rater reliability. For predictive validity, triage notes of ED presentations in a month with the highest OV were assessed for presence of OV risk. Each presentation was then matched with events recorded in the OV incident register. Sensitivity and specificity values were calculated. For inter‐rater reliability, two assessors—trained and untrained—independently assessed the triage notes for presence of OV risk. Cohen's kappa was calculated. RESULTS: Two rounds of content validity with a total of N = 81 end users led to the development of a three‐domain tool that assesses for OV risk using aggression history, behavioural concerns (i.e., angry, clenched fist, demanding, threatening language or resisting care) and clinical presentation concerns (i.e., alcohol/drug intoxication and erratic cognition). Recommended risk ratings are low (score = 0 risk domain present), moderate (score = 1 risk domain present) and high (score = 2–3 risk domains present), with an area under the curve of 0.77 (95% confidence interval 0.7–0.81, p < .01). Moderate risk rating had a 61% sensitivity and 91% specificity, whereas high risk rating had 37% sensitivity and 97% specificity. Inter‐rater reliability ranged from 0.67 to 0.75 (p < .01), suggesting moderate agreement. CONCLUSIONS: The novel three‐domain OV risk assessment tool was shown to be appropriate and relevant for application in EDs. The tool, developed through a rigorous content validity process, demonstrates acceptable predictive validity and inter‐rater reliability. IMPACT: The developed tool is currently piloted in a single hospital ED, with a view to extend to inpatient settings and other hospitals.
format Online
Article
Text
id pubmed-9306479
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-93064792022-07-28 Validity and reliability of the novel three‐item occupational violence patient risk assessment tool Cabilan, C. J. McRae, Joshua Learmont, Ben Taurima, Karen Galbraith, Sue Mason, Dale Eley, Robert Snoswell, Centaine Johnston, Amy N. B. J Adv Nurs Research Papers AIM: To develop and psychometrically test an occupational violence (OV) risk assessment tool in the emergency department (ED). DESIGN: Three studies were conducted in phases: content validity, predictive validity and inter‐rater reliability from June 2019 to March 2021. METHODS: For content validity, ED end users (mainly nurses) were recruited to rate items that would appropriately assess for OV risk. Subsequently, a risk assessment tool was developed and tested for its predictive validity and inter‐rater reliability. For predictive validity, triage notes of ED presentations in a month with the highest OV were assessed for presence of OV risk. Each presentation was then matched with events recorded in the OV incident register. Sensitivity and specificity values were calculated. For inter‐rater reliability, two assessors—trained and untrained—independently assessed the triage notes for presence of OV risk. Cohen's kappa was calculated. RESULTS: Two rounds of content validity with a total of N = 81 end users led to the development of a three‐domain tool that assesses for OV risk using aggression history, behavioural concerns (i.e., angry, clenched fist, demanding, threatening language or resisting care) and clinical presentation concerns (i.e., alcohol/drug intoxication and erratic cognition). Recommended risk ratings are low (score = 0 risk domain present), moderate (score = 1 risk domain present) and high (score = 2–3 risk domains present), with an area under the curve of 0.77 (95% confidence interval 0.7–0.81, p < .01). Moderate risk rating had a 61% sensitivity and 91% specificity, whereas high risk rating had 37% sensitivity and 97% specificity. Inter‐rater reliability ranged from 0.67 to 0.75 (p < .01), suggesting moderate agreement. CONCLUSIONS: The novel three‐domain OV risk assessment tool was shown to be appropriate and relevant for application in EDs. The tool, developed through a rigorous content validity process, demonstrates acceptable predictive validity and inter‐rater reliability. IMPACT: The developed tool is currently piloted in a single hospital ED, with a view to extend to inpatient settings and other hospitals. John Wiley and Sons Inc. 2022-02-07 2022-04 /pmc/articles/PMC9306479/ /pubmed/35128709 http://dx.doi.org/10.1111/jan.15166 Text en © 2022 The Authors. Journal of Advanced Nursing published by John Wiley & Sons Ltd. https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by-nc-nd/4.0/ (https://creativecommons.org/licenses/by-nc-nd/4.0/) License, which permits use and distribution in any medium, provided the original work is properly cited, the use is non‐commercial and no modifications or adaptations are made.
spellingShingle Research Papers
Cabilan, C. J.
McRae, Joshua
Learmont, Ben
Taurima, Karen
Galbraith, Sue
Mason, Dale
Eley, Robert
Snoswell, Centaine
Johnston, Amy N. B.
Validity and reliability of the novel three‐item occupational violence patient risk assessment tool
title Validity and reliability of the novel three‐item occupational violence patient risk assessment tool
title_full Validity and reliability of the novel three‐item occupational violence patient risk assessment tool
title_fullStr Validity and reliability of the novel three‐item occupational violence patient risk assessment tool
title_full_unstemmed Validity and reliability of the novel three‐item occupational violence patient risk assessment tool
title_short Validity and reliability of the novel three‐item occupational violence patient risk assessment tool
title_sort validity and reliability of the novel three‐item occupational violence patient risk assessment tool
topic Research Papers
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9306479/
https://www.ncbi.nlm.nih.gov/pubmed/35128709
http://dx.doi.org/10.1111/jan.15166
work_keys_str_mv AT cabilancj validityandreliabilityofthenovelthreeitemoccupationalviolencepatientriskassessmenttool
AT mcraejoshua validityandreliabilityofthenovelthreeitemoccupationalviolencepatientriskassessmenttool
AT learmontben validityandreliabilityofthenovelthreeitemoccupationalviolencepatientriskassessmenttool
AT taurimakaren validityandreliabilityofthenovelthreeitemoccupationalviolencepatientriskassessmenttool
AT galbraithsue validityandreliabilityofthenovelthreeitemoccupationalviolencepatientriskassessmenttool
AT masondale validityandreliabilityofthenovelthreeitemoccupationalviolencepatientriskassessmenttool
AT eleyrobert validityandreliabilityofthenovelthreeitemoccupationalviolencepatientriskassessmenttool
AT snoswellcentaine validityandreliabilityofthenovelthreeitemoccupationalviolencepatientriskassessmenttool
AT johnstonamynb validityandreliabilityofthenovelthreeitemoccupationalviolencepatientriskassessmenttool