Cargando…

Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework

OBJECTIVE: To derive a comprehensive implementation framework for clinical AI models within hospitals informed by existing AI frameworks and integrated with reporting standards for clinical AI research. MATERIALS AND METHODS: (1) Derive a provisional implementation framework based on the taxonomy of...

Descripción completa

Detalles Bibliográficos
Autores principales: van der Vegt, Anton H, Scott, Ian A, Dermawan, Krishna, Schnetler, Rudolf J, Kalke, Vikrant R, Lane, Paul J
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10436156/
https://www.ncbi.nlm.nih.gov/pubmed/37208863
http://dx.doi.org/10.1093/jamia/ocad088
_version_ 1785092262140575744
author van der Vegt, Anton H
Scott, Ian A
Dermawan, Krishna
Schnetler, Rudolf J
Kalke, Vikrant R
Lane, Paul J
author_facet van der Vegt, Anton H
Scott, Ian A
Dermawan, Krishna
Schnetler, Rudolf J
Kalke, Vikrant R
Lane, Paul J
author_sort van der Vegt, Anton H
collection PubMed
description OBJECTIVE: To derive a comprehensive implementation framework for clinical AI models within hospitals informed by existing AI frameworks and integrated with reporting standards for clinical AI research. MATERIALS AND METHODS: (1) Derive a provisional implementation framework based on the taxonomy of Stead et al and integrated with current reporting standards for AI research: TRIPOD, DECIDE-AI, CONSORT-AI. (2) Undertake a scoping review of published clinical AI implementation frameworks and identify key themes and stages. (3) Perform a gap analysis and refine the framework by incorporating missing items. RESULTS: The provisional AI implementation framework, called SALIENT, was mapped to 5 stages common to both the taxonomy and the reporting standards. A scoping review retrieved 20 studies and 247 themes, stages, and subelements were identified. A gap analysis identified 5 new cross-stage themes and 16 new tasks. The final framework comprised 5 stages, 7 elements, and 4 components, including the AI system, data pipeline, human-computer interface, and clinical workflow. DISCUSSION: This pragmatic framework resolves gaps in existing stage- and theme-based clinical AI implementation guidance by comprehensively addressing the what (components), when (stages), and how (tasks) of AI implementation, as well as the who (organization) and why (policy domains). By integrating research reporting standards into SALIENT, the framework is grounded in rigorous evaluation methodologies. The framework requires validation as being applicable to real-world studies of deployed AI models. CONCLUSIONS: A novel end-to-end framework has been developed for implementing AI within hospital clinical practice that builds on previous AI implementation frameworks and research reporting standards.
format Online
Article
Text
id pubmed-10436156
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-104361562023-08-19 Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework van der Vegt, Anton H Scott, Ian A Dermawan, Krishna Schnetler, Rudolf J Kalke, Vikrant R Lane, Paul J J Am Med Inform Assoc Research and Applications OBJECTIVE: To derive a comprehensive implementation framework for clinical AI models within hospitals informed by existing AI frameworks and integrated with reporting standards for clinical AI research. MATERIALS AND METHODS: (1) Derive a provisional implementation framework based on the taxonomy of Stead et al and integrated with current reporting standards for AI research: TRIPOD, DECIDE-AI, CONSORT-AI. (2) Undertake a scoping review of published clinical AI implementation frameworks and identify key themes and stages. (3) Perform a gap analysis and refine the framework by incorporating missing items. RESULTS: The provisional AI implementation framework, called SALIENT, was mapped to 5 stages common to both the taxonomy and the reporting standards. A scoping review retrieved 20 studies and 247 themes, stages, and subelements were identified. A gap analysis identified 5 new cross-stage themes and 16 new tasks. The final framework comprised 5 stages, 7 elements, and 4 components, including the AI system, data pipeline, human-computer interface, and clinical workflow. DISCUSSION: This pragmatic framework resolves gaps in existing stage- and theme-based clinical AI implementation guidance by comprehensively addressing the what (components), when (stages), and how (tasks) of AI implementation, as well as the who (organization) and why (policy domains). By integrating research reporting standards into SALIENT, the framework is grounded in rigorous evaluation methodologies. The framework requires validation as being applicable to real-world studies of deployed AI models. CONCLUSIONS: A novel end-to-end framework has been developed for implementing AI within hospital clinical practice that builds on previous AI implementation frameworks and research reporting standards. Oxford University Press 2023-05-19 /pmc/articles/PMC10436156/ /pubmed/37208863 http://dx.doi.org/10.1093/jamia/ocad088 Text en © The Author(s) 2023. Published by Oxford University Press on behalf of the American Medical Informatics Association. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research and Applications
van der Vegt, Anton H
Scott, Ian A
Dermawan, Krishna
Schnetler, Rudolf J
Kalke, Vikrant R
Lane, Paul J
Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework
title Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework
title_full Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework
title_fullStr Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework
title_full_unstemmed Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework
title_short Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework
title_sort implementation frameworks for end-to-end clinical ai: derivation of the salient framework
topic Research and Applications
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10436156/
https://www.ncbi.nlm.nih.gov/pubmed/37208863
http://dx.doi.org/10.1093/jamia/ocad088
work_keys_str_mv AT vandervegtantonh implementationframeworksforendtoendclinicalaiderivationofthesalientframework
AT scottiana implementationframeworksforendtoendclinicalaiderivationofthesalientframework
AT dermawankrishna implementationframeworksforendtoendclinicalaiderivationofthesalientframework
AT schnetlerrudolfj implementationframeworksforendtoendclinicalaiderivationofthesalientframework
AT kalkevikrantr implementationframeworksforendtoendclinicalaiderivationofthesalientframework
AT lanepaulj implementationframeworksforendtoendclinicalaiderivationofthesalientframework