Cargando…
Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework
OBJECTIVE: To derive a comprehensive implementation framework for clinical AI models within hospitals informed by existing AI frameworks and integrated with reporting standards for clinical AI research. MATERIALS AND METHODS: (1) Derive a provisional implementation framework based on the taxonomy of...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Oxford University Press
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10436156/ https://www.ncbi.nlm.nih.gov/pubmed/37208863 http://dx.doi.org/10.1093/jamia/ocad088 |
_version_ | 1785092262140575744 |
---|---|
author | van der Vegt, Anton H Scott, Ian A Dermawan, Krishna Schnetler, Rudolf J Kalke, Vikrant R Lane, Paul J |
author_facet | van der Vegt, Anton H Scott, Ian A Dermawan, Krishna Schnetler, Rudolf J Kalke, Vikrant R Lane, Paul J |
author_sort | van der Vegt, Anton H |
collection | PubMed |
description | OBJECTIVE: To derive a comprehensive implementation framework for clinical AI models within hospitals informed by existing AI frameworks and integrated with reporting standards for clinical AI research. MATERIALS AND METHODS: (1) Derive a provisional implementation framework based on the taxonomy of Stead et al and integrated with current reporting standards for AI research: TRIPOD, DECIDE-AI, CONSORT-AI. (2) Undertake a scoping review of published clinical AI implementation frameworks and identify key themes and stages. (3) Perform a gap analysis and refine the framework by incorporating missing items. RESULTS: The provisional AI implementation framework, called SALIENT, was mapped to 5 stages common to both the taxonomy and the reporting standards. A scoping review retrieved 20 studies and 247 themes, stages, and subelements were identified. A gap analysis identified 5 new cross-stage themes and 16 new tasks. The final framework comprised 5 stages, 7 elements, and 4 components, including the AI system, data pipeline, human-computer interface, and clinical workflow. DISCUSSION: This pragmatic framework resolves gaps in existing stage- and theme-based clinical AI implementation guidance by comprehensively addressing the what (components), when (stages), and how (tasks) of AI implementation, as well as the who (organization) and why (policy domains). By integrating research reporting standards into SALIENT, the framework is grounded in rigorous evaluation methodologies. The framework requires validation as being applicable to real-world studies of deployed AI models. CONCLUSIONS: A novel end-to-end framework has been developed for implementing AI within hospital clinical practice that builds on previous AI implementation frameworks and research reporting standards. |
format | Online Article Text |
id | pubmed-10436156 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Oxford University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-104361562023-08-19 Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework van der Vegt, Anton H Scott, Ian A Dermawan, Krishna Schnetler, Rudolf J Kalke, Vikrant R Lane, Paul J J Am Med Inform Assoc Research and Applications OBJECTIVE: To derive a comprehensive implementation framework for clinical AI models within hospitals informed by existing AI frameworks and integrated with reporting standards for clinical AI research. MATERIALS AND METHODS: (1) Derive a provisional implementation framework based on the taxonomy of Stead et al and integrated with current reporting standards for AI research: TRIPOD, DECIDE-AI, CONSORT-AI. (2) Undertake a scoping review of published clinical AI implementation frameworks and identify key themes and stages. (3) Perform a gap analysis and refine the framework by incorporating missing items. RESULTS: The provisional AI implementation framework, called SALIENT, was mapped to 5 stages common to both the taxonomy and the reporting standards. A scoping review retrieved 20 studies and 247 themes, stages, and subelements were identified. A gap analysis identified 5 new cross-stage themes and 16 new tasks. The final framework comprised 5 stages, 7 elements, and 4 components, including the AI system, data pipeline, human-computer interface, and clinical workflow. DISCUSSION: This pragmatic framework resolves gaps in existing stage- and theme-based clinical AI implementation guidance by comprehensively addressing the what (components), when (stages), and how (tasks) of AI implementation, as well as the who (organization) and why (policy domains). By integrating research reporting standards into SALIENT, the framework is grounded in rigorous evaluation methodologies. The framework requires validation as being applicable to real-world studies of deployed AI models. CONCLUSIONS: A novel end-to-end framework has been developed for implementing AI within hospital clinical practice that builds on previous AI implementation frameworks and research reporting standards. Oxford University Press 2023-05-19 /pmc/articles/PMC10436156/ /pubmed/37208863 http://dx.doi.org/10.1093/jamia/ocad088 Text en © The Author(s) 2023. Published by Oxford University Press on behalf of the American Medical Informatics Association. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research and Applications van der Vegt, Anton H Scott, Ian A Dermawan, Krishna Schnetler, Rudolf J Kalke, Vikrant R Lane, Paul J Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework |
title | Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework |
title_full | Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework |
title_fullStr | Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework |
title_full_unstemmed | Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework |
title_short | Implementation frameworks for end-to-end clinical AI: derivation of the SALIENT framework |
title_sort | implementation frameworks for end-to-end clinical ai: derivation of the salient framework |
topic | Research and Applications |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10436156/ https://www.ncbi.nlm.nih.gov/pubmed/37208863 http://dx.doi.org/10.1093/jamia/ocad088 |
work_keys_str_mv | AT vandervegtantonh implementationframeworksforendtoendclinicalaiderivationofthesalientframework AT scottiana implementationframeworksforendtoendclinicalaiderivationofthesalientframework AT dermawankrishna implementationframeworksforendtoendclinicalaiderivationofthesalientframework AT schnetlerrudolfj implementationframeworksforendtoendclinicalaiderivationofthesalientframework AT kalkevikrantr implementationframeworksforendtoendclinicalaiderivationofthesalientframework AT lanepaulj implementationframeworksforendtoendclinicalaiderivationofthesalientframework |