Cargando…

Machine Learning for Predicting Mortality in Transcatheter Aortic Valve Implantation: An Inter-Center Cross Validation Study

Current prognostic risk scores for transcatheter aortic valve implantation (TAVI) do not benefit yet from modern machine learning techniques, which can improve risk stratification of one-year mortality of patients before TAVI. Despite the advancement of machine learning in healthcare, data sharing r...

Descripción completa

Detalles Bibliográficos
Autores principales: Mamprin, Marco, Lopes, Ricardo R., Zelis, Jo M., Tonino, Pim A. L., van Mourik, Martijn S., Vis, Marije M., Zinger, Svitlana, de Mol, Bas A. J. M., de With, Peter H. N.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8227005/
https://www.ncbi.nlm.nih.gov/pubmed/34199892
http://dx.doi.org/10.3390/jcdd8060065
_version_ 1783712422448594944
author Mamprin, Marco
Lopes, Ricardo R.
Zelis, Jo M.
Tonino, Pim A. L.
van Mourik, Martijn S.
Vis, Marije M.
Zinger, Svitlana
de Mol, Bas A. J. M.
de With, Peter H. N.
author_facet Mamprin, Marco
Lopes, Ricardo R.
Zelis, Jo M.
Tonino, Pim A. L.
van Mourik, Martijn S.
Vis, Marije M.
Zinger, Svitlana
de Mol, Bas A. J. M.
de With, Peter H. N.
author_sort Mamprin, Marco
collection PubMed
description Current prognostic risk scores for transcatheter aortic valve implantation (TAVI) do not benefit yet from modern machine learning techniques, which can improve risk stratification of one-year mortality of patients before TAVI. Despite the advancement of machine learning in healthcare, data sharing regulations are very strict and typically prevent exchanging patient data, without the involvement of ethical committees. A very robust validation approach, including 1300 and 631 patients per center, was performed to validate a machine learning model of one center at the other external center with their data, in a mutual fashion. This was achieved without any data exchange but solely by exchanging the models and the data processing pipelines. A dedicated exchange protocol was designed to evaluate and quantify the model’s robustness on the data of the external center. Models developed with the larger dataset offered similar or higher prediction accuracy on the external validation. Logistic regression, random forest and CatBoost lead to areas under curve of the ROC of 0.65, 0.67 and 0.65 for the internal validation and of 0.62, 0.66, 0.68 for the external validation, respectively. We propose a scalable exchange protocol which can be further extended on other TAVI centers, but more generally to any other clinical scenario, that could benefit from this validation approach.
format Online
Article
Text
id pubmed-8227005
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-82270052021-06-26 Machine Learning for Predicting Mortality in Transcatheter Aortic Valve Implantation: An Inter-Center Cross Validation Study Mamprin, Marco Lopes, Ricardo R. Zelis, Jo M. Tonino, Pim A. L. van Mourik, Martijn S. Vis, Marije M. Zinger, Svitlana de Mol, Bas A. J. M. de With, Peter H. N. J Cardiovasc Dev Dis Article Current prognostic risk scores for transcatheter aortic valve implantation (TAVI) do not benefit yet from modern machine learning techniques, which can improve risk stratification of one-year mortality of patients before TAVI. Despite the advancement of machine learning in healthcare, data sharing regulations are very strict and typically prevent exchanging patient data, without the involvement of ethical committees. A very robust validation approach, including 1300 and 631 patients per center, was performed to validate a machine learning model of one center at the other external center with their data, in a mutual fashion. This was achieved without any data exchange but solely by exchanging the models and the data processing pipelines. A dedicated exchange protocol was designed to evaluate and quantify the model’s robustness on the data of the external center. Models developed with the larger dataset offered similar or higher prediction accuracy on the external validation. Logistic regression, random forest and CatBoost lead to areas under curve of the ROC of 0.65, 0.67 and 0.65 for the internal validation and of 0.62, 0.66, 0.68 for the external validation, respectively. We propose a scalable exchange protocol which can be further extended on other TAVI centers, but more generally to any other clinical scenario, that could benefit from this validation approach. MDPI 2021-06-04 /pmc/articles/PMC8227005/ /pubmed/34199892 http://dx.doi.org/10.3390/jcdd8060065 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Mamprin, Marco
Lopes, Ricardo R.
Zelis, Jo M.
Tonino, Pim A. L.
van Mourik, Martijn S.
Vis, Marije M.
Zinger, Svitlana
de Mol, Bas A. J. M.
de With, Peter H. N.
Machine Learning for Predicting Mortality in Transcatheter Aortic Valve Implantation: An Inter-Center Cross Validation Study
title Machine Learning for Predicting Mortality in Transcatheter Aortic Valve Implantation: An Inter-Center Cross Validation Study
title_full Machine Learning for Predicting Mortality in Transcatheter Aortic Valve Implantation: An Inter-Center Cross Validation Study
title_fullStr Machine Learning for Predicting Mortality in Transcatheter Aortic Valve Implantation: An Inter-Center Cross Validation Study
title_full_unstemmed Machine Learning for Predicting Mortality in Transcatheter Aortic Valve Implantation: An Inter-Center Cross Validation Study
title_short Machine Learning for Predicting Mortality in Transcatheter Aortic Valve Implantation: An Inter-Center Cross Validation Study
title_sort machine learning for predicting mortality in transcatheter aortic valve implantation: an inter-center cross validation study
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8227005/
https://www.ncbi.nlm.nih.gov/pubmed/34199892
http://dx.doi.org/10.3390/jcdd8060065
work_keys_str_mv AT mamprinmarco machinelearningforpredictingmortalityintranscatheteraorticvalveimplantationanintercentercrossvalidationstudy
AT lopesricardor machinelearningforpredictingmortalityintranscatheteraorticvalveimplantationanintercentercrossvalidationstudy
AT zelisjom machinelearningforpredictingmortalityintranscatheteraorticvalveimplantationanintercentercrossvalidationstudy
AT toninopimal machinelearningforpredictingmortalityintranscatheteraorticvalveimplantationanintercentercrossvalidationstudy
AT vanmourikmartijns machinelearningforpredictingmortalityintranscatheteraorticvalveimplantationanintercentercrossvalidationstudy
AT vismarijem machinelearningforpredictingmortalityintranscatheteraorticvalveimplantationanintercentercrossvalidationstudy
AT zingersvitlana machinelearningforpredictingmortalityintranscatheteraorticvalveimplantationanintercentercrossvalidationstudy
AT demolbasajm machinelearningforpredictingmortalityintranscatheteraorticvalveimplantationanintercentercrossvalidationstudy
AT dewithpeterhn machinelearningforpredictingmortalityintranscatheteraorticvalveimplantationanintercentercrossvalidationstudy