Cargando…

A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis

BACKGROUND: Personalized medicine tailors care based on the patient’s or pathogen’s genotypic and phenotypic characteristics. An automated Clinical Decision Support System (CDSS) could help translate the genotypic and phenotypic characteristics into optimal treatment and thus facilitate implementati...

Descripción completa

Detalles Bibliográficos
Autores principales: Verboven, Lennert, Calders, Toon, Callens, Steven, Black, John, Maartens, Gary, Dooley, Kelly E., Potgieter, Samantha, Warren, Robin M., Laukens, Kris, Van Rie, Annelies
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8892778/
https://www.ncbi.nlm.nih.gov/pubmed/35236355
http://dx.doi.org/10.1186/s12911-022-01790-0
_version_ 1784662257152557056
author Verboven, Lennert
Calders, Toon
Callens, Steven
Black, John
Maartens, Gary
Dooley, Kelly E.
Potgieter, Samantha
Warren, Robin M.
Laukens, Kris
Van Rie, Annelies
author_facet Verboven, Lennert
Calders, Toon
Callens, Steven
Black, John
Maartens, Gary
Dooley, Kelly E.
Potgieter, Samantha
Warren, Robin M.
Laukens, Kris
Van Rie, Annelies
author_sort Verboven, Lennert
collection PubMed
description BACKGROUND: Personalized medicine tailors care based on the patient’s or pathogen’s genotypic and phenotypic characteristics. An automated Clinical Decision Support System (CDSS) could help translate the genotypic and phenotypic characteristics into optimal treatment and thus facilitate implementation of individualized treatment by less experienced physicians. METHODS: We developed a hybrid knowledge- and data-driven treatment recommender CDSS. Stakeholders and experts first define the knowledge base by identifying and quantifying drug and regimen features for the prototype model input. In an iterative manner, feedback from experts is harvested to generate model training datasets, machine learning methods are applied to identify complex relations and patterns in the data, and model performance is assessed by estimating the precision at one, mean reciprocal rank and mean average precision. Once the model performance no longer iteratively increases, a validation dataset is used to assess model overfitting. RESULTS: We applied the novel methodology to develop a treatment recommender CDSS for individualized treatment of drug resistant tuberculosis as a proof of concept. Using input from stakeholders and three rounds of expert feedback on a dataset of 355 patients with 129 unique drug resistance profiles, the model had a 95% precision at 1 indicating that the highest ranked treatment regimen was considered appropriate by the experts in 95% of cases. Use of a validation data set however suggested substantial model overfitting, with a reduction in precision at 1 to 78%. CONCLUSION: Our novel and flexible hybrid knowledge- and data-driven treatment recommender CDSS is a first step towards the automation of individualized treatment for personalized medicine. Further research should assess its value in fields other than drug resistant tuberculosis, develop solid statistical approaches to assess model performance, and evaluate their accuracy in real-life clinical settings.
format Online
Article
Text
id pubmed-8892778
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-88927782022-03-10 A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis Verboven, Lennert Calders, Toon Callens, Steven Black, John Maartens, Gary Dooley, Kelly E. Potgieter, Samantha Warren, Robin M. Laukens, Kris Van Rie, Annelies BMC Med Inform Decis Mak Research BACKGROUND: Personalized medicine tailors care based on the patient’s or pathogen’s genotypic and phenotypic characteristics. An automated Clinical Decision Support System (CDSS) could help translate the genotypic and phenotypic characteristics into optimal treatment and thus facilitate implementation of individualized treatment by less experienced physicians. METHODS: We developed a hybrid knowledge- and data-driven treatment recommender CDSS. Stakeholders and experts first define the knowledge base by identifying and quantifying drug and regimen features for the prototype model input. In an iterative manner, feedback from experts is harvested to generate model training datasets, machine learning methods are applied to identify complex relations and patterns in the data, and model performance is assessed by estimating the precision at one, mean reciprocal rank and mean average precision. Once the model performance no longer iteratively increases, a validation dataset is used to assess model overfitting. RESULTS: We applied the novel methodology to develop a treatment recommender CDSS for individualized treatment of drug resistant tuberculosis as a proof of concept. Using input from stakeholders and three rounds of expert feedback on a dataset of 355 patients with 129 unique drug resistance profiles, the model had a 95% precision at 1 indicating that the highest ranked treatment regimen was considered appropriate by the experts in 95% of cases. Use of a validation data set however suggested substantial model overfitting, with a reduction in precision at 1 to 78%. CONCLUSION: Our novel and flexible hybrid knowledge- and data-driven treatment recommender CDSS is a first step towards the automation of individualized treatment for personalized medicine. Further research should assess its value in fields other than drug resistant tuberculosis, develop solid statistical approaches to assess model performance, and evaluate their accuracy in real-life clinical settings. BioMed Central 2022-03-02 /pmc/articles/PMC8892778/ /pubmed/35236355 http://dx.doi.org/10.1186/s12911-022-01790-0 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research
Verboven, Lennert
Calders, Toon
Callens, Steven
Black, John
Maartens, Gary
Dooley, Kelly E.
Potgieter, Samantha
Warren, Robin M.
Laukens, Kris
Van Rie, Annelies
A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis
title A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis
title_full A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis
title_fullStr A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis
title_full_unstemmed A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis
title_short A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis
title_sort treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8892778/
https://www.ncbi.nlm.nih.gov/pubmed/35236355
http://dx.doi.org/10.1186/s12911-022-01790-0
work_keys_str_mv AT verbovenlennert atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT calderstoon atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT callenssteven atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT blackjohn atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT maartensgary atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT dooleykellye atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT potgietersamantha atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT warrenrobinm atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT laukenskris atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT vanrieannelies atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT verbovenlennert treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT calderstoon treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT callenssteven treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT blackjohn treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT maartensgary treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT dooleykellye treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT potgietersamantha treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT warrenrobinm treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT laukenskris treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis
AT vanrieannelies treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis