Cargando…
A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis
BACKGROUND: Personalized medicine tailors care based on the patient’s or pathogen’s genotypic and phenotypic characteristics. An automated Clinical Decision Support System (CDSS) could help translate the genotypic and phenotypic characteristics into optimal treatment and thus facilitate implementati...
Autores principales: | , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8892778/ https://www.ncbi.nlm.nih.gov/pubmed/35236355 http://dx.doi.org/10.1186/s12911-022-01790-0 |
_version_ | 1784662257152557056 |
---|---|
author | Verboven, Lennert Calders, Toon Callens, Steven Black, John Maartens, Gary Dooley, Kelly E. Potgieter, Samantha Warren, Robin M. Laukens, Kris Van Rie, Annelies |
author_facet | Verboven, Lennert Calders, Toon Callens, Steven Black, John Maartens, Gary Dooley, Kelly E. Potgieter, Samantha Warren, Robin M. Laukens, Kris Van Rie, Annelies |
author_sort | Verboven, Lennert |
collection | PubMed |
description | BACKGROUND: Personalized medicine tailors care based on the patient’s or pathogen’s genotypic and phenotypic characteristics. An automated Clinical Decision Support System (CDSS) could help translate the genotypic and phenotypic characteristics into optimal treatment and thus facilitate implementation of individualized treatment by less experienced physicians. METHODS: We developed a hybrid knowledge- and data-driven treatment recommender CDSS. Stakeholders and experts first define the knowledge base by identifying and quantifying drug and regimen features for the prototype model input. In an iterative manner, feedback from experts is harvested to generate model training datasets, machine learning methods are applied to identify complex relations and patterns in the data, and model performance is assessed by estimating the precision at one, mean reciprocal rank and mean average precision. Once the model performance no longer iteratively increases, a validation dataset is used to assess model overfitting. RESULTS: We applied the novel methodology to develop a treatment recommender CDSS for individualized treatment of drug resistant tuberculosis as a proof of concept. Using input from stakeholders and three rounds of expert feedback on a dataset of 355 patients with 129 unique drug resistance profiles, the model had a 95% precision at 1 indicating that the highest ranked treatment regimen was considered appropriate by the experts in 95% of cases. Use of a validation data set however suggested substantial model overfitting, with a reduction in precision at 1 to 78%. CONCLUSION: Our novel and flexible hybrid knowledge- and data-driven treatment recommender CDSS is a first step towards the automation of individualized treatment for personalized medicine. Further research should assess its value in fields other than drug resistant tuberculosis, develop solid statistical approaches to assess model performance, and evaluate their accuracy in real-life clinical settings. |
format | Online Article Text |
id | pubmed-8892778 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-88927782022-03-10 A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis Verboven, Lennert Calders, Toon Callens, Steven Black, John Maartens, Gary Dooley, Kelly E. Potgieter, Samantha Warren, Robin M. Laukens, Kris Van Rie, Annelies BMC Med Inform Decis Mak Research BACKGROUND: Personalized medicine tailors care based on the patient’s or pathogen’s genotypic and phenotypic characteristics. An automated Clinical Decision Support System (CDSS) could help translate the genotypic and phenotypic characteristics into optimal treatment and thus facilitate implementation of individualized treatment by less experienced physicians. METHODS: We developed a hybrid knowledge- and data-driven treatment recommender CDSS. Stakeholders and experts first define the knowledge base by identifying and quantifying drug and regimen features for the prototype model input. In an iterative manner, feedback from experts is harvested to generate model training datasets, machine learning methods are applied to identify complex relations and patterns in the data, and model performance is assessed by estimating the precision at one, mean reciprocal rank and mean average precision. Once the model performance no longer iteratively increases, a validation dataset is used to assess model overfitting. RESULTS: We applied the novel methodology to develop a treatment recommender CDSS for individualized treatment of drug resistant tuberculosis as a proof of concept. Using input from stakeholders and three rounds of expert feedback on a dataset of 355 patients with 129 unique drug resistance profiles, the model had a 95% precision at 1 indicating that the highest ranked treatment regimen was considered appropriate by the experts in 95% of cases. Use of a validation data set however suggested substantial model overfitting, with a reduction in precision at 1 to 78%. CONCLUSION: Our novel and flexible hybrid knowledge- and data-driven treatment recommender CDSS is a first step towards the automation of individualized treatment for personalized medicine. Further research should assess its value in fields other than drug resistant tuberculosis, develop solid statistical approaches to assess model performance, and evaluate their accuracy in real-life clinical settings. BioMed Central 2022-03-02 /pmc/articles/PMC8892778/ /pubmed/35236355 http://dx.doi.org/10.1186/s12911-022-01790-0 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Research Verboven, Lennert Calders, Toon Callens, Steven Black, John Maartens, Gary Dooley, Kelly E. Potgieter, Samantha Warren, Robin M. Laukens, Kris Van Rie, Annelies A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis |
title | A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis |
title_full | A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis |
title_fullStr | A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis |
title_full_unstemmed | A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis |
title_short | A treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis |
title_sort | treatment recommender clinical decision support system for personalized medicine: method development and proof-of-concept for drug resistant tuberculosis |
topic | Research |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8892778/ https://www.ncbi.nlm.nih.gov/pubmed/35236355 http://dx.doi.org/10.1186/s12911-022-01790-0 |
work_keys_str_mv | AT verbovenlennert atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT calderstoon atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT callenssteven atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT blackjohn atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT maartensgary atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT dooleykellye atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT potgietersamantha atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT warrenrobinm atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT laukenskris atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT vanrieannelies atreatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT verbovenlennert treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT calderstoon treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT callenssteven treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT blackjohn treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT maartensgary treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT dooleykellye treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT potgietersamantha treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT warrenrobinm treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT laukenskris treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis AT vanrieannelies treatmentrecommenderclinicaldecisionsupportsystemforpersonalizedmedicinemethoddevelopmentandproofofconceptfordrugresistanttuberculosis |