Cargando…
Ensemble modeling with machine learning and deep learning to provide interpretable generalized rules for classifying CNS drugs with high prediction power
The trade-off between a machine learning (ML) and deep learning (DL) model’s predictability and its interpretability has been a rising concern in central nervous system-related quantitative structure–activity relationship (CNS-QSAR) analysis. Many state-of-the-art predictive modeling failed to provi...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Oxford University Press
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8769704/ https://www.ncbi.nlm.nih.gov/pubmed/34530437 http://dx.doi.org/10.1093/bib/bbab377 |
_version_ | 1784635208553725952 |
---|---|
author | Yu, Tzu-Hui Su, Bo-Han Battalora, Leo Chander Liu, Sin Tseng, Yufeng Jane |
author_facet | Yu, Tzu-Hui Su, Bo-Han Battalora, Leo Chander Liu, Sin Tseng, Yufeng Jane |
author_sort | Yu, Tzu-Hui |
collection | PubMed |
description | The trade-off between a machine learning (ML) and deep learning (DL) model’s predictability and its interpretability has been a rising concern in central nervous system-related quantitative structure–activity relationship (CNS-QSAR) analysis. Many state-of-the-art predictive modeling failed to provide structural insights due to their black box-like nature. Lack of interpretability and further to provide easy simple rules would be challenging for CNS-QSAR models. To address these issues, we develop a protocol to combine the power of ML and DL to generate a set of simple rules that are easy to interpret with high prediction power. A data set of 940 market drugs (315 CNS-active, 625 CNS-inactive) with support vector machine and graph convolutional network algorithms were used. Individual ML/DL modeling methods were also constructed for comparison. The performance of these models was evaluated using an additional external dataset of 117 market drugs (42 CNS-active, 75 CNS-inactive). Fingerprint-split validation was adopted to ensure model stringency and generalizability. The resulting novel hybrid ensemble model outperformed other constituent traditional QSAR models with an accuracy of 0.96 and an F1 score of 0.95. With the power of the interpretability provided with this protocol, our model laid down a set of simple physicochemical rules to determine whether a compound can be a CNS drug using six sub-structural features. These rules displayed higher classification ability than classical guidelines, with higher specificity and more mechanistic insights than just for blood–brain barrier permeability. This hybrid protocol can potentially be used for other drug property predictions. |
format | Online Article Text |
id | pubmed-8769704 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Oxford University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-87697042022-01-20 Ensemble modeling with machine learning and deep learning to provide interpretable generalized rules for classifying CNS drugs with high prediction power Yu, Tzu-Hui Su, Bo-Han Battalora, Leo Chander Liu, Sin Tseng, Yufeng Jane Brief Bioinform Problem Solving Protocol The trade-off between a machine learning (ML) and deep learning (DL) model’s predictability and its interpretability has been a rising concern in central nervous system-related quantitative structure–activity relationship (CNS-QSAR) analysis. Many state-of-the-art predictive modeling failed to provide structural insights due to their black box-like nature. Lack of interpretability and further to provide easy simple rules would be challenging for CNS-QSAR models. To address these issues, we develop a protocol to combine the power of ML and DL to generate a set of simple rules that are easy to interpret with high prediction power. A data set of 940 market drugs (315 CNS-active, 625 CNS-inactive) with support vector machine and graph convolutional network algorithms were used. Individual ML/DL modeling methods were also constructed for comparison. The performance of these models was evaluated using an additional external dataset of 117 market drugs (42 CNS-active, 75 CNS-inactive). Fingerprint-split validation was adopted to ensure model stringency and generalizability. The resulting novel hybrid ensemble model outperformed other constituent traditional QSAR models with an accuracy of 0.96 and an F1 score of 0.95. With the power of the interpretability provided with this protocol, our model laid down a set of simple physicochemical rules to determine whether a compound can be a CNS drug using six sub-structural features. These rules displayed higher classification ability than classical guidelines, with higher specificity and more mechanistic insights than just for blood–brain barrier permeability. This hybrid protocol can potentially be used for other drug property predictions. Oxford University Press 2021-09-17 /pmc/articles/PMC8769704/ /pubmed/34530437 http://dx.doi.org/10.1093/bib/bbab377 Text en © The Author(s) 2021. Published by Oxford University Press. https://creativecommons.org/licenses/by-nc/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (https://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact journals.permissions@oup.com |
spellingShingle | Problem Solving Protocol Yu, Tzu-Hui Su, Bo-Han Battalora, Leo Chander Liu, Sin Tseng, Yufeng Jane Ensemble modeling with machine learning and deep learning to provide interpretable generalized rules for classifying CNS drugs with high prediction power |
title | Ensemble modeling with machine learning and deep learning to provide interpretable generalized rules for classifying CNS drugs with high prediction power |
title_full | Ensemble modeling with machine learning and deep learning to provide interpretable generalized rules for classifying CNS drugs with high prediction power |
title_fullStr | Ensemble modeling with machine learning and deep learning to provide interpretable generalized rules for classifying CNS drugs with high prediction power |
title_full_unstemmed | Ensemble modeling with machine learning and deep learning to provide interpretable generalized rules for classifying CNS drugs with high prediction power |
title_short | Ensemble modeling with machine learning and deep learning to provide interpretable generalized rules for classifying CNS drugs with high prediction power |
title_sort | ensemble modeling with machine learning and deep learning to provide interpretable generalized rules for classifying cns drugs with high prediction power |
topic | Problem Solving Protocol |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8769704/ https://www.ncbi.nlm.nih.gov/pubmed/34530437 http://dx.doi.org/10.1093/bib/bbab377 |
work_keys_str_mv | AT yutzuhui ensemblemodelingwithmachinelearninganddeeplearningtoprovideinterpretablegeneralizedrulesforclassifyingcnsdrugswithhighpredictionpower AT subohan ensemblemodelingwithmachinelearninganddeeplearningtoprovideinterpretablegeneralizedrulesforclassifyingcnsdrugswithhighpredictionpower AT battaloraleochander ensemblemodelingwithmachinelearninganddeeplearningtoprovideinterpretablegeneralizedrulesforclassifyingcnsdrugswithhighpredictionpower AT liusin ensemblemodelingwithmachinelearninganddeeplearningtoprovideinterpretablegeneralizedrulesforclassifyingcnsdrugswithhighpredictionpower AT tsengyufengjane ensemblemodelingwithmachinelearninganddeeplearningtoprovideinterpretablegeneralizedrulesforclassifyingcnsdrugswithhighpredictionpower |