Cargando…
Systematic comparison of multi-omics survival models reveals a widespread lack of noise resistance
As observed in several previous studies, integrating more molecular modalities in multi-omics cancer survival models may not always improve model accuracy. In this study, we compared eight deep learning and four statistical integration techniques for survival prediction on 17 multi-omics datasets, e...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Elsevier
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10162996/ https://www.ncbi.nlm.nih.gov/pubmed/37159669 http://dx.doi.org/10.1016/j.crmeth.2023.100461 |
_version_ | 1785037801842016256 |
---|---|
author | Wissel, David Rowson, Daniel Boeva, Valentina |
author_facet | Wissel, David Rowson, Daniel Boeva, Valentina |
author_sort | Wissel, David |
collection | PubMed |
description | As observed in several previous studies, integrating more molecular modalities in multi-omics cancer survival models may not always improve model accuracy. In this study, we compared eight deep learning and four statistical integration techniques for survival prediction on 17 multi-omics datasets, examining model performance in terms of overall accuracy and noise resistance. We found that one deep learning method, mean late fusion, and two statistical methods, PriorityLasso and BlockForest, performed best in terms of both noise resistance and overall discriminative and calibration performance. Nevertheless, all methods struggled to adequately handle noise when too many modalities were added. In summary, we confirmed that current multi-omics survival methods are not sufficiently noise resistant. We recommend relying on only modalities for which there is known predictive value for a particular cancer type until models that have stronger noise-resistance properties are developed. |
format | Online Article Text |
id | pubmed-10162996 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Elsevier |
record_format | MEDLINE/PubMed |
spelling | pubmed-101629962023-05-07 Systematic comparison of multi-omics survival models reveals a widespread lack of noise resistance Wissel, David Rowson, Daniel Boeva, Valentina Cell Rep Methods Resource As observed in several previous studies, integrating more molecular modalities in multi-omics cancer survival models may not always improve model accuracy. In this study, we compared eight deep learning and four statistical integration techniques for survival prediction on 17 multi-omics datasets, examining model performance in terms of overall accuracy and noise resistance. We found that one deep learning method, mean late fusion, and two statistical methods, PriorityLasso and BlockForest, performed best in terms of both noise resistance and overall discriminative and calibration performance. Nevertheless, all methods struggled to adequately handle noise when too many modalities were added. In summary, we confirmed that current multi-omics survival methods are not sufficiently noise resistant. We recommend relying on only modalities for which there is known predictive value for a particular cancer type until models that have stronger noise-resistance properties are developed. Elsevier 2023-04-24 /pmc/articles/PMC10162996/ /pubmed/37159669 http://dx.doi.org/10.1016/j.crmeth.2023.100461 Text en © 2023 The Author(s) https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Resource Wissel, David Rowson, Daniel Boeva, Valentina Systematic comparison of multi-omics survival models reveals a widespread lack of noise resistance |
title | Systematic comparison of multi-omics survival models reveals a widespread lack of noise resistance |
title_full | Systematic comparison of multi-omics survival models reveals a widespread lack of noise resistance |
title_fullStr | Systematic comparison of multi-omics survival models reveals a widespread lack of noise resistance |
title_full_unstemmed | Systematic comparison of multi-omics survival models reveals a widespread lack of noise resistance |
title_short | Systematic comparison of multi-omics survival models reveals a widespread lack of noise resistance |
title_sort | systematic comparison of multi-omics survival models reveals a widespread lack of noise resistance |
topic | Resource |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10162996/ https://www.ncbi.nlm.nih.gov/pubmed/37159669 http://dx.doi.org/10.1016/j.crmeth.2023.100461 |
work_keys_str_mv | AT wisseldavid systematiccomparisonofmultiomicssurvivalmodelsrevealsawidespreadlackofnoiseresistance AT rowsondaniel systematiccomparisonofmultiomicssurvivalmodelsrevealsawidespreadlackofnoiseresistance AT boevavalentina systematiccomparisonofmultiomicssurvivalmodelsrevealsawidespreadlackofnoiseresistance |