Cargando…
Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study
BACKGROUND: The aim of this work is to evaluate the performance of radiomics predictions for a range of molecular, genomic and clinical targets in patients with clear cell renal cell carcinoma (ccRCC) and demonstrate the impact of novel feature selection strategies and sub-segmentations on model int...
Autores principales: | , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
BioMed Central
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10424427/ https://www.ncbi.nlm.nih.gov/pubmed/37580840 http://dx.doi.org/10.1186/s40644-023-00594-3 |
_version_ | 1785089675102257152 |
---|---|
author | Orton, Matthew R. Hann, Evan Doran, Simon J. Shepherd, Scott T. C. Ap Dafydd, Derfel Spencer, Charlotte E. López, José I. Albarrán-Artahona, Víctor Comito, Francesca Warren, Hannah Shur, Joshua Messiou, Christina Larkin, James Turajlic, Samra Koh, Dow-Mu |
author_facet | Orton, Matthew R. Hann, Evan Doran, Simon J. Shepherd, Scott T. C. Ap Dafydd, Derfel Spencer, Charlotte E. López, José I. Albarrán-Artahona, Víctor Comito, Francesca Warren, Hannah Shur, Joshua Messiou, Christina Larkin, James Turajlic, Samra Koh, Dow-Mu |
author_sort | Orton, Matthew R. |
collection | PubMed |
description | BACKGROUND: The aim of this work is to evaluate the performance of radiomics predictions for a range of molecular, genomic and clinical targets in patients with clear cell renal cell carcinoma (ccRCC) and demonstrate the impact of novel feature selection strategies and sub-segmentations on model interpretability. METHODS: Contrast-enhanced CT scans from the first 101 patients recruited to the TRACERx Renal Cancer study (NCT03226886) were used to derive radiomics classification models to predict 20 molecular, histopathology and clinical target variables. Manual 3D segmentation was used in conjunction with automatic sub-segmentation to generate radiomics features from the core, rim, high and low enhancing sub-regions, and the whole tumour. Comparisons were made between two classification model pipelines: a Conventional pipeline reflecting common radiomics practice, and a Proposed pipeline including two novel feature selection steps designed to improve model interpretability. For both pipelines nested cross-validation was used to estimate prediction performance and tune model hyper-parameters, and permutation testing was used to evaluate the statistical significance of the estimated performance measures. Further model robustness assessments were conducted by evaluating model variability across the cross-validation folds. RESULTS: Classification performance was significant (p < 0.05, H(0):AUROC = 0.5) for 11 of 20 targets using either pipeline and for these targets the AUROCs were within ± 0.05 for the two pipelines, except for one target where the Proposed pipeline performance increased by > 0.1. Five of these targets (necrosis on histology, presence of renal vein invasion, overall histological stage, linear evolutionary subtype and loss of 9p21.3 somatic alteration marker) had AUROC > 0.8. Models derived using the Proposed pipeline contained fewer feature groups than the Conventional pipeline, leading to more straightforward model interpretations without loss of performance. Sub-segmentations lead to improved performance and/or improved interpretability when predicting the presence of sarcomatoid differentiation and tumour stage. CONCLUSIONS: Use of the Proposed pipeline, which includes the novel feature selection methods, leads to more interpretable models without compromising prediction performance. TRIAL REGISTRATION: NCT03226886 (TRACERx Renal) SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s40644-023-00594-3. |
format | Online Article Text |
id | pubmed-10424427 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | BioMed Central |
record_format | MEDLINE/PubMed |
spelling | pubmed-104244272023-08-15 Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study Orton, Matthew R. Hann, Evan Doran, Simon J. Shepherd, Scott T. C. Ap Dafydd, Derfel Spencer, Charlotte E. López, José I. Albarrán-Artahona, Víctor Comito, Francesca Warren, Hannah Shur, Joshua Messiou, Christina Larkin, James Turajlic, Samra Koh, Dow-Mu Cancer Imaging Research Article BACKGROUND: The aim of this work is to evaluate the performance of radiomics predictions for a range of molecular, genomic and clinical targets in patients with clear cell renal cell carcinoma (ccRCC) and demonstrate the impact of novel feature selection strategies and sub-segmentations on model interpretability. METHODS: Contrast-enhanced CT scans from the first 101 patients recruited to the TRACERx Renal Cancer study (NCT03226886) were used to derive radiomics classification models to predict 20 molecular, histopathology and clinical target variables. Manual 3D segmentation was used in conjunction with automatic sub-segmentation to generate radiomics features from the core, rim, high and low enhancing sub-regions, and the whole tumour. Comparisons were made between two classification model pipelines: a Conventional pipeline reflecting common radiomics practice, and a Proposed pipeline including two novel feature selection steps designed to improve model interpretability. For both pipelines nested cross-validation was used to estimate prediction performance and tune model hyper-parameters, and permutation testing was used to evaluate the statistical significance of the estimated performance measures. Further model robustness assessments were conducted by evaluating model variability across the cross-validation folds. RESULTS: Classification performance was significant (p < 0.05, H(0):AUROC = 0.5) for 11 of 20 targets using either pipeline and for these targets the AUROCs were within ± 0.05 for the two pipelines, except for one target where the Proposed pipeline performance increased by > 0.1. Five of these targets (necrosis on histology, presence of renal vein invasion, overall histological stage, linear evolutionary subtype and loss of 9p21.3 somatic alteration marker) had AUROC > 0.8. Models derived using the Proposed pipeline contained fewer feature groups than the Conventional pipeline, leading to more straightforward model interpretations without loss of performance. Sub-segmentations lead to improved performance and/or improved interpretability when predicting the presence of sarcomatoid differentiation and tumour stage. CONCLUSIONS: Use of the Proposed pipeline, which includes the novel feature selection methods, leads to more interpretable models without compromising prediction performance. TRIAL REGISTRATION: NCT03226886 (TRACERx Renal) SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s40644-023-00594-3. BioMed Central 2023-08-14 /pmc/articles/PMC10424427/ /pubmed/37580840 http://dx.doi.org/10.1186/s40644-023-00594-3 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data. |
spellingShingle | Research Article Orton, Matthew R. Hann, Evan Doran, Simon J. Shepherd, Scott T. C. Ap Dafydd, Derfel Spencer, Charlotte E. López, José I. Albarrán-Artahona, Víctor Comito, Francesca Warren, Hannah Shur, Joshua Messiou, Christina Larkin, James Turajlic, Samra Koh, Dow-Mu Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study |
title | Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study |
title_full | Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study |
title_fullStr | Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study |
title_full_unstemmed | Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study |
title_short | Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study |
title_sort | interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the tracerx renal study |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10424427/ https://www.ncbi.nlm.nih.gov/pubmed/37580840 http://dx.doi.org/10.1186/s40644-023-00594-3 |
work_keys_str_mv | AT ortonmatthewr interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT hannevan interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT doransimonj interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT shepherdscotttc interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT apdafyddderfel interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT spencercharlottee interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT lopezjosei interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT albarranartahonavictor interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT comitofrancesca interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT warrenhannah interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT shurjoshua interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT messiouchristina interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT larkinjames interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT turajlicsamra interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy AT kohdowmu interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy |