Cargando…

Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study

BACKGROUND: The aim of this work is to evaluate the performance of radiomics predictions for a range of molecular, genomic and clinical targets in patients with clear cell renal cell carcinoma (ccRCC) and demonstrate the impact of novel feature selection strategies and sub-segmentations on model int...

Descripción completa

Detalles Bibliográficos
Autores principales: Orton, Matthew R., Hann, Evan, Doran, Simon J., Shepherd, Scott T. C., Ap Dafydd, Derfel, Spencer, Charlotte E., López, José I., Albarrán-Artahona, Víctor, Comito, Francesca, Warren, Hannah, Shur, Joshua, Messiou, Christina, Larkin, James, Turajlic, Samra, Koh, Dow-Mu
Formato: Online Artículo Texto
Lenguaje:English
Publicado: BioMed Central 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10424427/
https://www.ncbi.nlm.nih.gov/pubmed/37580840
http://dx.doi.org/10.1186/s40644-023-00594-3
_version_ 1785089675102257152
author Orton, Matthew R.
Hann, Evan
Doran, Simon J.
Shepherd, Scott T. C.
Ap Dafydd, Derfel
Spencer, Charlotte E.
López, José I.
Albarrán-Artahona, Víctor
Comito, Francesca
Warren, Hannah
Shur, Joshua
Messiou, Christina
Larkin, James
Turajlic, Samra
Koh, Dow-Mu
author_facet Orton, Matthew R.
Hann, Evan
Doran, Simon J.
Shepherd, Scott T. C.
Ap Dafydd, Derfel
Spencer, Charlotte E.
López, José I.
Albarrán-Artahona, Víctor
Comito, Francesca
Warren, Hannah
Shur, Joshua
Messiou, Christina
Larkin, James
Turajlic, Samra
Koh, Dow-Mu
author_sort Orton, Matthew R.
collection PubMed
description BACKGROUND: The aim of this work is to evaluate the performance of radiomics predictions for a range of molecular, genomic and clinical targets in patients with clear cell renal cell carcinoma (ccRCC) and demonstrate the impact of novel feature selection strategies and sub-segmentations on model interpretability. METHODS: Contrast-enhanced CT scans from the first 101 patients recruited to the TRACERx Renal Cancer study (NCT03226886) were used to derive radiomics classification models to predict 20 molecular, histopathology and clinical target variables. Manual 3D segmentation was used in conjunction with automatic sub-segmentation to generate radiomics features from the core, rim, high and low enhancing sub-regions, and the whole tumour. Comparisons were made between two classification model pipelines: a Conventional pipeline reflecting common radiomics practice, and a Proposed pipeline including two novel feature selection steps designed to improve model interpretability. For both pipelines nested cross-validation was used to estimate prediction performance and tune model hyper-parameters, and permutation testing was used to evaluate the statistical significance of the estimated performance measures. Further model robustness assessments were conducted by evaluating model variability across the cross-validation folds. RESULTS: Classification performance was significant (p < 0.05, H(0):AUROC = 0.5) for 11 of 20 targets using either pipeline and for these targets the AUROCs were within ± 0.05 for the two pipelines, except for one target where the Proposed pipeline performance increased by > 0.1. Five of these targets (necrosis on histology, presence of renal vein invasion, overall histological stage, linear evolutionary subtype and loss of 9p21.3 somatic alteration marker) had AUROC > 0.8. Models derived using the Proposed pipeline contained fewer feature groups than the Conventional pipeline, leading to more straightforward model interpretations without loss of performance. Sub-segmentations lead to improved performance and/or improved interpretability when predicting the presence of sarcomatoid differentiation and tumour stage. CONCLUSIONS: Use of the Proposed pipeline, which includes the novel feature selection methods, leads to more interpretable models without compromising prediction performance. TRIAL REGISTRATION: NCT03226886 (TRACERx Renal) SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s40644-023-00594-3.
format Online
Article
Text
id pubmed-10424427
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher BioMed Central
record_format MEDLINE/PubMed
spelling pubmed-104244272023-08-15 Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study Orton, Matthew R. Hann, Evan Doran, Simon J. Shepherd, Scott T. C. Ap Dafydd, Derfel Spencer, Charlotte E. López, José I. Albarrán-Artahona, Víctor Comito, Francesca Warren, Hannah Shur, Joshua Messiou, Christina Larkin, James Turajlic, Samra Koh, Dow-Mu Cancer Imaging Research Article BACKGROUND: The aim of this work is to evaluate the performance of radiomics predictions for a range of molecular, genomic and clinical targets in patients with clear cell renal cell carcinoma (ccRCC) and demonstrate the impact of novel feature selection strategies and sub-segmentations on model interpretability. METHODS: Contrast-enhanced CT scans from the first 101 patients recruited to the TRACERx Renal Cancer study (NCT03226886) were used to derive radiomics classification models to predict 20 molecular, histopathology and clinical target variables. Manual 3D segmentation was used in conjunction with automatic sub-segmentation to generate radiomics features from the core, rim, high and low enhancing sub-regions, and the whole tumour. Comparisons were made between two classification model pipelines: a Conventional pipeline reflecting common radiomics practice, and a Proposed pipeline including two novel feature selection steps designed to improve model interpretability. For both pipelines nested cross-validation was used to estimate prediction performance and tune model hyper-parameters, and permutation testing was used to evaluate the statistical significance of the estimated performance measures. Further model robustness assessments were conducted by evaluating model variability across the cross-validation folds. RESULTS: Classification performance was significant (p < 0.05, H(0):AUROC = 0.5) for 11 of 20 targets using either pipeline and for these targets the AUROCs were within ± 0.05 for the two pipelines, except for one target where the Proposed pipeline performance increased by > 0.1. Five of these targets (necrosis on histology, presence of renal vein invasion, overall histological stage, linear evolutionary subtype and loss of 9p21.3 somatic alteration marker) had AUROC > 0.8. Models derived using the Proposed pipeline contained fewer feature groups than the Conventional pipeline, leading to more straightforward model interpretations without loss of performance. Sub-segmentations lead to improved performance and/or improved interpretability when predicting the presence of sarcomatoid differentiation and tumour stage. CONCLUSIONS: Use of the Proposed pipeline, which includes the novel feature selection methods, leads to more interpretable models without compromising prediction performance. TRIAL REGISTRATION: NCT03226886 (TRACERx Renal) SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s40644-023-00594-3. BioMed Central 2023-08-14 /pmc/articles/PMC10424427/ /pubmed/37580840 http://dx.doi.org/10.1186/s40644-023-00594-3 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/ (https://creativecommons.org/publicdomain/zero/1.0/) ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
spellingShingle Research Article
Orton, Matthew R.
Hann, Evan
Doran, Simon J.
Shepherd, Scott T. C.
Ap Dafydd, Derfel
Spencer, Charlotte E.
López, José I.
Albarrán-Artahona, Víctor
Comito, Francesca
Warren, Hannah
Shur, Joshua
Messiou, Christina
Larkin, James
Turajlic, Samra
Koh, Dow-Mu
Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study
title Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study
title_full Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study
title_fullStr Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study
title_full_unstemmed Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study
title_short Interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the TRACERx Renal study
title_sort interpretability of radiomics models is improved when using feature group selection strategies for predicting molecular and clinical targets in clear-cell renal cell carcinoma: insights from the tracerx renal study
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10424427/
https://www.ncbi.nlm.nih.gov/pubmed/37580840
http://dx.doi.org/10.1186/s40644-023-00594-3
work_keys_str_mv AT ortonmatthewr interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT hannevan interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT doransimonj interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT shepherdscotttc interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT apdafyddderfel interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT spencercharlottee interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT lopezjosei interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT albarranartahonavictor interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT comitofrancesca interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT warrenhannah interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT shurjoshua interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT messiouchristina interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT larkinjames interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT turajlicsamra interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy
AT kohdowmu interpretabilityofradiomicsmodelsisimprovedwhenusingfeaturegroupselectionstrategiesforpredictingmolecularandclinicaltargetsinclearcellrenalcellcarcinomainsightsfromthetracerxrenalstudy