Cargando…

Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning

PURPOSE: Artificial intelligence (AI)-automated tumor delineation for pediatric gliomas would enable real-time volumetric evaluation to support diagnosis, treatment response assessment, and clinical decision-making. Auto-segmentation algorithms for pediatric tumors are rare, due to limited data avai...

Descripción completa

Detalles Bibliográficos
Autores principales: Boyd, Aidan, Ye, Zezhong, Prabhu, Sanjay, Tjong, Michael C., Zha, Yining, Zapaishchykova, Anna, Vajapeyam, Sridhar, Hayat, Hasaan, Chopra, Rishi, Liu, Kevin X., Nabavidazeh, Ali, Resnick, Adam, Mueller, Sabine, Haas-Kogan, Daphne, Aerts, Hugo J.W.L., Poussaint, Tina, Kann, Benjamin H.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cold Spring Harbor Laboratory 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10327271/
https://www.ncbi.nlm.nih.gov/pubmed/37425854
http://dx.doi.org/10.1101/2023.06.29.23292048
_version_ 1785069588594032640
author Boyd, Aidan
Ye, Zezhong
Prabhu, Sanjay
Tjong, Michael C.
Zha, Yining
Zapaishchykova, Anna
Vajapeyam, Sridhar
Hayat, Hasaan
Chopra, Rishi
Liu, Kevin X.
Nabavidazeh, Ali
Resnick, Adam
Mueller, Sabine
Haas-Kogan, Daphne
Aerts, Hugo J.W.L.
Poussaint, Tina
Kann, Benjamin H.
author_facet Boyd, Aidan
Ye, Zezhong
Prabhu, Sanjay
Tjong, Michael C.
Zha, Yining
Zapaishchykova, Anna
Vajapeyam, Sridhar
Hayat, Hasaan
Chopra, Rishi
Liu, Kevin X.
Nabavidazeh, Ali
Resnick, Adam
Mueller, Sabine
Haas-Kogan, Daphne
Aerts, Hugo J.W.L.
Poussaint, Tina
Kann, Benjamin H.
author_sort Boyd, Aidan
collection PubMed
description PURPOSE: Artificial intelligence (AI)-automated tumor delineation for pediatric gliomas would enable real-time volumetric evaluation to support diagnosis, treatment response assessment, and clinical decision-making. Auto-segmentation algorithms for pediatric tumors are rare, due to limited data availability, and algorithms have yet to demonstrate clinical translation. METHODS: We leveraged two datasets from a national brain tumor consortium (n=184) and a pediatric cancer center (n=100) to develop, externally validate, and clinically benchmark deep learning neural networks for pediatric low-grade glioma (pLGG) segmentation using a novel in-domain, stepwise transfer learning approach. The best model [via Dice similarity coefficient (DSC)] was externally validated and subject to randomized, blinded evaluation by three expert clinicians wherein clinicians assessed clinical acceptability of expert- and AI-generated segmentations via 10-point Likert scales and Turing tests. RESULTS: The best AI model utilized in-domain, stepwise transfer learning (median DSC: 0.877 [IQR 0.715–0.914]) versus baseline model (median DSC 0.812 [IQR 0.559–0.888]; p<0.05). On external testing (n=60), the AI model yielded accuracy comparable to inter-expert agreement (median DSC: 0.834 [IQR 0.726–0.901] vs. 0.861 [IQR 0.795–0.905], p=0.13). On clinical benchmarking (n=100 scans, 300 segmentations from 3 experts), the experts rated the AI model higher on average compared to other experts (median Likert rating: 9 [IQR 7–9]) vs. 7 [IQR 7–9], p<0.05 for each). Additionally, the AI segmentations had significantly higher (p<0.05) overall acceptability compared to experts on average (80.2% vs. 65.4%). Experts correctly predicted the origins of AI segmentations in an average of 26.0% of cases. CONCLUSIONS: Stepwise transfer learning enabled expert-level, automated pediatric brain tumor auto-segmentation and volumetric measurement with a high level of clinical acceptability. This approach may enable development and translation of AI imaging segmentation algorithms in limited data scenarios.
format Online
Article
Text
id pubmed-10327271
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Cold Spring Harbor Laboratory
record_format MEDLINE/PubMed
spelling pubmed-103272712023-07-08 Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning Boyd, Aidan Ye, Zezhong Prabhu, Sanjay Tjong, Michael C. Zha, Yining Zapaishchykova, Anna Vajapeyam, Sridhar Hayat, Hasaan Chopra, Rishi Liu, Kevin X. Nabavidazeh, Ali Resnick, Adam Mueller, Sabine Haas-Kogan, Daphne Aerts, Hugo J.W.L. Poussaint, Tina Kann, Benjamin H. medRxiv Article PURPOSE: Artificial intelligence (AI)-automated tumor delineation for pediatric gliomas would enable real-time volumetric evaluation to support diagnosis, treatment response assessment, and clinical decision-making. Auto-segmentation algorithms for pediatric tumors are rare, due to limited data availability, and algorithms have yet to demonstrate clinical translation. METHODS: We leveraged two datasets from a national brain tumor consortium (n=184) and a pediatric cancer center (n=100) to develop, externally validate, and clinically benchmark deep learning neural networks for pediatric low-grade glioma (pLGG) segmentation using a novel in-domain, stepwise transfer learning approach. The best model [via Dice similarity coefficient (DSC)] was externally validated and subject to randomized, blinded evaluation by three expert clinicians wherein clinicians assessed clinical acceptability of expert- and AI-generated segmentations via 10-point Likert scales and Turing tests. RESULTS: The best AI model utilized in-domain, stepwise transfer learning (median DSC: 0.877 [IQR 0.715–0.914]) versus baseline model (median DSC 0.812 [IQR 0.559–0.888]; p<0.05). On external testing (n=60), the AI model yielded accuracy comparable to inter-expert agreement (median DSC: 0.834 [IQR 0.726–0.901] vs. 0.861 [IQR 0.795–0.905], p=0.13). On clinical benchmarking (n=100 scans, 300 segmentations from 3 experts), the experts rated the AI model higher on average compared to other experts (median Likert rating: 9 [IQR 7–9]) vs. 7 [IQR 7–9], p<0.05 for each). Additionally, the AI segmentations had significantly higher (p<0.05) overall acceptability compared to experts on average (80.2% vs. 65.4%). Experts correctly predicted the origins of AI segmentations in an average of 26.0% of cases. CONCLUSIONS: Stepwise transfer learning enabled expert-level, automated pediatric brain tumor auto-segmentation and volumetric measurement with a high level of clinical acceptability. This approach may enable development and translation of AI imaging segmentation algorithms in limited data scenarios. Cold Spring Harbor Laboratory 2023-09-18 /pmc/articles/PMC10327271/ /pubmed/37425854 http://dx.doi.org/10.1101/2023.06.29.23292048 Text en https://creativecommons.org/licenses/by-nc/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (https://creativecommons.org/licenses/by-nc/4.0/) , which allows reusers to distribute, remix, adapt, and build upon the material in any medium or format for noncommercial purposes only, and only so long as attribution is given to the creator.
spellingShingle Article
Boyd, Aidan
Ye, Zezhong
Prabhu, Sanjay
Tjong, Michael C.
Zha, Yining
Zapaishchykova, Anna
Vajapeyam, Sridhar
Hayat, Hasaan
Chopra, Rishi
Liu, Kevin X.
Nabavidazeh, Ali
Resnick, Adam
Mueller, Sabine
Haas-Kogan, Daphne
Aerts, Hugo J.W.L.
Poussaint, Tina
Kann, Benjamin H.
Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning
title Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning
title_full Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning
title_fullStr Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning
title_full_unstemmed Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning
title_short Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning
title_sort expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10327271/
https://www.ncbi.nlm.nih.gov/pubmed/37425854
http://dx.doi.org/10.1101/2023.06.29.23292048
work_keys_str_mv AT boydaidan expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT yezezhong expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT prabhusanjay expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT tjongmichaelc expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT zhayining expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT zapaishchykovaanna expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT vajapeyamsridhar expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT hayathasaan expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT choprarishi expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT liukevinx expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT nabavidazehali expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT resnickadam expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT muellersabine expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT haaskogandaphne expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT aertshugojwl expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT poussainttina expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning
AT kannbenjaminh expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning