Cargando…
Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning
PURPOSE: Artificial intelligence (AI)-automated tumor delineation for pediatric gliomas would enable real-time volumetric evaluation to support diagnosis, treatment response assessment, and clinical decision-making. Auto-segmentation algorithms for pediatric tumors are rare, due to limited data avai...
Autores principales: | , , , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Cold Spring Harbor Laboratory
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10327271/ https://www.ncbi.nlm.nih.gov/pubmed/37425854 http://dx.doi.org/10.1101/2023.06.29.23292048 |
_version_ | 1785069588594032640 |
---|---|
author | Boyd, Aidan Ye, Zezhong Prabhu, Sanjay Tjong, Michael C. Zha, Yining Zapaishchykova, Anna Vajapeyam, Sridhar Hayat, Hasaan Chopra, Rishi Liu, Kevin X. Nabavidazeh, Ali Resnick, Adam Mueller, Sabine Haas-Kogan, Daphne Aerts, Hugo J.W.L. Poussaint, Tina Kann, Benjamin H. |
author_facet | Boyd, Aidan Ye, Zezhong Prabhu, Sanjay Tjong, Michael C. Zha, Yining Zapaishchykova, Anna Vajapeyam, Sridhar Hayat, Hasaan Chopra, Rishi Liu, Kevin X. Nabavidazeh, Ali Resnick, Adam Mueller, Sabine Haas-Kogan, Daphne Aerts, Hugo J.W.L. Poussaint, Tina Kann, Benjamin H. |
author_sort | Boyd, Aidan |
collection | PubMed |
description | PURPOSE: Artificial intelligence (AI)-automated tumor delineation for pediatric gliomas would enable real-time volumetric evaluation to support diagnosis, treatment response assessment, and clinical decision-making. Auto-segmentation algorithms for pediatric tumors are rare, due to limited data availability, and algorithms have yet to demonstrate clinical translation. METHODS: We leveraged two datasets from a national brain tumor consortium (n=184) and a pediatric cancer center (n=100) to develop, externally validate, and clinically benchmark deep learning neural networks for pediatric low-grade glioma (pLGG) segmentation using a novel in-domain, stepwise transfer learning approach. The best model [via Dice similarity coefficient (DSC)] was externally validated and subject to randomized, blinded evaluation by three expert clinicians wherein clinicians assessed clinical acceptability of expert- and AI-generated segmentations via 10-point Likert scales and Turing tests. RESULTS: The best AI model utilized in-domain, stepwise transfer learning (median DSC: 0.877 [IQR 0.715–0.914]) versus baseline model (median DSC 0.812 [IQR 0.559–0.888]; p<0.05). On external testing (n=60), the AI model yielded accuracy comparable to inter-expert agreement (median DSC: 0.834 [IQR 0.726–0.901] vs. 0.861 [IQR 0.795–0.905], p=0.13). On clinical benchmarking (n=100 scans, 300 segmentations from 3 experts), the experts rated the AI model higher on average compared to other experts (median Likert rating: 9 [IQR 7–9]) vs. 7 [IQR 7–9], p<0.05 for each). Additionally, the AI segmentations had significantly higher (p<0.05) overall acceptability compared to experts on average (80.2% vs. 65.4%). Experts correctly predicted the origins of AI segmentations in an average of 26.0% of cases. CONCLUSIONS: Stepwise transfer learning enabled expert-level, automated pediatric brain tumor auto-segmentation and volumetric measurement with a high level of clinical acceptability. This approach may enable development and translation of AI imaging segmentation algorithms in limited data scenarios. |
format | Online Article Text |
id | pubmed-10327271 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Cold Spring Harbor Laboratory |
record_format | MEDLINE/PubMed |
spelling | pubmed-103272712023-07-08 Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning Boyd, Aidan Ye, Zezhong Prabhu, Sanjay Tjong, Michael C. Zha, Yining Zapaishchykova, Anna Vajapeyam, Sridhar Hayat, Hasaan Chopra, Rishi Liu, Kevin X. Nabavidazeh, Ali Resnick, Adam Mueller, Sabine Haas-Kogan, Daphne Aerts, Hugo J.W.L. Poussaint, Tina Kann, Benjamin H. medRxiv Article PURPOSE: Artificial intelligence (AI)-automated tumor delineation for pediatric gliomas would enable real-time volumetric evaluation to support diagnosis, treatment response assessment, and clinical decision-making. Auto-segmentation algorithms for pediatric tumors are rare, due to limited data availability, and algorithms have yet to demonstrate clinical translation. METHODS: We leveraged two datasets from a national brain tumor consortium (n=184) and a pediatric cancer center (n=100) to develop, externally validate, and clinically benchmark deep learning neural networks for pediatric low-grade glioma (pLGG) segmentation using a novel in-domain, stepwise transfer learning approach. The best model [via Dice similarity coefficient (DSC)] was externally validated and subject to randomized, blinded evaluation by three expert clinicians wherein clinicians assessed clinical acceptability of expert- and AI-generated segmentations via 10-point Likert scales and Turing tests. RESULTS: The best AI model utilized in-domain, stepwise transfer learning (median DSC: 0.877 [IQR 0.715–0.914]) versus baseline model (median DSC 0.812 [IQR 0.559–0.888]; p<0.05). On external testing (n=60), the AI model yielded accuracy comparable to inter-expert agreement (median DSC: 0.834 [IQR 0.726–0.901] vs. 0.861 [IQR 0.795–0.905], p=0.13). On clinical benchmarking (n=100 scans, 300 segmentations from 3 experts), the experts rated the AI model higher on average compared to other experts (median Likert rating: 9 [IQR 7–9]) vs. 7 [IQR 7–9], p<0.05 for each). Additionally, the AI segmentations had significantly higher (p<0.05) overall acceptability compared to experts on average (80.2% vs. 65.4%). Experts correctly predicted the origins of AI segmentations in an average of 26.0% of cases. CONCLUSIONS: Stepwise transfer learning enabled expert-level, automated pediatric brain tumor auto-segmentation and volumetric measurement with a high level of clinical acceptability. This approach may enable development and translation of AI imaging segmentation algorithms in limited data scenarios. Cold Spring Harbor Laboratory 2023-09-18 /pmc/articles/PMC10327271/ /pubmed/37425854 http://dx.doi.org/10.1101/2023.06.29.23292048 Text en https://creativecommons.org/licenses/by-nc/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (https://creativecommons.org/licenses/by-nc/4.0/) , which allows reusers to distribute, remix, adapt, and build upon the material in any medium or format for noncommercial purposes only, and only so long as attribution is given to the creator. |
spellingShingle | Article Boyd, Aidan Ye, Zezhong Prabhu, Sanjay Tjong, Michael C. Zha, Yining Zapaishchykova, Anna Vajapeyam, Sridhar Hayat, Hasaan Chopra, Rishi Liu, Kevin X. Nabavidazeh, Ali Resnick, Adam Mueller, Sabine Haas-Kogan, Daphne Aerts, Hugo J.W.L. Poussaint, Tina Kann, Benjamin H. Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning |
title | Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning |
title_full | Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning |
title_fullStr | Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning |
title_full_unstemmed | Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning |
title_short | Expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning |
title_sort | expert-level pediatric brain tumor segmentation in a limited data scenario with stepwise transfer learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10327271/ https://www.ncbi.nlm.nih.gov/pubmed/37425854 http://dx.doi.org/10.1101/2023.06.29.23292048 |
work_keys_str_mv | AT boydaidan expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT yezezhong expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT prabhusanjay expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT tjongmichaelc expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT zhayining expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT zapaishchykovaanna expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT vajapeyamsridhar expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT hayathasaan expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT choprarishi expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT liukevinx expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT nabavidazehali expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT resnickadam expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT muellersabine expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT haaskogandaphne expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT aertshugojwl expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT poussainttina expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning AT kannbenjaminh expertlevelpediatricbraintumorsegmentationinalimiteddatascenariowithstepwisetransferlearning |