Cargando…
Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation
Deep learning has been widely used to analyze digitized hematoxylin and eosin (H&E)-stained histopathology whole slide images. Automated cancer segmentation using deep learning can be used to diagnose malignancy and to find novel morphological patterns to predict molecular subtypes. To train pix...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Elsevier
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9758515/ https://www.ncbi.nlm.nih.gov/pubmed/36536772 http://dx.doi.org/10.1016/j.jpi.2022.100160 |
_version_ | 1784852056437161984 |
---|---|
author | Ho, David Joon Chui, M. Herman Vanderbilt, Chad M. Jung, Jiwon Robson, Mark E. Park, Chan-Sik Roh, Jin Fuchs, Thomas J. |
author_facet | Ho, David Joon Chui, M. Herman Vanderbilt, Chad M. Jung, Jiwon Robson, Mark E. Park, Chan-Sik Roh, Jin Fuchs, Thomas J. |
author_sort | Ho, David Joon |
collection | PubMed |
description | Deep learning has been widely used to analyze digitized hematoxylin and eosin (H&E)-stained histopathology whole slide images. Automated cancer segmentation using deep learning can be used to diagnose malignancy and to find novel morphological patterns to predict molecular subtypes. To train pixel-wise cancer segmentation models, manual annotation from pathologists is generally a bottleneck due to its time-consuming nature. In this paper, we propose Deep Interactive Learning with a pretrained segmentation model from a different cancer type to reduce manual annotation time. Instead of annotating all pixels from cancer and non-cancer regions on giga-pixel whole slide images, an iterative process of annotating mislabeled regions from a segmentation model and training/finetuning the model with the additional annotation can reduce the time. Especially, employing a pretrained segmentation model can further reduce the time than starting annotation from scratch. We trained an accurate ovarian cancer segmentation model with a pretrained breast segmentation model by 3.5 hours of manual annotation which achieved intersection-over-union of 0.74, recall of 0.86, and precision of 0.84. With automatically extracted high-grade serous ovarian cancer patches, we attempted to train an additional classification deep learning model to predict BRCA mutation. The segmentation model and code have been released at https://github.com/MSKCC-Computational-Pathology/DMMN-ovary. |
format | Online Article Text |
id | pubmed-9758515 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Elsevier |
record_format | MEDLINE/PubMed |
spelling | pubmed-97585152022-12-18 Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation Ho, David Joon Chui, M. Herman Vanderbilt, Chad M. Jung, Jiwon Robson, Mark E. Park, Chan-Sik Roh, Jin Fuchs, Thomas J. J Pathol Inform Original Research Article Deep learning has been widely used to analyze digitized hematoxylin and eosin (H&E)-stained histopathology whole slide images. Automated cancer segmentation using deep learning can be used to diagnose malignancy and to find novel morphological patterns to predict molecular subtypes. To train pixel-wise cancer segmentation models, manual annotation from pathologists is generally a bottleneck due to its time-consuming nature. In this paper, we propose Deep Interactive Learning with a pretrained segmentation model from a different cancer type to reduce manual annotation time. Instead of annotating all pixels from cancer and non-cancer regions on giga-pixel whole slide images, an iterative process of annotating mislabeled regions from a segmentation model and training/finetuning the model with the additional annotation can reduce the time. Especially, employing a pretrained segmentation model can further reduce the time than starting annotation from scratch. We trained an accurate ovarian cancer segmentation model with a pretrained breast segmentation model by 3.5 hours of manual annotation which achieved intersection-over-union of 0.74, recall of 0.86, and precision of 0.84. With automatically extracted high-grade serous ovarian cancer patches, we attempted to train an additional classification deep learning model to predict BRCA mutation. The segmentation model and code have been released at https://github.com/MSKCC-Computational-Pathology/DMMN-ovary. Elsevier 2022-11-26 /pmc/articles/PMC9758515/ /pubmed/36536772 http://dx.doi.org/10.1016/j.jpi.2022.100160 Text en © 2022 The Authors https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). |
spellingShingle | Original Research Article Ho, David Joon Chui, M. Herman Vanderbilt, Chad M. Jung, Jiwon Robson, Mark E. Park, Chan-Sik Roh, Jin Fuchs, Thomas J. Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation |
title | Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation |
title_full | Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation |
title_fullStr | Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation |
title_full_unstemmed | Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation |
title_short | Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation |
title_sort | deep interactive learning-based ovarian cancer segmentation of h&e-stained whole slide images to study morphological patterns of brca mutation |
topic | Original Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9758515/ https://www.ncbi.nlm.nih.gov/pubmed/36536772 http://dx.doi.org/10.1016/j.jpi.2022.100160 |
work_keys_str_mv | AT hodavidjoon deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation AT chuimherman deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation AT vanderbiltchadm deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation AT jungjiwon deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation AT robsonmarke deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation AT parkchansik deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation AT rohjin deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation AT fuchsthomasj deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation |