Cargando…

Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation

Deep learning has been widely used to analyze digitized hematoxylin and eosin (H&E)-stained histopathology whole slide images. Automated cancer segmentation using deep learning can be used to diagnose malignancy and to find novel morphological patterns to predict molecular subtypes. To train pix...

Descripción completa

Detalles Bibliográficos
Autores principales: Ho, David Joon, Chui, M. Herman, Vanderbilt, Chad M., Jung, Jiwon, Robson, Mark E., Park, Chan-Sik, Roh, Jin, Fuchs, Thomas J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9758515/
https://www.ncbi.nlm.nih.gov/pubmed/36536772
http://dx.doi.org/10.1016/j.jpi.2022.100160
_version_ 1784852056437161984
author Ho, David Joon
Chui, M. Herman
Vanderbilt, Chad M.
Jung, Jiwon
Robson, Mark E.
Park, Chan-Sik
Roh, Jin
Fuchs, Thomas J.
author_facet Ho, David Joon
Chui, M. Herman
Vanderbilt, Chad M.
Jung, Jiwon
Robson, Mark E.
Park, Chan-Sik
Roh, Jin
Fuchs, Thomas J.
author_sort Ho, David Joon
collection PubMed
description Deep learning has been widely used to analyze digitized hematoxylin and eosin (H&E)-stained histopathology whole slide images. Automated cancer segmentation using deep learning can be used to diagnose malignancy and to find novel morphological patterns to predict molecular subtypes. To train pixel-wise cancer segmentation models, manual annotation from pathologists is generally a bottleneck due to its time-consuming nature. In this paper, we propose Deep Interactive Learning with a pretrained segmentation model from a different cancer type to reduce manual annotation time. Instead of annotating all pixels from cancer and non-cancer regions on giga-pixel whole slide images, an iterative process of annotating mislabeled regions from a segmentation model and training/finetuning the model with the additional annotation can reduce the time. Especially, employing a pretrained segmentation model can further reduce the time than starting annotation from scratch. We trained an accurate ovarian cancer segmentation model with a pretrained breast segmentation model by 3.5 hours of manual annotation which achieved intersection-over-union of 0.74, recall of 0.86, and precision of 0.84. With automatically extracted high-grade serous ovarian cancer patches, we attempted to train an additional classification deep learning model to predict BRCA mutation. The segmentation model and code have been released at https://github.com/MSKCC-Computational-Pathology/DMMN-ovary.
format Online
Article
Text
id pubmed-9758515
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Elsevier
record_format MEDLINE/PubMed
spelling pubmed-97585152022-12-18 Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation Ho, David Joon Chui, M. Herman Vanderbilt, Chad M. Jung, Jiwon Robson, Mark E. Park, Chan-Sik Roh, Jin Fuchs, Thomas J. J Pathol Inform Original Research Article Deep learning has been widely used to analyze digitized hematoxylin and eosin (H&E)-stained histopathology whole slide images. Automated cancer segmentation using deep learning can be used to diagnose malignancy and to find novel morphological patterns to predict molecular subtypes. To train pixel-wise cancer segmentation models, manual annotation from pathologists is generally a bottleneck due to its time-consuming nature. In this paper, we propose Deep Interactive Learning with a pretrained segmentation model from a different cancer type to reduce manual annotation time. Instead of annotating all pixels from cancer and non-cancer regions on giga-pixel whole slide images, an iterative process of annotating mislabeled regions from a segmentation model and training/finetuning the model with the additional annotation can reduce the time. Especially, employing a pretrained segmentation model can further reduce the time than starting annotation from scratch. We trained an accurate ovarian cancer segmentation model with a pretrained breast segmentation model by 3.5 hours of manual annotation which achieved intersection-over-union of 0.74, recall of 0.86, and precision of 0.84. With automatically extracted high-grade serous ovarian cancer patches, we attempted to train an additional classification deep learning model to predict BRCA mutation. The segmentation model and code have been released at https://github.com/MSKCC-Computational-Pathology/DMMN-ovary. Elsevier 2022-11-26 /pmc/articles/PMC9758515/ /pubmed/36536772 http://dx.doi.org/10.1016/j.jpi.2022.100160 Text en © 2022 The Authors https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
spellingShingle Original Research Article
Ho, David Joon
Chui, M. Herman
Vanderbilt, Chad M.
Jung, Jiwon
Robson, Mark E.
Park, Chan-Sik
Roh, Jin
Fuchs, Thomas J.
Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation
title Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation
title_full Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation
title_fullStr Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation
title_full_unstemmed Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation
title_short Deep Interactive Learning-based ovarian cancer segmentation of H&E-stained whole slide images to study morphological patterns of BRCA mutation
title_sort deep interactive learning-based ovarian cancer segmentation of h&e-stained whole slide images to study morphological patterns of brca mutation
topic Original Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9758515/
https://www.ncbi.nlm.nih.gov/pubmed/36536772
http://dx.doi.org/10.1016/j.jpi.2022.100160
work_keys_str_mv AT hodavidjoon deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation
AT chuimherman deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation
AT vanderbiltchadm deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation
AT jungjiwon deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation
AT robsonmarke deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation
AT parkchansik deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation
AT rohjin deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation
AT fuchsthomasj deepinteractivelearningbasedovariancancersegmentationofhestainedwholeslideimagestostudymorphologicalpatternsofbrcamutation