Cargando…

Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning

In cytological examination, suspicious cells are evaluated regarding malignancy and cancer type. To assist this, we previously proposed an automated method based on supervised learning that classifies cells in lung cytological images as benign or malignant. However, it is often difficult to label al...

Descripción completa

Detalles Bibliográficos
Autores principales: Teramoto, Atsushi, Kiriyama, Yuka, Tsukamoto, Tetsuya, Sakurai, Eiko, Michiba, Ayano, Imaizumi, Kazuyoshi, Saito, Kuniaki, Fujita, Hiroshi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8514584/
https://www.ncbi.nlm.nih.gov/pubmed/34645863
http://dx.doi.org/10.1038/s41598-021-99246-4
_version_ 1784583423346606080
author Teramoto, Atsushi
Kiriyama, Yuka
Tsukamoto, Tetsuya
Sakurai, Eiko
Michiba, Ayano
Imaizumi, Kazuyoshi
Saito, Kuniaki
Fujita, Hiroshi
author_facet Teramoto, Atsushi
Kiriyama, Yuka
Tsukamoto, Tetsuya
Sakurai, Eiko
Michiba, Ayano
Imaizumi, Kazuyoshi
Saito, Kuniaki
Fujita, Hiroshi
author_sort Teramoto, Atsushi
collection PubMed
description In cytological examination, suspicious cells are evaluated regarding malignancy and cancer type. To assist this, we previously proposed an automated method based on supervised learning that classifies cells in lung cytological images as benign or malignant. However, it is often difficult to label all cells. In this study, we developed a weakly supervised method for the classification of benign and malignant lung cells in cytological images using attention-based deep multiple instance learning (AD MIL). Images of lung cytological specimens were divided into small patch images and stored in bags. Each bag was then labeled as benign or malignant, and classification was conducted using AD MIL. The distribution of attention weights was also calculated as a color map to confirm the presence of malignant cells in the image. AD MIL using the AlexNet-like convolutional neural network model showed the best classification performance, with an accuracy of 0.916, which was better than that of supervised learning. In addition, an attention map of the entire image based on the attention weight allowed AD MIL to focus on most malignant cells. Our weakly supervised method automatically classifies cytological images with acceptable accuracy based on supervised learning without complex annotations.
format Online
Article
Text
id pubmed-8514584
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-85145842021-10-15 Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning Teramoto, Atsushi Kiriyama, Yuka Tsukamoto, Tetsuya Sakurai, Eiko Michiba, Ayano Imaizumi, Kazuyoshi Saito, Kuniaki Fujita, Hiroshi Sci Rep Article In cytological examination, suspicious cells are evaluated regarding malignancy and cancer type. To assist this, we previously proposed an automated method based on supervised learning that classifies cells in lung cytological images as benign or malignant. However, it is often difficult to label all cells. In this study, we developed a weakly supervised method for the classification of benign and malignant lung cells in cytological images using attention-based deep multiple instance learning (AD MIL). Images of lung cytological specimens were divided into small patch images and stored in bags. Each bag was then labeled as benign or malignant, and classification was conducted using AD MIL. The distribution of attention weights was also calculated as a color map to confirm the presence of malignant cells in the image. AD MIL using the AlexNet-like convolutional neural network model showed the best classification performance, with an accuracy of 0.916, which was better than that of supervised learning. In addition, an attention map of the entire image based on the attention weight allowed AD MIL to focus on most malignant cells. Our weakly supervised method automatically classifies cytological images with acceptable accuracy based on supervised learning without complex annotations. Nature Publishing Group UK 2021-10-13 /pmc/articles/PMC8514584/ /pubmed/34645863 http://dx.doi.org/10.1038/s41598-021-99246-4 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Teramoto, Atsushi
Kiriyama, Yuka
Tsukamoto, Tetsuya
Sakurai, Eiko
Michiba, Ayano
Imaizumi, Kazuyoshi
Saito, Kuniaki
Fujita, Hiroshi
Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
title Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
title_full Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
title_fullStr Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
title_full_unstemmed Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
title_short Weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
title_sort weakly supervised learning for classification of lung cytological images using attention-based multiple instance learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8514584/
https://www.ncbi.nlm.nih.gov/pubmed/34645863
http://dx.doi.org/10.1038/s41598-021-99246-4
work_keys_str_mv AT teramotoatsushi weaklysupervisedlearningforclassificationoflungcytologicalimagesusingattentionbasedmultipleinstancelearning
AT kiriyamayuka weaklysupervisedlearningforclassificationoflungcytologicalimagesusingattentionbasedmultipleinstancelearning
AT tsukamototetsuya weaklysupervisedlearningforclassificationoflungcytologicalimagesusingattentionbasedmultipleinstancelearning
AT sakuraieiko weaklysupervisedlearningforclassificationoflungcytologicalimagesusingattentionbasedmultipleinstancelearning
AT michibaayano weaklysupervisedlearningforclassificationoflungcytologicalimagesusingattentionbasedmultipleinstancelearning
AT imaizumikazuyoshi weaklysupervisedlearningforclassificationoflungcytologicalimagesusingattentionbasedmultipleinstancelearning
AT saitokuniaki weaklysupervisedlearningforclassificationoflungcytologicalimagesusingattentionbasedmultipleinstancelearning
AT fujitahiroshi weaklysupervisedlearningforclassificationoflungcytologicalimagesusingattentionbasedmultipleinstancelearning