Cargando…

Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images

The Coronavirus disease is quickly spreading all over the world and the emergency situation is still out of control. Latest achievements of deep learning algorithms suggest the use of deep Convolutional Neural Network to implement a computer-aided diagnostic system for automatic classification of CO...

Descripción completa

Detalles Bibliográficos
Autores principales: Özdemir, Özgür, Sönmez, Elena Battini
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Authors. Published by Elsevier B.V. on behalf of King Saud University. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8280602/
http://dx.doi.org/10.1016/j.jksuci.2021.07.005
_version_ 1783722668244074496
author Özdemir, Özgür
Sönmez, Elena Battini
author_facet Özdemir, Özgür
Sönmez, Elena Battini
author_sort Özdemir, Özgür
collection PubMed
description The Coronavirus disease is quickly spreading all over the world and the emergency situation is still out of control. Latest achievements of deep learning algorithms suggest the use of deep Convolutional Neural Network to implement a computer-aided diagnostic system for automatic classification of COVID-19 CT images. In this paper, we propose to employ a feature-wise attention layer in order to enhance the discriminative features obtained by convolutional networks. Moreover, the original performance of the network has been improved using the mixup data augmentation technique. This work compares the proposed attention-based model against the stacked attention networks, and traditional versus mixup data augmentation approaches. We deduced that feature-wise attention extension, while outperforming the stacked attention variants, achieves remarkable improvements over the baseline convolutional neural networks. That is, ResNet50 architecture extended with a feature-wise attention layer obtained 95.57% accuracy score, which, to best of our knowledge, fixes the state-of-the-art in the challenging COVID-CT dataset.
format Online
Article
Text
id pubmed-8280602
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher The Authors. Published by Elsevier B.V. on behalf of King Saud University.
record_format MEDLINE/PubMed
spelling pubmed-82806022021-07-20 Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images Özdemir, Özgür Sönmez, Elena Battini Journal of King Saud University - Computer and Information Sciences Article The Coronavirus disease is quickly spreading all over the world and the emergency situation is still out of control. Latest achievements of deep learning algorithms suggest the use of deep Convolutional Neural Network to implement a computer-aided diagnostic system for automatic classification of COVID-19 CT images. In this paper, we propose to employ a feature-wise attention layer in order to enhance the discriminative features obtained by convolutional networks. Moreover, the original performance of the network has been improved using the mixup data augmentation technique. This work compares the proposed attention-based model against the stacked attention networks, and traditional versus mixup data augmentation approaches. We deduced that feature-wise attention extension, while outperforming the stacked attention variants, achieves remarkable improvements over the baseline convolutional neural networks. That is, ResNet50 architecture extended with a feature-wise attention layer obtained 95.57% accuracy score, which, to best of our knowledge, fixes the state-of-the-art in the challenging COVID-CT dataset. The Authors. Published by Elsevier B.V. on behalf of King Saud University. 2022-09 2021-07-15 /pmc/articles/PMC8280602/ http://dx.doi.org/10.1016/j.jksuci.2021.07.005 Text en © 2021 The Authors Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID-19. The COVID-19 resource centre is hosted on Elsevier Connect, the company's public news and information website. Elsevier hereby grants permission to make all its COVID-19-related research that is available on the COVID-19 resource centre - including this research content - immediately available in PubMed Central and other publicly funded repositories, such as the WHO COVID database with rights for unrestricted research re-use and analyses in any form or by any means with acknowledgement of the original source. These permissions are granted for free by Elsevier for as long as the COVID-19 resource centre remains active.
spellingShingle Article
Özdemir, Özgür
Sönmez, Elena Battini
Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images
title Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images
title_full Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images
title_fullStr Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images
title_full_unstemmed Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images
title_short Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images
title_sort attention mechanism and mixup data augmentation for classification of covid-19 computed tomography images
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8280602/
http://dx.doi.org/10.1016/j.jksuci.2021.07.005
work_keys_str_mv AT ozdemirozgur attentionmechanismandmixupdataaugmentationforclassificationofcovid19computedtomographyimages
AT sonmezelenabattini attentionmechanismandmixupdataaugmentationforclassificationofcovid19computedtomographyimages