Cargando…
Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images
The Coronavirus disease is quickly spreading all over the world and the emergency situation is still out of control. Latest achievements of deep learning algorithms suggest the use of deep Convolutional Neural Network to implement a computer-aided diagnostic system for automatic classification of CO...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
The Authors. Published by Elsevier B.V. on behalf of King Saud University.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8280602/ http://dx.doi.org/10.1016/j.jksuci.2021.07.005 |
_version_ | 1783722668244074496 |
---|---|
author | Özdemir, Özgür Sönmez, Elena Battini |
author_facet | Özdemir, Özgür Sönmez, Elena Battini |
author_sort | Özdemir, Özgür |
collection | PubMed |
description | The Coronavirus disease is quickly spreading all over the world and the emergency situation is still out of control. Latest achievements of deep learning algorithms suggest the use of deep Convolutional Neural Network to implement a computer-aided diagnostic system for automatic classification of COVID-19 CT images. In this paper, we propose to employ a feature-wise attention layer in order to enhance the discriminative features obtained by convolutional networks. Moreover, the original performance of the network has been improved using the mixup data augmentation technique. This work compares the proposed attention-based model against the stacked attention networks, and traditional versus mixup data augmentation approaches. We deduced that feature-wise attention extension, while outperforming the stacked attention variants, achieves remarkable improvements over the baseline convolutional neural networks. That is, ResNet50 architecture extended with a feature-wise attention layer obtained 95.57% accuracy score, which, to best of our knowledge, fixes the state-of-the-art in the challenging COVID-CT dataset. |
format | Online Article Text |
id | pubmed-8280602 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | The Authors. Published by Elsevier B.V. on behalf of King Saud University. |
record_format | MEDLINE/PubMed |
spelling | pubmed-82806022021-07-20 Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images Özdemir, Özgür Sönmez, Elena Battini Journal of King Saud University - Computer and Information Sciences Article The Coronavirus disease is quickly spreading all over the world and the emergency situation is still out of control. Latest achievements of deep learning algorithms suggest the use of deep Convolutional Neural Network to implement a computer-aided diagnostic system for automatic classification of COVID-19 CT images. In this paper, we propose to employ a feature-wise attention layer in order to enhance the discriminative features obtained by convolutional networks. Moreover, the original performance of the network has been improved using the mixup data augmentation technique. This work compares the proposed attention-based model against the stacked attention networks, and traditional versus mixup data augmentation approaches. We deduced that feature-wise attention extension, while outperforming the stacked attention variants, achieves remarkable improvements over the baseline convolutional neural networks. That is, ResNet50 architecture extended with a feature-wise attention layer obtained 95.57% accuracy score, which, to best of our knowledge, fixes the state-of-the-art in the challenging COVID-CT dataset. The Authors. Published by Elsevier B.V. on behalf of King Saud University. 2022-09 2021-07-15 /pmc/articles/PMC8280602/ http://dx.doi.org/10.1016/j.jksuci.2021.07.005 Text en © 2021 The Authors Since January 2020 Elsevier has created a COVID-19 resource centre with free information in English and Mandarin on the novel coronavirus COVID-19. The COVID-19 resource centre is hosted on Elsevier Connect, the company's public news and information website. Elsevier hereby grants permission to make all its COVID-19-related research that is available on the COVID-19 resource centre - including this research content - immediately available in PubMed Central and other publicly funded repositories, such as the WHO COVID database with rights for unrestricted research re-use and analyses in any form or by any means with acknowledgement of the original source. These permissions are granted for free by Elsevier for as long as the COVID-19 resource centre remains active. |
spellingShingle | Article Özdemir, Özgür Sönmez, Elena Battini Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images |
title | Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images |
title_full | Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images |
title_fullStr | Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images |
title_full_unstemmed | Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images |
title_short | Attention mechanism and mixup data augmentation for classification of COVID-19 Computed Tomography images |
title_sort | attention mechanism and mixup data augmentation for classification of covid-19 computed tomography images |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8280602/ http://dx.doi.org/10.1016/j.jksuci.2021.07.005 |
work_keys_str_mv | AT ozdemirozgur attentionmechanismandmixupdataaugmentationforclassificationofcovid19computedtomographyimages AT sonmezelenabattini attentionmechanismandmixupdataaugmentationforclassificationofcovid19computedtomographyimages |