Cargando…

Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention

Because thermal infrared sport targets have rich and complex semantic information, there is a high coupling between different types of features. In view of these limitations, we propose a Non-Glodal decoupled Attention, namely,local U-shaped attention decoupling network (LUANets), which aims to deco...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhao, Jia, Mao, Bingfei, Meng, Hengran, Wu, Liping, Li, Jingpeng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9258899/
https://www.ncbi.nlm.nih.gov/pubmed/35793275
http://dx.doi.org/10.1371/journal.pone.0270376
_version_ 1784741655584178176
author Zhao, Jia
Mao, Bingfei
Meng, Hengran
Wu, Liping
Li, Jingpeng
author_facet Zhao, Jia
Mao, Bingfei
Meng, Hengran
Wu, Liping
Li, Jingpeng
author_sort Zhao, Jia
collection PubMed
description Because thermal infrared sport targets have rich and complex semantic information, there is a high coupling between different types of features. In view of these limitations, we propose a Non-Glodal decoupled Attention, namely,local U-shaped attention decoupling network (LUANets), which aims to decompose the coupling relationship of different sport target features in thermal infrared images and establish effective spatial dependence between them. This method takes the captured multi-scale initial features according to different levels and inputs them into the local decoupling module with U-shaped attention structure to realize the decomposition of semantic details. At the same time, considering the correlation between different targets, in the process of feature decomposition, using prior knowledge as guiding information many times to establish effective spatial dependence. Secondly, we design a two-way cross-aggregation FPN module to cross-aggregate information flows in the front and back directions to achieve feature interaction while further reducing the coupling between different types of features. The evaluation results on data such as TIIs,SportFCs and FLIR show that the LUANets method we proposed has achieved the best detection performance, with mAP of 68.72%,59.51% and 65.29%, respectively.
format Online
Article
Text
id pubmed-9258899
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-92588992022-07-07 Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention Zhao, Jia Mao, Bingfei Meng, Hengran Wu, Liping Li, Jingpeng PLoS One Research Article Because thermal infrared sport targets have rich and complex semantic information, there is a high coupling between different types of features. In view of these limitations, we propose a Non-Glodal decoupled Attention, namely,local U-shaped attention decoupling network (LUANets), which aims to decompose the coupling relationship of different sport target features in thermal infrared images and establish effective spatial dependence between them. This method takes the captured multi-scale initial features according to different levels and inputs them into the local decoupling module with U-shaped attention structure to realize the decomposition of semantic details. At the same time, considering the correlation between different targets, in the process of feature decomposition, using prior knowledge as guiding information many times to establish effective spatial dependence. Secondly, we design a two-way cross-aggregation FPN module to cross-aggregate information flows in the front and back directions to achieve feature interaction while further reducing the coupling between different types of features. The evaluation results on data such as TIIs,SportFCs and FLIR show that the LUANets method we proposed has achieved the best detection performance, with mAP of 68.72%,59.51% and 65.29%, respectively. Public Library of Science 2022-07-06 /pmc/articles/PMC9258899/ /pubmed/35793275 http://dx.doi.org/10.1371/journal.pone.0270376 Text en © 2022 Zhao et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Zhao, Jia
Mao, Bingfei
Meng, Hengran
Wu, Liping
Li, Jingpeng
Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention
title Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention
title_full Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention
title_fullStr Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention
title_full_unstemmed Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention
title_short Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention
title_sort non-gdanets: sports small object detection of thermal images with non-glodal decoupled attention
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9258899/
https://www.ncbi.nlm.nih.gov/pubmed/35793275
http://dx.doi.org/10.1371/journal.pone.0270376
work_keys_str_mv AT zhaojia nongdanetssportssmallobjectdetectionofthermalimageswithnonglodaldecoupledattention
AT maobingfei nongdanetssportssmallobjectdetectionofthermalimageswithnonglodaldecoupledattention
AT menghengran nongdanetssportssmallobjectdetectionofthermalimageswithnonglodaldecoupledattention
AT wuliping nongdanetssportssmallobjectdetectionofthermalimageswithnonglodaldecoupledattention
AT lijingpeng nongdanetssportssmallobjectdetectionofthermalimageswithnonglodaldecoupledattention