Cargando…
Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention
Because thermal infrared sport targets have rich and complex semantic information, there is a high coupling between different types of features. In view of these limitations, we propose a Non-Glodal decoupled Attention, namely,local U-shaped attention decoupling network (LUANets), which aims to deco...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9258899/ https://www.ncbi.nlm.nih.gov/pubmed/35793275 http://dx.doi.org/10.1371/journal.pone.0270376 |
_version_ | 1784741655584178176 |
---|---|
author | Zhao, Jia Mao, Bingfei Meng, Hengran Wu, Liping Li, Jingpeng |
author_facet | Zhao, Jia Mao, Bingfei Meng, Hengran Wu, Liping Li, Jingpeng |
author_sort | Zhao, Jia |
collection | PubMed |
description | Because thermal infrared sport targets have rich and complex semantic information, there is a high coupling between different types of features. In view of these limitations, we propose a Non-Glodal decoupled Attention, namely,local U-shaped attention decoupling network (LUANets), which aims to decompose the coupling relationship of different sport target features in thermal infrared images and establish effective spatial dependence between them. This method takes the captured multi-scale initial features according to different levels and inputs them into the local decoupling module with U-shaped attention structure to realize the decomposition of semantic details. At the same time, considering the correlation between different targets, in the process of feature decomposition, using prior knowledge as guiding information many times to establish effective spatial dependence. Secondly, we design a two-way cross-aggregation FPN module to cross-aggregate information flows in the front and back directions to achieve feature interaction while further reducing the coupling between different types of features. The evaluation results on data such as TIIs,SportFCs and FLIR show that the LUANets method we proposed has achieved the best detection performance, with mAP of 68.72%,59.51% and 65.29%, respectively. |
format | Online Article Text |
id | pubmed-9258899 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-92588992022-07-07 Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention Zhao, Jia Mao, Bingfei Meng, Hengran Wu, Liping Li, Jingpeng PLoS One Research Article Because thermal infrared sport targets have rich and complex semantic information, there is a high coupling between different types of features. In view of these limitations, we propose a Non-Glodal decoupled Attention, namely,local U-shaped attention decoupling network (LUANets), which aims to decompose the coupling relationship of different sport target features in thermal infrared images and establish effective spatial dependence between them. This method takes the captured multi-scale initial features according to different levels and inputs them into the local decoupling module with U-shaped attention structure to realize the decomposition of semantic details. At the same time, considering the correlation between different targets, in the process of feature decomposition, using prior knowledge as guiding information many times to establish effective spatial dependence. Secondly, we design a two-way cross-aggregation FPN module to cross-aggregate information flows in the front and back directions to achieve feature interaction while further reducing the coupling between different types of features. The evaluation results on data such as TIIs,SportFCs and FLIR show that the LUANets method we proposed has achieved the best detection performance, with mAP of 68.72%,59.51% and 65.29%, respectively. Public Library of Science 2022-07-06 /pmc/articles/PMC9258899/ /pubmed/35793275 http://dx.doi.org/10.1371/journal.pone.0270376 Text en © 2022 Zhao et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Zhao, Jia Mao, Bingfei Meng, Hengran Wu, Liping Li, Jingpeng Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention |
title | Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention |
title_full | Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention |
title_fullStr | Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention |
title_full_unstemmed | Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention |
title_short | Non-GDANets: Sports small object detection of thermal images with Non-Glodal decoupled Attention |
title_sort | non-gdanets: sports small object detection of thermal images with non-glodal decoupled attention |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9258899/ https://www.ncbi.nlm.nih.gov/pubmed/35793275 http://dx.doi.org/10.1371/journal.pone.0270376 |
work_keys_str_mv | AT zhaojia nongdanetssportssmallobjectdetectionofthermalimageswithnonglodaldecoupledattention AT maobingfei nongdanetssportssmallobjectdetectionofthermalimageswithnonglodaldecoupledattention AT menghengran nongdanetssportssmallobjectdetectionofthermalimageswithnonglodaldecoupledattention AT wuliping nongdanetssportssmallobjectdetectionofthermalimageswithnonglodaldecoupledattention AT lijingpeng nongdanetssportssmallobjectdetectionofthermalimageswithnonglodaldecoupledattention |