Cargando…
A Time Sequence Images Matching Method Based on the Siamese Network
The similar analysis of time sequence images to achieve image matching is a foundation of tasks in dynamic environments, such as multi-object tracking and dynamic gesture recognition. Therefore, we propose a matching method of time sequence images based on the Siamese network. Inspired by comparativ...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8433774/ https://www.ncbi.nlm.nih.gov/pubmed/34502791 http://dx.doi.org/10.3390/s21175900 |
_version_ | 1783751438817558528 |
---|---|
author | Tao, Bo Huang, Licheng Zhao, Haoyi Li, Gongfa Tong, Xiliang |
author_facet | Tao, Bo Huang, Licheng Zhao, Haoyi Li, Gongfa Tong, Xiliang |
author_sort | Tao, Bo |
collection | PubMed |
description | The similar analysis of time sequence images to achieve image matching is a foundation of tasks in dynamic environments, such as multi-object tracking and dynamic gesture recognition. Therefore, we propose a matching method of time sequence images based on the Siamese network. Inspired by comparative learning, two different comparative parts are designed and embedded in the network. The first part makes a comparison between the input image pairs to generate the correlation matrix. The second part compares the correlation matrix, which is the output of the first comparison part, with a template, in order to calculate the similarity. The improved loss function is used to constrain the image matching and similarity calculation. After experimental verification, we found that it not only performs better, but also has some ability to estimate the camera pose. |
format | Online Article Text |
id | pubmed-8433774 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-84337742021-09-12 A Time Sequence Images Matching Method Based on the Siamese Network Tao, Bo Huang, Licheng Zhao, Haoyi Li, Gongfa Tong, Xiliang Sensors (Basel) Article The similar analysis of time sequence images to achieve image matching is a foundation of tasks in dynamic environments, such as multi-object tracking and dynamic gesture recognition. Therefore, we propose a matching method of time sequence images based on the Siamese network. Inspired by comparative learning, two different comparative parts are designed and embedded in the network. The first part makes a comparison between the input image pairs to generate the correlation matrix. The second part compares the correlation matrix, which is the output of the first comparison part, with a template, in order to calculate the similarity. The improved loss function is used to constrain the image matching and similarity calculation. After experimental verification, we found that it not only performs better, but also has some ability to estimate the camera pose. MDPI 2021-09-02 /pmc/articles/PMC8433774/ /pubmed/34502791 http://dx.doi.org/10.3390/s21175900 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Tao, Bo Huang, Licheng Zhao, Haoyi Li, Gongfa Tong, Xiliang A Time Sequence Images Matching Method Based on the Siamese Network |
title | A Time Sequence Images Matching Method Based on the Siamese Network |
title_full | A Time Sequence Images Matching Method Based on the Siamese Network |
title_fullStr | A Time Sequence Images Matching Method Based on the Siamese Network |
title_full_unstemmed | A Time Sequence Images Matching Method Based on the Siamese Network |
title_short | A Time Sequence Images Matching Method Based on the Siamese Network |
title_sort | time sequence images matching method based on the siamese network |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8433774/ https://www.ncbi.nlm.nih.gov/pubmed/34502791 http://dx.doi.org/10.3390/s21175900 |
work_keys_str_mv | AT taobo atimesequenceimagesmatchingmethodbasedonthesiamesenetwork AT huanglicheng atimesequenceimagesmatchingmethodbasedonthesiamesenetwork AT zhaohaoyi atimesequenceimagesmatchingmethodbasedonthesiamesenetwork AT ligongfa atimesequenceimagesmatchingmethodbasedonthesiamesenetwork AT tongxiliang atimesequenceimagesmatchingmethodbasedonthesiamesenetwork AT taobo timesequenceimagesmatchingmethodbasedonthesiamesenetwork AT huanglicheng timesequenceimagesmatchingmethodbasedonthesiamesenetwork AT zhaohaoyi timesequenceimagesmatchingmethodbasedonthesiamesenetwork AT ligongfa timesequenceimagesmatchingmethodbasedonthesiamesenetwork AT tongxiliang timesequenceimagesmatchingmethodbasedonthesiamesenetwork |