Cargando…

A Time Sequence Images Matching Method Based on the Siamese Network

The similar analysis of time sequence images to achieve image matching is a foundation of tasks in dynamic environments, such as multi-object tracking and dynamic gesture recognition. Therefore, we propose a matching method of time sequence images based on the Siamese network. Inspired by comparativ...

Descripción completa

Detalles Bibliográficos
Autores principales: Tao, Bo, Huang, Licheng, Zhao, Haoyi, Li, Gongfa, Tong, Xiliang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8433774/
https://www.ncbi.nlm.nih.gov/pubmed/34502791
http://dx.doi.org/10.3390/s21175900
_version_ 1783751438817558528
author Tao, Bo
Huang, Licheng
Zhao, Haoyi
Li, Gongfa
Tong, Xiliang
author_facet Tao, Bo
Huang, Licheng
Zhao, Haoyi
Li, Gongfa
Tong, Xiliang
author_sort Tao, Bo
collection PubMed
description The similar analysis of time sequence images to achieve image matching is a foundation of tasks in dynamic environments, such as multi-object tracking and dynamic gesture recognition. Therefore, we propose a matching method of time sequence images based on the Siamese network. Inspired by comparative learning, two different comparative parts are designed and embedded in the network. The first part makes a comparison between the input image pairs to generate the correlation matrix. The second part compares the correlation matrix, which is the output of the first comparison part, with a template, in order to calculate the similarity. The improved loss function is used to constrain the image matching and similarity calculation. After experimental verification, we found that it not only performs better, but also has some ability to estimate the camera pose.
format Online
Article
Text
id pubmed-8433774
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-84337742021-09-12 A Time Sequence Images Matching Method Based on the Siamese Network Tao, Bo Huang, Licheng Zhao, Haoyi Li, Gongfa Tong, Xiliang Sensors (Basel) Article The similar analysis of time sequence images to achieve image matching is a foundation of tasks in dynamic environments, such as multi-object tracking and dynamic gesture recognition. Therefore, we propose a matching method of time sequence images based on the Siamese network. Inspired by comparative learning, two different comparative parts are designed and embedded in the network. The first part makes a comparison between the input image pairs to generate the correlation matrix. The second part compares the correlation matrix, which is the output of the first comparison part, with a template, in order to calculate the similarity. The improved loss function is used to constrain the image matching and similarity calculation. After experimental verification, we found that it not only performs better, but also has some ability to estimate the camera pose. MDPI 2021-09-02 /pmc/articles/PMC8433774/ /pubmed/34502791 http://dx.doi.org/10.3390/s21175900 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Tao, Bo
Huang, Licheng
Zhao, Haoyi
Li, Gongfa
Tong, Xiliang
A Time Sequence Images Matching Method Based on the Siamese Network
title A Time Sequence Images Matching Method Based on the Siamese Network
title_full A Time Sequence Images Matching Method Based on the Siamese Network
title_fullStr A Time Sequence Images Matching Method Based on the Siamese Network
title_full_unstemmed A Time Sequence Images Matching Method Based on the Siamese Network
title_short A Time Sequence Images Matching Method Based on the Siamese Network
title_sort time sequence images matching method based on the siamese network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8433774/
https://www.ncbi.nlm.nih.gov/pubmed/34502791
http://dx.doi.org/10.3390/s21175900
work_keys_str_mv AT taobo atimesequenceimagesmatchingmethodbasedonthesiamesenetwork
AT huanglicheng atimesequenceimagesmatchingmethodbasedonthesiamesenetwork
AT zhaohaoyi atimesequenceimagesmatchingmethodbasedonthesiamesenetwork
AT ligongfa atimesequenceimagesmatchingmethodbasedonthesiamesenetwork
AT tongxiliang atimesequenceimagesmatchingmethodbasedonthesiamesenetwork
AT taobo timesequenceimagesmatchingmethodbasedonthesiamesenetwork
AT huanglicheng timesequenceimagesmatchingmethodbasedonthesiamesenetwork
AT zhaohaoyi timesequenceimagesmatchingmethodbasedonthesiamesenetwork
AT ligongfa timesequenceimagesmatchingmethodbasedonthesiamesenetwork
AT tongxiliang timesequenceimagesmatchingmethodbasedonthesiamesenetwork