Cargando…
Multi-Feature Transformer-Based Learning for Continuous Human Motion Recognition with High Similarity Using mmWave FMCW Radar
Doppler-radar-based continuous human motion recognition recently has attracted extensive attention, which is a favorable choice for privacy and personal security. Existing results of continuous human motion recognition (CHMR) using mmWave FMCW Radar are not considered the continuous human motion wit...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9659133/ https://www.ncbi.nlm.nih.gov/pubmed/36366107 http://dx.doi.org/10.3390/s22218409 |
_version_ | 1784830126150647808 |
---|---|
author | Chen, Yuh-Shyan Cheng, Kuang-Hung Xu, You-An Juang, Tong-Ying |
author_facet | Chen, Yuh-Shyan Cheng, Kuang-Hung Xu, You-An Juang, Tong-Ying |
author_sort | Chen, Yuh-Shyan |
collection | PubMed |
description | Doppler-radar-based continuous human motion recognition recently has attracted extensive attention, which is a favorable choice for privacy and personal security. Existing results of continuous human motion recognition (CHMR) using mmWave FMCW Radar are not considered the continuous human motion with the high similarity problem. In this paper, we proposed a new CHMR algorithm with the consideration of the high similarity (HS) problem, called as CHMR-HS, by using the modified Transformer-based learning model. As far as we know, this is the first result in the literature to investigate the continuous HMR with the high similarity. To obtain the clear FMCW radar images, the background and target signals of the detected human are separated through the background denoising and the target extraction algorithms. To investigate the effects of the spectral-temporal multi-features with different dimensions, Doppler, range, and angle signatures are extracted as the 2D features and range-Doppler-time and range-angle-time signatures are extracted as the 3D features. The 2D/3D features are trained into the adjusted Transformer-encoder model to distinguish the difference of the high-similarity human motions. The conventional Transformer-decoder model is also re-designed to be Transformer-sequential-decoder model such that Transformer-sequential-decoder model can successfully recognize the continuous human motions with the high similarity. The experimental results show that the accuracy of our proposed CHMR-HS scheme are 95.2% and 94.5% if using 3D and 2D features, the simulation results also illustrates that our CHMR-HS scheme has advantages over existing CHMR schemes. |
format | Online Article Text |
id | pubmed-9659133 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-96591332022-11-15 Multi-Feature Transformer-Based Learning for Continuous Human Motion Recognition with High Similarity Using mmWave FMCW Radar Chen, Yuh-Shyan Cheng, Kuang-Hung Xu, You-An Juang, Tong-Ying Sensors (Basel) Article Doppler-radar-based continuous human motion recognition recently has attracted extensive attention, which is a favorable choice for privacy and personal security. Existing results of continuous human motion recognition (CHMR) using mmWave FMCW Radar are not considered the continuous human motion with the high similarity problem. In this paper, we proposed a new CHMR algorithm with the consideration of the high similarity (HS) problem, called as CHMR-HS, by using the modified Transformer-based learning model. As far as we know, this is the first result in the literature to investigate the continuous HMR with the high similarity. To obtain the clear FMCW radar images, the background and target signals of the detected human are separated through the background denoising and the target extraction algorithms. To investigate the effects of the spectral-temporal multi-features with different dimensions, Doppler, range, and angle signatures are extracted as the 2D features and range-Doppler-time and range-angle-time signatures are extracted as the 3D features. The 2D/3D features are trained into the adjusted Transformer-encoder model to distinguish the difference of the high-similarity human motions. The conventional Transformer-decoder model is also re-designed to be Transformer-sequential-decoder model such that Transformer-sequential-decoder model can successfully recognize the continuous human motions with the high similarity. The experimental results show that the accuracy of our proposed CHMR-HS scheme are 95.2% and 94.5% if using 3D and 2D features, the simulation results also illustrates that our CHMR-HS scheme has advantages over existing CHMR schemes. MDPI 2022-11-01 /pmc/articles/PMC9659133/ /pubmed/36366107 http://dx.doi.org/10.3390/s22218409 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Chen, Yuh-Shyan Cheng, Kuang-Hung Xu, You-An Juang, Tong-Ying Multi-Feature Transformer-Based Learning for Continuous Human Motion Recognition with High Similarity Using mmWave FMCW Radar |
title | Multi-Feature Transformer-Based Learning for Continuous Human Motion Recognition with High Similarity Using mmWave FMCW Radar |
title_full | Multi-Feature Transformer-Based Learning for Continuous Human Motion Recognition with High Similarity Using mmWave FMCW Radar |
title_fullStr | Multi-Feature Transformer-Based Learning for Continuous Human Motion Recognition with High Similarity Using mmWave FMCW Radar |
title_full_unstemmed | Multi-Feature Transformer-Based Learning for Continuous Human Motion Recognition with High Similarity Using mmWave FMCW Radar |
title_short | Multi-Feature Transformer-Based Learning for Continuous Human Motion Recognition with High Similarity Using mmWave FMCW Radar |
title_sort | multi-feature transformer-based learning for continuous human motion recognition with high similarity using mmwave fmcw radar |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9659133/ https://www.ncbi.nlm.nih.gov/pubmed/36366107 http://dx.doi.org/10.3390/s22218409 |
work_keys_str_mv | AT chenyuhshyan multifeaturetransformerbasedlearningforcontinuoushumanmotionrecognitionwithhighsimilarityusingmmwavefmcwradar AT chengkuanghung multifeaturetransformerbasedlearningforcontinuoushumanmotionrecognitionwithhighsimilarityusingmmwavefmcwradar AT xuyouan multifeaturetransformerbasedlearningforcontinuoushumanmotionrecognitionwithhighsimilarityusingmmwavefmcwradar AT juangtongying multifeaturetransformerbasedlearningforcontinuoushumanmotionrecognitionwithhighsimilarityusingmmwavefmcwradar |