Cargando…

Use of Domain Labels during Pre-Training for Domain-Independent WiFi-CSI Gesture Recognition

To minimize dependency on the availability of data labels, some WiFi-CSI based-gesture recognition solutions utilize an unsupervised representation learning phase prior to fine-tuning downstream task classifiers. In this case, however, the overall performance of the solution is negatively affected b...

Descripción completa

Detalles Bibliográficos
Autores principales: van Berlo, Bram, Verhoeven, Richard, Meratnia, Nirvana
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10675214/
https://www.ncbi.nlm.nih.gov/pubmed/38005619
http://dx.doi.org/10.3390/s23229233
_version_ 1785149793979334656
author van Berlo, Bram
Verhoeven, Richard
Meratnia, Nirvana
author_facet van Berlo, Bram
Verhoeven, Richard
Meratnia, Nirvana
author_sort van Berlo, Bram
collection PubMed
description To minimize dependency on the availability of data labels, some WiFi-CSI based-gesture recognition solutions utilize an unsupervised representation learning phase prior to fine-tuning downstream task classifiers. In this case, however, the overall performance of the solution is negatively affected by domain factors present in the WiFi-CSI data used by the pre-training models. To reduce this negative effect, we propose an integration of the adversarial domain classifier in the pre-training phase. We consider this as an effective step towards automatic domain discovery during pre-training. We also experiment with multi-class and label versions of domain classification to improve situations, in which integrating a multi-class and single label-based domain classifier during pre-training fails to reduce the negative impact domain factors have on overall solution performance. For our extensive random and leave-out domain factor cross-validation experiments, we utilise (i) an end-to-end and unsupervised representation learning baseline, (ii) integration of both single- and multi-label domain classification, and (iii) so-called domain-aware versions of the aformentioned unsupervised representation learning baseline in (i) with two different datasets, i.e., Widar3 and SignFi. We also consider an input sample type that generalizes, in terms of overall solution performance, to both aforementioned datasets. Experiment results with the Widar3 dataset indicate that multi-label domain classification reduces domain shift in position (1.2% mean metric improvement and 0.5% variance increase) and orientation (0.4% mean metric improvement and 1.0% variance decrease) in domain factor leave-out cross-validation experiments. The results also indicate that domain shift reduction, when considering single- or multi-label domain classification during pre-training, is negatively impacted when a large proportion of negative view combinations contain views that originate from different domains within a substantial amount of mini-batches considered during pre-training. This is caused by the view contrastive loss repelling the aforementioned negative view combinations, eventually causing more domain shift in the intermediate feature space of the overall solution.
format Online
Article
Text
id pubmed-10675214
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-106752142023-11-16 Use of Domain Labels during Pre-Training for Domain-Independent WiFi-CSI Gesture Recognition van Berlo, Bram Verhoeven, Richard Meratnia, Nirvana Sensors (Basel) Article To minimize dependency on the availability of data labels, some WiFi-CSI based-gesture recognition solutions utilize an unsupervised representation learning phase prior to fine-tuning downstream task classifiers. In this case, however, the overall performance of the solution is negatively affected by domain factors present in the WiFi-CSI data used by the pre-training models. To reduce this negative effect, we propose an integration of the adversarial domain classifier in the pre-training phase. We consider this as an effective step towards automatic domain discovery during pre-training. We also experiment with multi-class and label versions of domain classification to improve situations, in which integrating a multi-class and single label-based domain classifier during pre-training fails to reduce the negative impact domain factors have on overall solution performance. For our extensive random and leave-out domain factor cross-validation experiments, we utilise (i) an end-to-end and unsupervised representation learning baseline, (ii) integration of both single- and multi-label domain classification, and (iii) so-called domain-aware versions of the aformentioned unsupervised representation learning baseline in (i) with two different datasets, i.e., Widar3 and SignFi. We also consider an input sample type that generalizes, in terms of overall solution performance, to both aforementioned datasets. Experiment results with the Widar3 dataset indicate that multi-label domain classification reduces domain shift in position (1.2% mean metric improvement and 0.5% variance increase) and orientation (0.4% mean metric improvement and 1.0% variance decrease) in domain factor leave-out cross-validation experiments. The results also indicate that domain shift reduction, when considering single- or multi-label domain classification during pre-training, is negatively impacted when a large proportion of negative view combinations contain views that originate from different domains within a substantial amount of mini-batches considered during pre-training. This is caused by the view contrastive loss repelling the aforementioned negative view combinations, eventually causing more domain shift in the intermediate feature space of the overall solution. MDPI 2023-11-16 /pmc/articles/PMC10675214/ /pubmed/38005619 http://dx.doi.org/10.3390/s23229233 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
van Berlo, Bram
Verhoeven, Richard
Meratnia, Nirvana
Use of Domain Labels during Pre-Training for Domain-Independent WiFi-CSI Gesture Recognition
title Use of Domain Labels during Pre-Training for Domain-Independent WiFi-CSI Gesture Recognition
title_full Use of Domain Labels during Pre-Training for Domain-Independent WiFi-CSI Gesture Recognition
title_fullStr Use of Domain Labels during Pre-Training for Domain-Independent WiFi-CSI Gesture Recognition
title_full_unstemmed Use of Domain Labels during Pre-Training for Domain-Independent WiFi-CSI Gesture Recognition
title_short Use of Domain Labels during Pre-Training for Domain-Independent WiFi-CSI Gesture Recognition
title_sort use of domain labels during pre-training for domain-independent wifi-csi gesture recognition
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10675214/
https://www.ncbi.nlm.nih.gov/pubmed/38005619
http://dx.doi.org/10.3390/s23229233
work_keys_str_mv AT vanberlobram useofdomainlabelsduringpretrainingfordomainindependentwificsigesturerecognition
AT verhoevenrichard useofdomainlabelsduringpretrainingfordomainindependentwificsigesturerecognition
AT meratnianirvana useofdomainlabelsduringpretrainingfordomainindependentwificsigesturerecognition