Cargando…

Model-Agnostic Structural Transfer Learning for Cross-Domain Autonomous Activity Recognition

Activity recognition using data collected with smart devices such as mobile and wearable sensors has become a critical component of many emerging applications ranging from behavioral medicine to gaming. However, an unprecedented increase in the diversity of smart devices in the internet-of-things er...

Descripción completa

Detalles Bibliográficos
Autores principales: Alinia, Parastoo, Arefeen, Asiful, Ashari, Zhila Esna, Mirzadeh, Seyed Iman, Ghasemzadeh, Hassan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10385762/
https://www.ncbi.nlm.nih.gov/pubmed/37514630
http://dx.doi.org/10.3390/s23146337
_version_ 1785081490020761600
author Alinia, Parastoo
Arefeen, Asiful
Ashari, Zhila Esna
Mirzadeh, Seyed Iman
Ghasemzadeh, Hassan
author_facet Alinia, Parastoo
Arefeen, Asiful
Ashari, Zhila Esna
Mirzadeh, Seyed Iman
Ghasemzadeh, Hassan
author_sort Alinia, Parastoo
collection PubMed
description Activity recognition using data collected with smart devices such as mobile and wearable sensors has become a critical component of many emerging applications ranging from behavioral medicine to gaming. However, an unprecedented increase in the diversity of smart devices in the internet-of-things era has limited the adoption of activity recognition models for use across different devices. This lack of cross-domain adaptation is particularly notable across sensors of different modalities where the mapping of the sensor data in the traditional feature level is highly challenging. To address this challenge, we propose ActiLabel, a combinatorial framework that learns structural similarities among the events that occur in a target domain and those of a source domain and identifies an optimal mapping between the two domains at their structural level. The structural similarities are captured through a graph model, referred to as the dependency graph, which abstracts details of activity patterns in low-level signal and feature space. The activity labels are then autonomously learned in the target domain by finding an optimal tiered mapping between the dependency graphs. We carry out an extensive set of experiments on three large datasets collected with wearable sensors involving human subjects. The results demonstrate the superiority of ActiLabel over state-of-the-art transfer learning and deep learning methods. In particular, ActiLabel outperforms such algorithms by average F1-scores of [Formula: see text] , [Formula: see text] , and [Formula: see text] for cross-modality, cross-location, and cross-subject activity recognition, respectively.
format Online
Article
Text
id pubmed-10385762
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-103857622023-07-30 Model-Agnostic Structural Transfer Learning for Cross-Domain Autonomous Activity Recognition Alinia, Parastoo Arefeen, Asiful Ashari, Zhila Esna Mirzadeh, Seyed Iman Ghasemzadeh, Hassan Sensors (Basel) Article Activity recognition using data collected with smart devices such as mobile and wearable sensors has become a critical component of many emerging applications ranging from behavioral medicine to gaming. However, an unprecedented increase in the diversity of smart devices in the internet-of-things era has limited the adoption of activity recognition models for use across different devices. This lack of cross-domain adaptation is particularly notable across sensors of different modalities where the mapping of the sensor data in the traditional feature level is highly challenging. To address this challenge, we propose ActiLabel, a combinatorial framework that learns structural similarities among the events that occur in a target domain and those of a source domain and identifies an optimal mapping between the two domains at their structural level. The structural similarities are captured through a graph model, referred to as the dependency graph, which abstracts details of activity patterns in low-level signal and feature space. The activity labels are then autonomously learned in the target domain by finding an optimal tiered mapping between the dependency graphs. We carry out an extensive set of experiments on three large datasets collected with wearable sensors involving human subjects. The results demonstrate the superiority of ActiLabel over state-of-the-art transfer learning and deep learning methods. In particular, ActiLabel outperforms such algorithms by average F1-scores of [Formula: see text] , [Formula: see text] , and [Formula: see text] for cross-modality, cross-location, and cross-subject activity recognition, respectively. MDPI 2023-07-12 /pmc/articles/PMC10385762/ /pubmed/37514630 http://dx.doi.org/10.3390/s23146337 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Alinia, Parastoo
Arefeen, Asiful
Ashari, Zhila Esna
Mirzadeh, Seyed Iman
Ghasemzadeh, Hassan
Model-Agnostic Structural Transfer Learning for Cross-Domain Autonomous Activity Recognition
title Model-Agnostic Structural Transfer Learning for Cross-Domain Autonomous Activity Recognition
title_full Model-Agnostic Structural Transfer Learning for Cross-Domain Autonomous Activity Recognition
title_fullStr Model-Agnostic Structural Transfer Learning for Cross-Domain Autonomous Activity Recognition
title_full_unstemmed Model-Agnostic Structural Transfer Learning for Cross-Domain Autonomous Activity Recognition
title_short Model-Agnostic Structural Transfer Learning for Cross-Domain Autonomous Activity Recognition
title_sort model-agnostic structural transfer learning for cross-domain autonomous activity recognition
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10385762/
https://www.ncbi.nlm.nih.gov/pubmed/37514630
http://dx.doi.org/10.3390/s23146337
work_keys_str_mv AT aliniaparastoo modelagnosticstructuraltransferlearningforcrossdomainautonomousactivityrecognition
AT arefeenasiful modelagnosticstructuraltransferlearningforcrossdomainautonomousactivityrecognition
AT asharizhilaesna modelagnosticstructuraltransferlearningforcrossdomainautonomousactivityrecognition
AT mirzadehseyediman modelagnosticstructuraltransferlearningforcrossdomainautonomousactivityrecognition
AT ghasemzadehhassan modelagnosticstructuraltransferlearningforcrossdomainautonomousactivityrecognition