Cargando…

A Conditional GAN for Generating Time Series Data for Stress Detection in Wearable Physiological Sensor Data

Human-centered applications using wearable sensors in combination with machine learning have received a great deal of attention in the last couple of years. At the same time, wearable sensors have also evolved and are now able to accurately measure physiological signals and are, therefore, suitable...

Descripción completa

Detalles Bibliográficos
Autores principales: Ehrhart, Maximilian, Resch, Bernd, Havas, Clemens, Niederseer, David
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9412645/
https://www.ncbi.nlm.nih.gov/pubmed/36015730
http://dx.doi.org/10.3390/s22165969
_version_ 1784775545331908608
author Ehrhart, Maximilian
Resch, Bernd
Havas, Clemens
Niederseer, David
author_facet Ehrhart, Maximilian
Resch, Bernd
Havas, Clemens
Niederseer, David
author_sort Ehrhart, Maximilian
collection PubMed
description Human-centered applications using wearable sensors in combination with machine learning have received a great deal of attention in the last couple of years. At the same time, wearable sensors have also evolved and are now able to accurately measure physiological signals and are, therefore, suitable for detecting body reactions to stress. The field of machine learning, or more precisely, deep learning, has been able to produce outstanding results. However, in order to produce these good results, large amounts of labeled data are needed, which, in the context of physiological data related to stress detection, are a great challenge to collect, as they usually require costly experiments or expert knowledge. This usually results in an imbalanced and small dataset, which makes it difficult to train a deep learning algorithm. In recent studies, this problem is tackled with data augmentation via a Generative Adversarial Network (GAN). Conditional GANs (cGAN) are particularly suitable for this as they provide the opportunity to feed auxiliary information such as a class label into the training process to generate labeled data. However, it has been found that during the training process of GANs, different problems usually occur, such as mode collapse or vanishing gradients. To tackle the problems mentioned above, we propose a Long Short-Term Memory (LSTM) network, combined with a Fully Convolutional Network (FCN) cGAN architecture, with an additional diversity term to generate synthetic physiological data, which are used to augment the training dataset to improve the performance of a binary classifier for stress detection. We evaluated the methodology on our collected physiological measurement dataset, and we were able to show that using the method, the performance of an LSTM and an FCN classifier could be improved. Further, we showed that the generated data could not be distinguished from the real data any longer.
format Online
Article
Text
id pubmed-9412645
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-94126452022-08-27 A Conditional GAN for Generating Time Series Data for Stress Detection in Wearable Physiological Sensor Data Ehrhart, Maximilian Resch, Bernd Havas, Clemens Niederseer, David Sensors (Basel) Article Human-centered applications using wearable sensors in combination with machine learning have received a great deal of attention in the last couple of years. At the same time, wearable sensors have also evolved and are now able to accurately measure physiological signals and are, therefore, suitable for detecting body reactions to stress. The field of machine learning, or more precisely, deep learning, has been able to produce outstanding results. However, in order to produce these good results, large amounts of labeled data are needed, which, in the context of physiological data related to stress detection, are a great challenge to collect, as they usually require costly experiments or expert knowledge. This usually results in an imbalanced and small dataset, which makes it difficult to train a deep learning algorithm. In recent studies, this problem is tackled with data augmentation via a Generative Adversarial Network (GAN). Conditional GANs (cGAN) are particularly suitable for this as they provide the opportunity to feed auxiliary information such as a class label into the training process to generate labeled data. However, it has been found that during the training process of GANs, different problems usually occur, such as mode collapse or vanishing gradients. To tackle the problems mentioned above, we propose a Long Short-Term Memory (LSTM) network, combined with a Fully Convolutional Network (FCN) cGAN architecture, with an additional diversity term to generate synthetic physiological data, which are used to augment the training dataset to improve the performance of a binary classifier for stress detection. We evaluated the methodology on our collected physiological measurement dataset, and we were able to show that using the method, the performance of an LSTM and an FCN classifier could be improved. Further, we showed that the generated data could not be distinguished from the real data any longer. MDPI 2022-08-10 /pmc/articles/PMC9412645/ /pubmed/36015730 http://dx.doi.org/10.3390/s22165969 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Ehrhart, Maximilian
Resch, Bernd
Havas, Clemens
Niederseer, David
A Conditional GAN for Generating Time Series Data for Stress Detection in Wearable Physiological Sensor Data
title A Conditional GAN for Generating Time Series Data for Stress Detection in Wearable Physiological Sensor Data
title_full A Conditional GAN for Generating Time Series Data for Stress Detection in Wearable Physiological Sensor Data
title_fullStr A Conditional GAN for Generating Time Series Data for Stress Detection in Wearable Physiological Sensor Data
title_full_unstemmed A Conditional GAN for Generating Time Series Data for Stress Detection in Wearable Physiological Sensor Data
title_short A Conditional GAN for Generating Time Series Data for Stress Detection in Wearable Physiological Sensor Data
title_sort conditional gan for generating time series data for stress detection in wearable physiological sensor data
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9412645/
https://www.ncbi.nlm.nih.gov/pubmed/36015730
http://dx.doi.org/10.3390/s22165969
work_keys_str_mv AT ehrhartmaximilian aconditionalganforgeneratingtimeseriesdataforstressdetectioninwearablephysiologicalsensordata
AT reschbernd aconditionalganforgeneratingtimeseriesdataforstressdetectioninwearablephysiologicalsensordata
AT havasclemens aconditionalganforgeneratingtimeseriesdataforstressdetectioninwearablephysiologicalsensordata
AT niederseerdavid aconditionalganforgeneratingtimeseriesdataforstressdetectioninwearablephysiologicalsensordata
AT ehrhartmaximilian conditionalganforgeneratingtimeseriesdataforstressdetectioninwearablephysiologicalsensordata
AT reschbernd conditionalganforgeneratingtimeseriesdataforstressdetectioninwearablephysiologicalsensordata
AT havasclemens conditionalganforgeneratingtimeseriesdataforstressdetectioninwearablephysiologicalsensordata
AT niederseerdavid conditionalganforgeneratingtimeseriesdataforstressdetectioninwearablephysiologicalsensordata