Cargando…

Multitask Siamese Network for Remote Photoplethysmography and Respiration Estimation

Heart and respiration rates represent important vital signs for the assessment of a person’s health condition. To estimate these vital signs accurately, we propose a multitask Siamese network model (MTS) that combines the advantages of the Siamese network and the multitask learning architecture. The...

Descripción completa

Detalles Bibliográficos
Autores principales: Lee, Heejin, Lee, Junghwan, Kwon, Yujin, Kwon, Jiyoon, Park, Sungmin, Sohn, Ryanghee, Park, Cheolsoo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9321619/
https://www.ncbi.nlm.nih.gov/pubmed/35890781
http://dx.doi.org/10.3390/s22145101
_version_ 1784756092360720384
author Lee, Heejin
Lee, Junghwan
Kwon, Yujin
Kwon, Jiyoon
Park, Sungmin
Sohn, Ryanghee
Park, Cheolsoo
author_facet Lee, Heejin
Lee, Junghwan
Kwon, Yujin
Kwon, Jiyoon
Park, Sungmin
Sohn, Ryanghee
Park, Cheolsoo
author_sort Lee, Heejin
collection PubMed
description Heart and respiration rates represent important vital signs for the assessment of a person’s health condition. To estimate these vital signs accurately, we propose a multitask Siamese network model (MTS) that combines the advantages of the Siamese network and the multitask learning architecture. The MTS model was trained by the images of the cheek including nose and mouth and forehead areas while sharing the same parameters between the Siamese networks, in order to extract the features about the heart and respiratory information. The proposed model was constructed with a small number of parameters and was able to yield a high vital-sign-prediction accuracy, comparable to that obtained from the single-task learning model; furthermore, the proposed model outperformed the conventional multitask learning model. As a result, we can simultaneously predict the heart and respiratory signals with the MTS model, while the number of parameters was reduced by 16 times with the mean average errors of heart and respiration rates being 2.84 and 4.21. Owing to its light weight, it would be advantageous to implement the vital-sign-monitoring model in an edge device such as a mobile phone or small-sized portable devices.
format Online
Article
Text
id pubmed-9321619
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-93216192022-07-27 Multitask Siamese Network for Remote Photoplethysmography and Respiration Estimation Lee, Heejin Lee, Junghwan Kwon, Yujin Kwon, Jiyoon Park, Sungmin Sohn, Ryanghee Park, Cheolsoo Sensors (Basel) Communication Heart and respiration rates represent important vital signs for the assessment of a person’s health condition. To estimate these vital signs accurately, we propose a multitask Siamese network model (MTS) that combines the advantages of the Siamese network and the multitask learning architecture. The MTS model was trained by the images of the cheek including nose and mouth and forehead areas while sharing the same parameters between the Siamese networks, in order to extract the features about the heart and respiratory information. The proposed model was constructed with a small number of parameters and was able to yield a high vital-sign-prediction accuracy, comparable to that obtained from the single-task learning model; furthermore, the proposed model outperformed the conventional multitask learning model. As a result, we can simultaneously predict the heart and respiratory signals with the MTS model, while the number of parameters was reduced by 16 times with the mean average errors of heart and respiration rates being 2.84 and 4.21. Owing to its light weight, it would be advantageous to implement the vital-sign-monitoring model in an edge device such as a mobile phone or small-sized portable devices. MDPI 2022-07-07 /pmc/articles/PMC9321619/ /pubmed/35890781 http://dx.doi.org/10.3390/s22145101 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Communication
Lee, Heejin
Lee, Junghwan
Kwon, Yujin
Kwon, Jiyoon
Park, Sungmin
Sohn, Ryanghee
Park, Cheolsoo
Multitask Siamese Network for Remote Photoplethysmography and Respiration Estimation
title Multitask Siamese Network for Remote Photoplethysmography and Respiration Estimation
title_full Multitask Siamese Network for Remote Photoplethysmography and Respiration Estimation
title_fullStr Multitask Siamese Network for Remote Photoplethysmography and Respiration Estimation
title_full_unstemmed Multitask Siamese Network for Remote Photoplethysmography and Respiration Estimation
title_short Multitask Siamese Network for Remote Photoplethysmography and Respiration Estimation
title_sort multitask siamese network for remote photoplethysmography and respiration estimation
topic Communication
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9321619/
https://www.ncbi.nlm.nih.gov/pubmed/35890781
http://dx.doi.org/10.3390/s22145101
work_keys_str_mv AT leeheejin multitasksiamesenetworkforremotephotoplethysmographyandrespirationestimation
AT leejunghwan multitasksiamesenetworkforremotephotoplethysmographyandrespirationestimation
AT kwonyujin multitasksiamesenetworkforremotephotoplethysmographyandrespirationestimation
AT kwonjiyoon multitasksiamesenetworkforremotephotoplethysmographyandrespirationestimation
AT parksungmin multitasksiamesenetworkforremotephotoplethysmographyandrespirationestimation
AT sohnryanghee multitasksiamesenetworkforremotephotoplethysmographyandrespirationestimation
AT parkcheolsoo multitasksiamesenetworkforremotephotoplethysmographyandrespirationestimation