Cargando…

Depression and Severity Detection Based on Body Kinematic Features: Using Kinect Recorded Skeleton Data of Simple Action

Relative limb movement is an important feature in assessing depression. In this study, we looked into whether a skeleton-mimetic task using natural stimuli may help people recognize depression. We innovatively used Kinect V2 to collect participant data. Sequential skeletal data was directly extracte...

Descripción completa

Detalles Bibliográficos
Autores principales: Yu, Yanhong, Li, Wentao, Zhao, Yue, Ye, Jiayu, Zheng, Yunshao, Liu, Xinxin, Wang, Qingxiang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9279697/
https://www.ncbi.nlm.nih.gov/pubmed/35847201
http://dx.doi.org/10.3389/fneur.2022.905917
_version_ 1784746456924553216
author Yu, Yanhong
Li, Wentao
Zhao, Yue
Ye, Jiayu
Zheng, Yunshao
Liu, Xinxin
Wang, Qingxiang
author_facet Yu, Yanhong
Li, Wentao
Zhao, Yue
Ye, Jiayu
Zheng, Yunshao
Liu, Xinxin
Wang, Qingxiang
author_sort Yu, Yanhong
collection PubMed
description Relative limb movement is an important feature in assessing depression. In this study, we looked into whether a skeleton-mimetic task using natural stimuli may help people recognize depression. We innovatively used Kinect V2 to collect participant data. Sequential skeletal data was directly extracted from the original Kinect-3D and tetrad coordinates of the participant's 25 body joints. Two constructed skeletal datasets of whole-body joints (including binary classification and multi classification) were input into the proposed model for depression recognition after data preparation. We improved the temporal convolution network (TCN), creating novel spatial attention dilated TCN (SATCN) network that included a hierarchy of temporal convolution groups with different dilated convolution scales to capture important skeletal features and a spatial attention block for final result prediction. The depression and non-depression groups can be classified automatically with a maximum accuracy of 75.8% in the binary classification task, and 64.3% accuracy in the multi classification dataset to recognize more fine-grained identification of depression severity, according to experimental results. Our experiments and methods based on Kinect V2 can not only identify and screen depression patients but also effectively observe the recovery level of depression patients during the recovery process. For example, in the change from severe depression to moderate or mild depression multi classification dataset.
format Online
Article
Text
id pubmed-9279697
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-92796972022-07-15 Depression and Severity Detection Based on Body Kinematic Features: Using Kinect Recorded Skeleton Data of Simple Action Yu, Yanhong Li, Wentao Zhao, Yue Ye, Jiayu Zheng, Yunshao Liu, Xinxin Wang, Qingxiang Front Neurol Neurology Relative limb movement is an important feature in assessing depression. In this study, we looked into whether a skeleton-mimetic task using natural stimuli may help people recognize depression. We innovatively used Kinect V2 to collect participant data. Sequential skeletal data was directly extracted from the original Kinect-3D and tetrad coordinates of the participant's 25 body joints. Two constructed skeletal datasets of whole-body joints (including binary classification and multi classification) were input into the proposed model for depression recognition after data preparation. We improved the temporal convolution network (TCN), creating novel spatial attention dilated TCN (SATCN) network that included a hierarchy of temporal convolution groups with different dilated convolution scales to capture important skeletal features and a spatial attention block for final result prediction. The depression and non-depression groups can be classified automatically with a maximum accuracy of 75.8% in the binary classification task, and 64.3% accuracy in the multi classification dataset to recognize more fine-grained identification of depression severity, according to experimental results. Our experiments and methods based on Kinect V2 can not only identify and screen depression patients but also effectively observe the recovery level of depression patients during the recovery process. For example, in the change from severe depression to moderate or mild depression multi classification dataset. Frontiers Media S.A. 2022-06-30 /pmc/articles/PMC9279697/ /pubmed/35847201 http://dx.doi.org/10.3389/fneur.2022.905917 Text en Copyright © 2022 Yu, Li, Zhao, Ye, Zheng, Liu and Wang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neurology
Yu, Yanhong
Li, Wentao
Zhao, Yue
Ye, Jiayu
Zheng, Yunshao
Liu, Xinxin
Wang, Qingxiang
Depression and Severity Detection Based on Body Kinematic Features: Using Kinect Recorded Skeleton Data of Simple Action
title Depression and Severity Detection Based on Body Kinematic Features: Using Kinect Recorded Skeleton Data of Simple Action
title_full Depression and Severity Detection Based on Body Kinematic Features: Using Kinect Recorded Skeleton Data of Simple Action
title_fullStr Depression and Severity Detection Based on Body Kinematic Features: Using Kinect Recorded Skeleton Data of Simple Action
title_full_unstemmed Depression and Severity Detection Based on Body Kinematic Features: Using Kinect Recorded Skeleton Data of Simple Action
title_short Depression and Severity Detection Based on Body Kinematic Features: Using Kinect Recorded Skeleton Data of Simple Action
title_sort depression and severity detection based on body kinematic features: using kinect recorded skeleton data of simple action
topic Neurology
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9279697/
https://www.ncbi.nlm.nih.gov/pubmed/35847201
http://dx.doi.org/10.3389/fneur.2022.905917
work_keys_str_mv AT yuyanhong depressionandseveritydetectionbasedonbodykinematicfeaturesusingkinectrecordedskeletondataofsimpleaction
AT liwentao depressionandseveritydetectionbasedonbodykinematicfeaturesusingkinectrecordedskeletondataofsimpleaction
AT zhaoyue depressionandseveritydetectionbasedonbodykinematicfeaturesusingkinectrecordedskeletondataofsimpleaction
AT yejiayu depressionandseveritydetectionbasedonbodykinematicfeaturesusingkinectrecordedskeletondataofsimpleaction
AT zhengyunshao depressionandseveritydetectionbasedonbodykinematicfeaturesusingkinectrecordedskeletondataofsimpleaction
AT liuxinxin depressionandseveritydetectionbasedonbodykinematicfeaturesusingkinectrecordedskeletondataofsimpleaction
AT wangqingxiang depressionandseveritydetectionbasedonbodykinematicfeaturesusingkinectrecordedskeletondataofsimpleaction