Cargando…

Fitness Movement Types and Completeness Detection Using a Transfer-Learning-Based Deep Neural Network

Fitness is important in people’s lives. Good fitness habits can improve cardiopulmonary capacity, increase concentration, prevent obesity, and effectively reduce the risk of death. Home fitness does not require large equipment but uses dumbbells, yoga mats, and horizontal bars to complete fitness ex...

Descripción completa

Detalles Bibliográficos
Autores principales: Chen, Kuan-Yu, Shin, Jungpil, Hasan, Md. Al Mehedi, Liaw, Jiun-Jian, Yuichi, Okuyama, Tomioka, Yoichi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9371130/
https://www.ncbi.nlm.nih.gov/pubmed/35957257
http://dx.doi.org/10.3390/s22155700
_version_ 1784767041132036096
author Chen, Kuan-Yu
Shin, Jungpil
Hasan, Md. Al Mehedi
Liaw, Jiun-Jian
Yuichi, Okuyama
Tomioka, Yoichi
author_facet Chen, Kuan-Yu
Shin, Jungpil
Hasan, Md. Al Mehedi
Liaw, Jiun-Jian
Yuichi, Okuyama
Tomioka, Yoichi
author_sort Chen, Kuan-Yu
collection PubMed
description Fitness is important in people’s lives. Good fitness habits can improve cardiopulmonary capacity, increase concentration, prevent obesity, and effectively reduce the risk of death. Home fitness does not require large equipment but uses dumbbells, yoga mats, and horizontal bars to complete fitness exercises and can effectively avoid contact with people, so it is deeply loved by people. People who work out at home use social media to obtain fitness knowledge, but learning ability is limited. Incomplete fitness is likely to lead to injury, and a cheap, timely, and accurate fitness detection system can reduce the risk of fitness injuries and can effectively improve people’s fitness awareness. In the past, many studies have engaged in the detection of fitness movements, among which the detection of fitness movements based on wearable devices, body nodes, and image deep learning has achieved better performance. However, a wearable device cannot detect a variety of fitness movements, may hinder the exercise of the fitness user, and has a high cost. Both body-node-based and image-deep-learning-based methods have lower costs, but each has some drawbacks. Therefore, this paper used a method based on deep transfer learning to establish a fitness database. After that, a deep neural network was trained to detect the type and completeness of fitness movements. We used Yolov4 and Mediapipe to instantly detect fitness movements and stored the 1D fitness signal of movement to build a database. Finally, MLP was used to classify the 1D signal waveform of fitness. In the performance of the classification of fitness movement types, the mAP was 99.71%, accuracy was 98.56%, precision was 97.9%, recall was 98.56%, and the F1-score was 98.23%, which is quite a high performance. In the performance of fitness movement completeness classification, accuracy was 92.84%, precision was 92.85, recall was 92.84%, and the F1-score was 92.83%. The average FPS in detection was 17.5. Experimental results show that our method achieves higher accuracy compared to other methods.
format Online
Article
Text
id pubmed-9371130
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-93711302022-08-12 Fitness Movement Types and Completeness Detection Using a Transfer-Learning-Based Deep Neural Network Chen, Kuan-Yu Shin, Jungpil Hasan, Md. Al Mehedi Liaw, Jiun-Jian Yuichi, Okuyama Tomioka, Yoichi Sensors (Basel) Article Fitness is important in people’s lives. Good fitness habits can improve cardiopulmonary capacity, increase concentration, prevent obesity, and effectively reduce the risk of death. Home fitness does not require large equipment but uses dumbbells, yoga mats, and horizontal bars to complete fitness exercises and can effectively avoid contact with people, so it is deeply loved by people. People who work out at home use social media to obtain fitness knowledge, but learning ability is limited. Incomplete fitness is likely to lead to injury, and a cheap, timely, and accurate fitness detection system can reduce the risk of fitness injuries and can effectively improve people’s fitness awareness. In the past, many studies have engaged in the detection of fitness movements, among which the detection of fitness movements based on wearable devices, body nodes, and image deep learning has achieved better performance. However, a wearable device cannot detect a variety of fitness movements, may hinder the exercise of the fitness user, and has a high cost. Both body-node-based and image-deep-learning-based methods have lower costs, but each has some drawbacks. Therefore, this paper used a method based on deep transfer learning to establish a fitness database. After that, a deep neural network was trained to detect the type and completeness of fitness movements. We used Yolov4 and Mediapipe to instantly detect fitness movements and stored the 1D fitness signal of movement to build a database. Finally, MLP was used to classify the 1D signal waveform of fitness. In the performance of the classification of fitness movement types, the mAP was 99.71%, accuracy was 98.56%, precision was 97.9%, recall was 98.56%, and the F1-score was 98.23%, which is quite a high performance. In the performance of fitness movement completeness classification, accuracy was 92.84%, precision was 92.85, recall was 92.84%, and the F1-score was 92.83%. The average FPS in detection was 17.5. Experimental results show that our method achieves higher accuracy compared to other methods. MDPI 2022-07-29 /pmc/articles/PMC9371130/ /pubmed/35957257 http://dx.doi.org/10.3390/s22155700 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Chen, Kuan-Yu
Shin, Jungpil
Hasan, Md. Al Mehedi
Liaw, Jiun-Jian
Yuichi, Okuyama
Tomioka, Yoichi
Fitness Movement Types and Completeness Detection Using a Transfer-Learning-Based Deep Neural Network
title Fitness Movement Types and Completeness Detection Using a Transfer-Learning-Based Deep Neural Network
title_full Fitness Movement Types and Completeness Detection Using a Transfer-Learning-Based Deep Neural Network
title_fullStr Fitness Movement Types and Completeness Detection Using a Transfer-Learning-Based Deep Neural Network
title_full_unstemmed Fitness Movement Types and Completeness Detection Using a Transfer-Learning-Based Deep Neural Network
title_short Fitness Movement Types and Completeness Detection Using a Transfer-Learning-Based Deep Neural Network
title_sort fitness movement types and completeness detection using a transfer-learning-based deep neural network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9371130/
https://www.ncbi.nlm.nih.gov/pubmed/35957257
http://dx.doi.org/10.3390/s22155700
work_keys_str_mv AT chenkuanyu fitnessmovementtypesandcompletenessdetectionusingatransferlearningbaseddeepneuralnetwork
AT shinjungpil fitnessmovementtypesandcompletenessdetectionusingatransferlearningbaseddeepneuralnetwork
AT hasanmdalmehedi fitnessmovementtypesandcompletenessdetectionusingatransferlearningbaseddeepneuralnetwork
AT liawjiunjian fitnessmovementtypesandcompletenessdetectionusingatransferlearningbaseddeepneuralnetwork
AT yuichiokuyama fitnessmovementtypesandcompletenessdetectionusingatransferlearningbaseddeepneuralnetwork
AT tomiokayoichi fitnessmovementtypesandcompletenessdetectionusingatransferlearningbaseddeepneuralnetwork