Cargando…
Using Convolutional Neural Networks with Multiple Thermal Sensors for Unobtrusive Pose Recognition
The desire to remain living in one’s own home rather than a care home by those in need of 24/7 care is one that requires a level of understanding for the actions of an environment’s inhabitants. This can potentially be accomplished with the ability to recognise Activities of Daily Living (ADLs); how...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7729469/ https://www.ncbi.nlm.nih.gov/pubmed/33291592 http://dx.doi.org/10.3390/s20236932 |
_version_ | 1783621465839501312 |
---|---|
author | Burns, Matthew Cruciani, Federico Morrow, Philip Nugent, Chris McClean, Sally |
author_facet | Burns, Matthew Cruciani, Federico Morrow, Philip Nugent, Chris McClean, Sally |
author_sort | Burns, Matthew |
collection | PubMed |
description | The desire to remain living in one’s own home rather than a care home by those in need of 24/7 care is one that requires a level of understanding for the actions of an environment’s inhabitants. This can potentially be accomplished with the ability to recognise Activities of Daily Living (ADLs); however, this research focuses first on producing an unobtrusive solution for pose recognition where the preservation of privacy is a primary aim. With an accurate manner of predicting an inhabitant’s poses, their interactions with objects within the environment and, therefore, the activities they are performing, can begin to be understood. This research implements a Convolutional Neural Network (CNN), which has been designed with an original architecture derived from the popular AlexNet, to predict poses from thermal imagery that have been captured using thermopile infrared sensors (TISs). Five TISs have been deployed within the smart kitchen in Ulster University where each provides input to a corresponding trained CNN. The approach is evaluated using an original dataset and an F1-score of 0.9920 was achieved with all five TISs. The limitations of utilising a ceiling-based TIS are investigated and each possible permutation of corner-based TISs is evaluated to satisfy a trade-off between the number of TISs, the total sensor cost and the performances. These tests are also promising as F1-scores of 0.9266, 0.9149 and 0.8468 were achieved with the isolated use of four, three, and two corner TISs, respectively. |
format | Online Article Text |
id | pubmed-7729469 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-77294692020-12-12 Using Convolutional Neural Networks with Multiple Thermal Sensors for Unobtrusive Pose Recognition Burns, Matthew Cruciani, Federico Morrow, Philip Nugent, Chris McClean, Sally Sensors (Basel) Article The desire to remain living in one’s own home rather than a care home by those in need of 24/7 care is one that requires a level of understanding for the actions of an environment’s inhabitants. This can potentially be accomplished with the ability to recognise Activities of Daily Living (ADLs); however, this research focuses first on producing an unobtrusive solution for pose recognition where the preservation of privacy is a primary aim. With an accurate manner of predicting an inhabitant’s poses, their interactions with objects within the environment and, therefore, the activities they are performing, can begin to be understood. This research implements a Convolutional Neural Network (CNN), which has been designed with an original architecture derived from the popular AlexNet, to predict poses from thermal imagery that have been captured using thermopile infrared sensors (TISs). Five TISs have been deployed within the smart kitchen in Ulster University where each provides input to a corresponding trained CNN. The approach is evaluated using an original dataset and an F1-score of 0.9920 was achieved with all five TISs. The limitations of utilising a ceiling-based TIS are investigated and each possible permutation of corner-based TISs is evaluated to satisfy a trade-off between the number of TISs, the total sensor cost and the performances. These tests are also promising as F1-scores of 0.9266, 0.9149 and 0.8468 were achieved with the isolated use of four, three, and two corner TISs, respectively. MDPI 2020-12-04 /pmc/articles/PMC7729469/ /pubmed/33291592 http://dx.doi.org/10.3390/s20236932 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Burns, Matthew Cruciani, Federico Morrow, Philip Nugent, Chris McClean, Sally Using Convolutional Neural Networks with Multiple Thermal Sensors for Unobtrusive Pose Recognition |
title | Using Convolutional Neural Networks with Multiple Thermal Sensors for Unobtrusive Pose Recognition |
title_full | Using Convolutional Neural Networks with Multiple Thermal Sensors for Unobtrusive Pose Recognition |
title_fullStr | Using Convolutional Neural Networks with Multiple Thermal Sensors for Unobtrusive Pose Recognition |
title_full_unstemmed | Using Convolutional Neural Networks with Multiple Thermal Sensors for Unobtrusive Pose Recognition |
title_short | Using Convolutional Neural Networks with Multiple Thermal Sensors for Unobtrusive Pose Recognition |
title_sort | using convolutional neural networks with multiple thermal sensors for unobtrusive pose recognition |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7729469/ https://www.ncbi.nlm.nih.gov/pubmed/33291592 http://dx.doi.org/10.3390/s20236932 |
work_keys_str_mv | AT burnsmatthew usingconvolutionalneuralnetworkswithmultiplethermalsensorsforunobtrusiveposerecognition AT crucianifederico usingconvolutionalneuralnetworkswithmultiplethermalsensorsforunobtrusiveposerecognition AT morrowphilip usingconvolutionalneuralnetworkswithmultiplethermalsensorsforunobtrusiveposerecognition AT nugentchris usingconvolutionalneuralnetworkswithmultiplethermalsensorsforunobtrusiveposerecognition AT mccleansally usingconvolutionalneuralnetworkswithmultiplethermalsensorsforunobtrusiveposerecognition |