Cargando…
An Infrared Array Sensor-Based Approach for Activity Detection, Combining Low-Cost Technology with Advanced Deep Learning Techniques
In this paper, we propose an activity detection system using a 24 × 32 resolution infrared array sensor placed on the ceiling. We first collect the data at different resolutions (i.e., 24 × 32, 12 × 16, and 6 × 8) and apply the advanced deep learning (DL) techniques of Super-Resolution (SR) and deno...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9145665/ https://www.ncbi.nlm.nih.gov/pubmed/35632305 http://dx.doi.org/10.3390/s22103898 |
_version_ | 1784716370573787136 |
---|---|
author | Krishnan, Arumugasamy Muthukumar Bouazizi, Mondher Ohtsuki, Tomoaki |
author_facet | Krishnan, Arumugasamy Muthukumar Bouazizi, Mondher Ohtsuki, Tomoaki |
author_sort | Krishnan, Arumugasamy Muthukumar |
collection | PubMed |
description | In this paper, we propose an activity detection system using a 24 × 32 resolution infrared array sensor placed on the ceiling. We first collect the data at different resolutions (i.e., 24 × 32, 12 × 16, and 6 × 8) and apply the advanced deep learning (DL) techniques of Super-Resolution (SR) and denoising to enhance the quality of the images. We then classify the images/sequences of images depending on the activities the subject is performing using a hybrid deep learning model combining a Convolutional Neural Network (CNN) and a Long Short-Term Memory (LSTM). We use data augmentation to improve the training of the neural networks by incorporating a wider variety of samples. The process of data augmentation is performed by a Conditional Generative Adversarial Network (CGAN). By enhancing the images using SR, removing the noise, and adding more training samples via data augmentation, our target is to improve the classification accuracy of the neural network. Through experiments, we show that employing these deep learning techniques to low-resolution noisy infrared images leads to a noticeable improvement in performance. The classification accuracy improved from 78.32% to 84.43% (for images with 6 × 8 resolution), and from 90.11% to 94.54% (for images with 12 × 16 resolution) when we used the CNN and CNN + LSTM networks, respectively. |
format | Online Article Text |
id | pubmed-9145665 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-91456652022-05-29 An Infrared Array Sensor-Based Approach for Activity Detection, Combining Low-Cost Technology with Advanced Deep Learning Techniques Krishnan, Arumugasamy Muthukumar Bouazizi, Mondher Ohtsuki, Tomoaki Sensors (Basel) Article In this paper, we propose an activity detection system using a 24 × 32 resolution infrared array sensor placed on the ceiling. We first collect the data at different resolutions (i.e., 24 × 32, 12 × 16, and 6 × 8) and apply the advanced deep learning (DL) techniques of Super-Resolution (SR) and denoising to enhance the quality of the images. We then classify the images/sequences of images depending on the activities the subject is performing using a hybrid deep learning model combining a Convolutional Neural Network (CNN) and a Long Short-Term Memory (LSTM). We use data augmentation to improve the training of the neural networks by incorporating a wider variety of samples. The process of data augmentation is performed by a Conditional Generative Adversarial Network (CGAN). By enhancing the images using SR, removing the noise, and adding more training samples via data augmentation, our target is to improve the classification accuracy of the neural network. Through experiments, we show that employing these deep learning techniques to low-resolution noisy infrared images leads to a noticeable improvement in performance. The classification accuracy improved from 78.32% to 84.43% (for images with 6 × 8 resolution), and from 90.11% to 94.54% (for images with 12 × 16 resolution) when we used the CNN and CNN + LSTM networks, respectively. MDPI 2022-05-20 /pmc/articles/PMC9145665/ /pubmed/35632305 http://dx.doi.org/10.3390/s22103898 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Krishnan, Arumugasamy Muthukumar Bouazizi, Mondher Ohtsuki, Tomoaki An Infrared Array Sensor-Based Approach for Activity Detection, Combining Low-Cost Technology with Advanced Deep Learning Techniques |
title | An Infrared Array Sensor-Based Approach for Activity Detection, Combining Low-Cost Technology with Advanced Deep Learning Techniques |
title_full | An Infrared Array Sensor-Based Approach for Activity Detection, Combining Low-Cost Technology with Advanced Deep Learning Techniques |
title_fullStr | An Infrared Array Sensor-Based Approach for Activity Detection, Combining Low-Cost Technology with Advanced Deep Learning Techniques |
title_full_unstemmed | An Infrared Array Sensor-Based Approach for Activity Detection, Combining Low-Cost Technology with Advanced Deep Learning Techniques |
title_short | An Infrared Array Sensor-Based Approach for Activity Detection, Combining Low-Cost Technology with Advanced Deep Learning Techniques |
title_sort | infrared array sensor-based approach for activity detection, combining low-cost technology with advanced deep learning techniques |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9145665/ https://www.ncbi.nlm.nih.gov/pubmed/35632305 http://dx.doi.org/10.3390/s22103898 |
work_keys_str_mv | AT krishnanarumugasamymuthukumar aninfraredarraysensorbasedapproachforactivitydetectioncombininglowcosttechnologywithadvanceddeeplearningtechniques AT bouazizimondher aninfraredarraysensorbasedapproachforactivitydetectioncombininglowcosttechnologywithadvanceddeeplearningtechniques AT ohtsukitomoaki aninfraredarraysensorbasedapproachforactivitydetectioncombininglowcosttechnologywithadvanceddeeplearningtechniques AT krishnanarumugasamymuthukumar infraredarraysensorbasedapproachforactivitydetectioncombininglowcosttechnologywithadvanceddeeplearningtechniques AT bouazizimondher infraredarraysensorbasedapproachforactivitydetectioncombininglowcosttechnologywithadvanceddeeplearningtechniques AT ohtsukitomoaki infraredarraysensorbasedapproachforactivitydetectioncombininglowcosttechnologywithadvanceddeeplearningtechniques |