Cargando…

EduNet: A New Video Dataset for Understanding Human Activity in the Classroom Environment

Human action recognition in videos has become a popular research area in artificial intelligence (AI) technology. In the past few years, this research has accelerated in areas such as sports, daily activities, kitchen activities, etc., due to developments in the benchmarks proposed for human action...

Descripción completa

Detalles Bibliográficos
Autores principales: Sharma, Vijeta, Gupta, Manjari, Kumar, Ajai, Mishra, Deepti
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8434086/
https://www.ncbi.nlm.nih.gov/pubmed/34502592
http://dx.doi.org/10.3390/s21175699
_version_ 1783751515030159360
author Sharma, Vijeta
Gupta, Manjari
Kumar, Ajai
Mishra, Deepti
author_facet Sharma, Vijeta
Gupta, Manjari
Kumar, Ajai
Mishra, Deepti
author_sort Sharma, Vijeta
collection PubMed
description Human action recognition in videos has become a popular research area in artificial intelligence (AI) technology. In the past few years, this research has accelerated in areas such as sports, daily activities, kitchen activities, etc., due to developments in the benchmarks proposed for human action recognition datasets in these areas. However, there is little research in the benchmarking datasets for human activity recognition in educational environments. Therefore, we developed a dataset of teacher and student activities to expand the research in the education domain. This paper proposes a new dataset, called EduNet, for a novel approach towards developing human action recognition datasets in classroom environments. EduNet has 20 action classes, containing around 7851 manually annotated clips extracted from YouTube videos, and recorded in an actual classroom environment. Each action category has a minimum of 200 clips, and the total duration is approximately 12 h. To the best of our knowledge, EduNet is the first dataset specially prepared for classroom monitoring for both teacher and student activities. It is also a challenging dataset of actions as it has many clips (and due to the unconstrained nature of the clips). We compared the performance of the EduNet dataset with benchmark video datasets UCF101 and HMDB51 on a standard I3D-ResNet-50 model, which resulted in 72.3% accuracy. The development of a new benchmark dataset for the education domain will benefit future research concerning classroom monitoring systems. The EduNet dataset is a collection of classroom activities from 1 to 12 standard schools.
format Online
Article
Text
id pubmed-8434086
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-84340862021-09-12 EduNet: A New Video Dataset for Understanding Human Activity in the Classroom Environment Sharma, Vijeta Gupta, Manjari Kumar, Ajai Mishra, Deepti Sensors (Basel) Article Human action recognition in videos has become a popular research area in artificial intelligence (AI) technology. In the past few years, this research has accelerated in areas such as sports, daily activities, kitchen activities, etc., due to developments in the benchmarks proposed for human action recognition datasets in these areas. However, there is little research in the benchmarking datasets for human activity recognition in educational environments. Therefore, we developed a dataset of teacher and student activities to expand the research in the education domain. This paper proposes a new dataset, called EduNet, for a novel approach towards developing human action recognition datasets in classroom environments. EduNet has 20 action classes, containing around 7851 manually annotated clips extracted from YouTube videos, and recorded in an actual classroom environment. Each action category has a minimum of 200 clips, and the total duration is approximately 12 h. To the best of our knowledge, EduNet is the first dataset specially prepared for classroom monitoring for both teacher and student activities. It is also a challenging dataset of actions as it has many clips (and due to the unconstrained nature of the clips). We compared the performance of the EduNet dataset with benchmark video datasets UCF101 and HMDB51 on a standard I3D-ResNet-50 model, which resulted in 72.3% accuracy. The development of a new benchmark dataset for the education domain will benefit future research concerning classroom monitoring systems. The EduNet dataset is a collection of classroom activities from 1 to 12 standard schools. MDPI 2021-08-24 /pmc/articles/PMC8434086/ /pubmed/34502592 http://dx.doi.org/10.3390/s21175699 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Sharma, Vijeta
Gupta, Manjari
Kumar, Ajai
Mishra, Deepti
EduNet: A New Video Dataset for Understanding Human Activity in the Classroom Environment
title EduNet: A New Video Dataset for Understanding Human Activity in the Classroom Environment
title_full EduNet: A New Video Dataset for Understanding Human Activity in the Classroom Environment
title_fullStr EduNet: A New Video Dataset for Understanding Human Activity in the Classroom Environment
title_full_unstemmed EduNet: A New Video Dataset for Understanding Human Activity in the Classroom Environment
title_short EduNet: A New Video Dataset for Understanding Human Activity in the Classroom Environment
title_sort edunet: a new video dataset for understanding human activity in the classroom environment
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8434086/
https://www.ncbi.nlm.nih.gov/pubmed/34502592
http://dx.doi.org/10.3390/s21175699
work_keys_str_mv AT sharmavijeta edunetanewvideodatasetforunderstandinghumanactivityintheclassroomenvironment
AT guptamanjari edunetanewvideodatasetforunderstandinghumanactivityintheclassroomenvironment
AT kumarajai edunetanewvideodatasetforunderstandinghumanactivityintheclassroomenvironment
AT mishradeepti edunetanewvideodatasetforunderstandinghumanactivityintheclassroomenvironment