Cargando…
CNN-Bi-LSTM: A Complex Environment-Oriented Cattle Behavior Classification Network Based on the Fusion of CNN and Bi-LSTM
Cattle behavior classification technology holds a crucial position within the realm of smart cattle farming. Addressing the requisites of cattle behavior classification in the agricultural sector, this paper presents a novel cattle behavior classification network tailored for intricate environments....
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10536225/ https://www.ncbi.nlm.nih.gov/pubmed/37765771 http://dx.doi.org/10.3390/s23187714 |
_version_ | 1785112815349006336 |
---|---|
author | Gao, Guohong Wang, Chengchao Wang, Jianping Lv, Yingying Li, Qian Ma, Yuxin Zhang, Xueyan Li, Zhiyu Chen, Guanglan |
author_facet | Gao, Guohong Wang, Chengchao Wang, Jianping Lv, Yingying Li, Qian Ma, Yuxin Zhang, Xueyan Li, Zhiyu Chen, Guanglan |
author_sort | Gao, Guohong |
collection | PubMed |
description | Cattle behavior classification technology holds a crucial position within the realm of smart cattle farming. Addressing the requisites of cattle behavior classification in the agricultural sector, this paper presents a novel cattle behavior classification network tailored for intricate environments. This network amalgamates the capabilities of CNN and Bi-LSTM. Initially, a data collection method is devised within an authentic farm setting, followed by the delineation of eight fundamental cattle behaviors. The foundational step involves utilizing VGG16 as the cornerstone of the CNN network, thereby extracting spatial feature vectors from each video data sequence. Subsequently, these features are channeled into a Bi-LSTM classification model, adept at unearthing semantic insights from temporal data in both directions. This process ensures precise recognition and categorization of cattle behaviors. To validate the model’s efficacy, ablation experiments, generalization effect assessments, and comparative analyses under consistent experimental conditions are performed. These investigations, involving module replacements within the classification model and comprehensive analysis of ablation experiments, affirm the model’s effectiveness. The self-constructed dataset about cattle is subjected to evaluation using cross-entropy loss, assessing the model’s generalization efficacy across diverse subjects and viewing perspectives. Classification performance accuracy is quantified through the application of a confusion matrix. Furthermore, a set of comparison experiments is conducted, involving three pertinent deep learning models: MASK-RCNN, CNN-LSTM, and EfficientNet-LSTM. The outcomes of these experiments unequivocally substantiate the superiority of the proposed model. Empirical results underscore the CNN-Bi-LSTM model’s commendable performance metrics: achieving 94.3% accuracy, 94.2% precision, and 93.4% recall while navigating challenges such as varying light conditions, occlusions, and environmental influences. The objective of this study is to employ a fusion of CNN and Bi-LSTM to autonomously extract features from multimodal data, thereby addressing the challenge of classifying cattle behaviors within intricate scenes. By surpassing the constraints imposed by conventional methodologies and the analysis of single-sensor data, this approach seeks to enhance the precision and generalizability of cattle behavior classification. The consequential practical, economic, and societal implications for the agricultural sector are of considerable significance. |
format | Online Article Text |
id | pubmed-10536225 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-105362252023-09-29 CNN-Bi-LSTM: A Complex Environment-Oriented Cattle Behavior Classification Network Based on the Fusion of CNN and Bi-LSTM Gao, Guohong Wang, Chengchao Wang, Jianping Lv, Yingying Li, Qian Ma, Yuxin Zhang, Xueyan Li, Zhiyu Chen, Guanglan Sensors (Basel) Article Cattle behavior classification technology holds a crucial position within the realm of smart cattle farming. Addressing the requisites of cattle behavior classification in the agricultural sector, this paper presents a novel cattle behavior classification network tailored for intricate environments. This network amalgamates the capabilities of CNN and Bi-LSTM. Initially, a data collection method is devised within an authentic farm setting, followed by the delineation of eight fundamental cattle behaviors. The foundational step involves utilizing VGG16 as the cornerstone of the CNN network, thereby extracting spatial feature vectors from each video data sequence. Subsequently, these features are channeled into a Bi-LSTM classification model, adept at unearthing semantic insights from temporal data in both directions. This process ensures precise recognition and categorization of cattle behaviors. To validate the model’s efficacy, ablation experiments, generalization effect assessments, and comparative analyses under consistent experimental conditions are performed. These investigations, involving module replacements within the classification model and comprehensive analysis of ablation experiments, affirm the model’s effectiveness. The self-constructed dataset about cattle is subjected to evaluation using cross-entropy loss, assessing the model’s generalization efficacy across diverse subjects and viewing perspectives. Classification performance accuracy is quantified through the application of a confusion matrix. Furthermore, a set of comparison experiments is conducted, involving three pertinent deep learning models: MASK-RCNN, CNN-LSTM, and EfficientNet-LSTM. The outcomes of these experiments unequivocally substantiate the superiority of the proposed model. Empirical results underscore the CNN-Bi-LSTM model’s commendable performance metrics: achieving 94.3% accuracy, 94.2% precision, and 93.4% recall while navigating challenges such as varying light conditions, occlusions, and environmental influences. The objective of this study is to employ a fusion of CNN and Bi-LSTM to autonomously extract features from multimodal data, thereby addressing the challenge of classifying cattle behaviors within intricate scenes. By surpassing the constraints imposed by conventional methodologies and the analysis of single-sensor data, this approach seeks to enhance the precision and generalizability of cattle behavior classification. The consequential practical, economic, and societal implications for the agricultural sector are of considerable significance. MDPI 2023-09-06 /pmc/articles/PMC10536225/ /pubmed/37765771 http://dx.doi.org/10.3390/s23187714 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Gao, Guohong Wang, Chengchao Wang, Jianping Lv, Yingying Li, Qian Ma, Yuxin Zhang, Xueyan Li, Zhiyu Chen, Guanglan CNN-Bi-LSTM: A Complex Environment-Oriented Cattle Behavior Classification Network Based on the Fusion of CNN and Bi-LSTM |
title | CNN-Bi-LSTM: A Complex Environment-Oriented Cattle Behavior Classification Network Based on the Fusion of CNN and Bi-LSTM |
title_full | CNN-Bi-LSTM: A Complex Environment-Oriented Cattle Behavior Classification Network Based on the Fusion of CNN and Bi-LSTM |
title_fullStr | CNN-Bi-LSTM: A Complex Environment-Oriented Cattle Behavior Classification Network Based on the Fusion of CNN and Bi-LSTM |
title_full_unstemmed | CNN-Bi-LSTM: A Complex Environment-Oriented Cattle Behavior Classification Network Based on the Fusion of CNN and Bi-LSTM |
title_short | CNN-Bi-LSTM: A Complex Environment-Oriented Cattle Behavior Classification Network Based on the Fusion of CNN and Bi-LSTM |
title_sort | cnn-bi-lstm: a complex environment-oriented cattle behavior classification network based on the fusion of cnn and bi-lstm |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10536225/ https://www.ncbi.nlm.nih.gov/pubmed/37765771 http://dx.doi.org/10.3390/s23187714 |
work_keys_str_mv | AT gaoguohong cnnbilstmacomplexenvironmentorientedcattlebehaviorclassificationnetworkbasedonthefusionofcnnandbilstm AT wangchengchao cnnbilstmacomplexenvironmentorientedcattlebehaviorclassificationnetworkbasedonthefusionofcnnandbilstm AT wangjianping cnnbilstmacomplexenvironmentorientedcattlebehaviorclassificationnetworkbasedonthefusionofcnnandbilstm AT lvyingying cnnbilstmacomplexenvironmentorientedcattlebehaviorclassificationnetworkbasedonthefusionofcnnandbilstm AT liqian cnnbilstmacomplexenvironmentorientedcattlebehaviorclassificationnetworkbasedonthefusionofcnnandbilstm AT mayuxin cnnbilstmacomplexenvironmentorientedcattlebehaviorclassificationnetworkbasedonthefusionofcnnandbilstm AT zhangxueyan cnnbilstmacomplexenvironmentorientedcattlebehaviorclassificationnetworkbasedonthefusionofcnnandbilstm AT lizhiyu cnnbilstmacomplexenvironmentorientedcattlebehaviorclassificationnetworkbasedonthefusionofcnnandbilstm AT chenguanglan cnnbilstmacomplexenvironmentorientedcattlebehaviorclassificationnetworkbasedonthefusionofcnnandbilstm |