Cargando…

TSML: A New Pig Behavior Recognition Method Based on Two-Stream Mutual Learning Network

Changes in pig behavior are crucial information in the livestock breeding process, and automatic pig behavior recognition is a vital method for improving pig welfare. However, most methods for pig behavior recognition rely on human observation and deep learning. Human observation is often time-consu...

Descripción completa

Detalles Bibliográficos
Autores principales: Hao, Wangli, Zhang, Kai, Zhang, Li, Han, Meng, Hao, Wangbao, Li, Fuzhong, Yang, Guoqiang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10255915/
https://www.ncbi.nlm.nih.gov/pubmed/37299818
http://dx.doi.org/10.3390/s23115092
_version_ 1785056988358508544
author Hao, Wangli
Zhang, Kai
Zhang, Li
Han, Meng
Hao, Wangbao
Li, Fuzhong
Yang, Guoqiang
author_facet Hao, Wangli
Zhang, Kai
Zhang, Li
Han, Meng
Hao, Wangbao
Li, Fuzhong
Yang, Guoqiang
author_sort Hao, Wangli
collection PubMed
description Changes in pig behavior are crucial information in the livestock breeding process, and automatic pig behavior recognition is a vital method for improving pig welfare. However, most methods for pig behavior recognition rely on human observation and deep learning. Human observation is often time-consuming and labor-intensive, while deep learning models with a large number of parameters can result in slow training times and low efficiency. To address these issues, this paper proposes a novel deep mutual learning enhanced two-stream pig behavior recognition approach. The proposed model consists of two mutual learning networks, which include the red–green–blue color model (RGB) and flow streams. Additionally, each branch contains two student networks that learn collaboratively to effectively achieve robust and rich appearance or motion features, ultimately leading to improved recognition performance of pig behaviors. Finally, the results of RGB and flow branches are weighted and fused to further improve the performance of pig behavior recognition. Experimental results demonstrate the effectiveness of the proposed model, which achieves state-of-the-art recognition performance with an accuracy of 96.52%, surpassing other models by 2.71%.
format Online
Article
Text
id pubmed-10255915
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-102559152023-06-10 TSML: A New Pig Behavior Recognition Method Based on Two-Stream Mutual Learning Network Hao, Wangli Zhang, Kai Zhang, Li Han, Meng Hao, Wangbao Li, Fuzhong Yang, Guoqiang Sensors (Basel) Article Changes in pig behavior are crucial information in the livestock breeding process, and automatic pig behavior recognition is a vital method for improving pig welfare. However, most methods for pig behavior recognition rely on human observation and deep learning. Human observation is often time-consuming and labor-intensive, while deep learning models with a large number of parameters can result in slow training times and low efficiency. To address these issues, this paper proposes a novel deep mutual learning enhanced two-stream pig behavior recognition approach. The proposed model consists of two mutual learning networks, which include the red–green–blue color model (RGB) and flow streams. Additionally, each branch contains two student networks that learn collaboratively to effectively achieve robust and rich appearance or motion features, ultimately leading to improved recognition performance of pig behaviors. Finally, the results of RGB and flow branches are weighted and fused to further improve the performance of pig behavior recognition. Experimental results demonstrate the effectiveness of the proposed model, which achieves state-of-the-art recognition performance with an accuracy of 96.52%, surpassing other models by 2.71%. MDPI 2023-05-26 /pmc/articles/PMC10255915/ /pubmed/37299818 http://dx.doi.org/10.3390/s23115092 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Hao, Wangli
Zhang, Kai
Zhang, Li
Han, Meng
Hao, Wangbao
Li, Fuzhong
Yang, Guoqiang
TSML: A New Pig Behavior Recognition Method Based on Two-Stream Mutual Learning Network
title TSML: A New Pig Behavior Recognition Method Based on Two-Stream Mutual Learning Network
title_full TSML: A New Pig Behavior Recognition Method Based on Two-Stream Mutual Learning Network
title_fullStr TSML: A New Pig Behavior Recognition Method Based on Two-Stream Mutual Learning Network
title_full_unstemmed TSML: A New Pig Behavior Recognition Method Based on Two-Stream Mutual Learning Network
title_short TSML: A New Pig Behavior Recognition Method Based on Two-Stream Mutual Learning Network
title_sort tsml: a new pig behavior recognition method based on two-stream mutual learning network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10255915/
https://www.ncbi.nlm.nih.gov/pubmed/37299818
http://dx.doi.org/10.3390/s23115092
work_keys_str_mv AT haowangli tsmlanewpigbehaviorrecognitionmethodbasedontwostreammutuallearningnetwork
AT zhangkai tsmlanewpigbehaviorrecognitionmethodbasedontwostreammutuallearningnetwork
AT zhangli tsmlanewpigbehaviorrecognitionmethodbasedontwostreammutuallearningnetwork
AT hanmeng tsmlanewpigbehaviorrecognitionmethodbasedontwostreammutuallearningnetwork
AT haowangbao tsmlanewpigbehaviorrecognitionmethodbasedontwostreammutuallearningnetwork
AT lifuzhong tsmlanewpigbehaviorrecognitionmethodbasedontwostreammutuallearningnetwork
AT yangguoqiang tsmlanewpigbehaviorrecognitionmethodbasedontwostreammutuallearningnetwork