Cargando…

Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals

Machine Activity Recognition (MAR) can be used to monitor manufacturing processes and find bottlenecks and potential for improvement in production. Several interesting results on MAR techniques have been produced in the last decade, but mostly on construction equipment. Forklift trucks, which are ub...

Descripción completa

Detalles Bibliográficos
Autores principales: Chen, Kunru, Rögnvaldsson, Thorsteinn, Nowaczyk, Sławomir, Pashami, Sepideh, Johansson, Emilia, Sternelöv, Gustav
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9185299/
https://www.ncbi.nlm.nih.gov/pubmed/35684791
http://dx.doi.org/10.3390/s22114170
_version_ 1784724690221137920
author Chen, Kunru
Rögnvaldsson, Thorsteinn
Nowaczyk, Sławomir
Pashami, Sepideh
Johansson, Emilia
Sternelöv, Gustav
author_facet Chen, Kunru
Rögnvaldsson, Thorsteinn
Nowaczyk, Sławomir
Pashami, Sepideh
Johansson, Emilia
Sternelöv, Gustav
author_sort Chen, Kunru
collection PubMed
description Machine Activity Recognition (MAR) can be used to monitor manufacturing processes and find bottlenecks and potential for improvement in production. Several interesting results on MAR techniques have been produced in the last decade, but mostly on construction equipment. Forklift trucks, which are ubiquitous and highly important industrial machines, have been missing from the MAR research. This paper presents a data-driven method for forklift activity recognition that uses Controller Area Network (CAN) signals and semi-supervised learning (SSL). The SSL enables the utilization of large quantities of unlabeled operation data to build better classifiers; after a two-step post-processing, the recognition results achieve balanced accuracy of 88% for driving activities and 95% for load-handling activities on a hold-out data set. In terms of the Matthews correlation coefficient for five activity classes, the final score is 0.82, which is equal to the recognition results of two non-domain experts who use videos of the activities. A particular success is that context can be used to capture the transport of small weight loads that are not detected by the forklift’s built-in weight sensor.
format Online
Article
Text
id pubmed-9185299
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-91852992022-06-11 Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals Chen, Kunru Rögnvaldsson, Thorsteinn Nowaczyk, Sławomir Pashami, Sepideh Johansson, Emilia Sternelöv, Gustav Sensors (Basel) Article Machine Activity Recognition (MAR) can be used to monitor manufacturing processes and find bottlenecks and potential for improvement in production. Several interesting results on MAR techniques have been produced in the last decade, but mostly on construction equipment. Forklift trucks, which are ubiquitous and highly important industrial machines, have been missing from the MAR research. This paper presents a data-driven method for forklift activity recognition that uses Controller Area Network (CAN) signals and semi-supervised learning (SSL). The SSL enables the utilization of large quantities of unlabeled operation data to build better classifiers; after a two-step post-processing, the recognition results achieve balanced accuracy of 88% for driving activities and 95% for load-handling activities on a hold-out data set. In terms of the Matthews correlation coefficient for five activity classes, the final score is 0.82, which is equal to the recognition results of two non-domain experts who use videos of the activities. A particular success is that context can be used to capture the transport of small weight loads that are not detected by the forklift’s built-in weight sensor. MDPI 2022-05-30 /pmc/articles/PMC9185299/ /pubmed/35684791 http://dx.doi.org/10.3390/s22114170 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Chen, Kunru
Rögnvaldsson, Thorsteinn
Nowaczyk, Sławomir
Pashami, Sepideh
Johansson, Emilia
Sternelöv, Gustav
Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals
title Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals
title_full Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals
title_fullStr Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals
title_full_unstemmed Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals
title_short Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals
title_sort semi-supervised learning for forklift activity recognition from controller area network (can) signals
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9185299/
https://www.ncbi.nlm.nih.gov/pubmed/35684791
http://dx.doi.org/10.3390/s22114170
work_keys_str_mv AT chenkunru semisupervisedlearningforforkliftactivityrecognitionfromcontrollerareanetworkcansignals
AT rognvaldssonthorsteinn semisupervisedlearningforforkliftactivityrecognitionfromcontrollerareanetworkcansignals
AT nowaczyksławomir semisupervisedlearningforforkliftactivityrecognitionfromcontrollerareanetworkcansignals
AT pashamisepideh semisupervisedlearningforforkliftactivityrecognitionfromcontrollerareanetworkcansignals
AT johanssonemilia semisupervisedlearningforforkliftactivityrecognitionfromcontrollerareanetworkcansignals
AT sternelovgustav semisupervisedlearningforforkliftactivityrecognitionfromcontrollerareanetworkcansignals