Cargando…
Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals
Machine Activity Recognition (MAR) can be used to monitor manufacturing processes and find bottlenecks and potential for improvement in production. Several interesting results on MAR techniques have been produced in the last decade, but mostly on construction equipment. Forklift trucks, which are ub...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9185299/ https://www.ncbi.nlm.nih.gov/pubmed/35684791 http://dx.doi.org/10.3390/s22114170 |
_version_ | 1784724690221137920 |
---|---|
author | Chen, Kunru Rögnvaldsson, Thorsteinn Nowaczyk, Sławomir Pashami, Sepideh Johansson, Emilia Sternelöv, Gustav |
author_facet | Chen, Kunru Rögnvaldsson, Thorsteinn Nowaczyk, Sławomir Pashami, Sepideh Johansson, Emilia Sternelöv, Gustav |
author_sort | Chen, Kunru |
collection | PubMed |
description | Machine Activity Recognition (MAR) can be used to monitor manufacturing processes and find bottlenecks and potential for improvement in production. Several interesting results on MAR techniques have been produced in the last decade, but mostly on construction equipment. Forklift trucks, which are ubiquitous and highly important industrial machines, have been missing from the MAR research. This paper presents a data-driven method for forklift activity recognition that uses Controller Area Network (CAN) signals and semi-supervised learning (SSL). The SSL enables the utilization of large quantities of unlabeled operation data to build better classifiers; after a two-step post-processing, the recognition results achieve balanced accuracy of 88% for driving activities and 95% for load-handling activities on a hold-out data set. In terms of the Matthews correlation coefficient for five activity classes, the final score is 0.82, which is equal to the recognition results of two non-domain experts who use videos of the activities. A particular success is that context can be used to capture the transport of small weight loads that are not detected by the forklift’s built-in weight sensor. |
format | Online Article Text |
id | pubmed-9185299 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-91852992022-06-11 Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals Chen, Kunru Rögnvaldsson, Thorsteinn Nowaczyk, Sławomir Pashami, Sepideh Johansson, Emilia Sternelöv, Gustav Sensors (Basel) Article Machine Activity Recognition (MAR) can be used to monitor manufacturing processes and find bottlenecks and potential for improvement in production. Several interesting results on MAR techniques have been produced in the last decade, but mostly on construction equipment. Forklift trucks, which are ubiquitous and highly important industrial machines, have been missing from the MAR research. This paper presents a data-driven method for forklift activity recognition that uses Controller Area Network (CAN) signals and semi-supervised learning (SSL). The SSL enables the utilization of large quantities of unlabeled operation data to build better classifiers; after a two-step post-processing, the recognition results achieve balanced accuracy of 88% for driving activities and 95% for load-handling activities on a hold-out data set. In terms of the Matthews correlation coefficient for five activity classes, the final score is 0.82, which is equal to the recognition results of two non-domain experts who use videos of the activities. A particular success is that context can be used to capture the transport of small weight loads that are not detected by the forklift’s built-in weight sensor. MDPI 2022-05-30 /pmc/articles/PMC9185299/ /pubmed/35684791 http://dx.doi.org/10.3390/s22114170 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Chen, Kunru Rögnvaldsson, Thorsteinn Nowaczyk, Sławomir Pashami, Sepideh Johansson, Emilia Sternelöv, Gustav Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals |
title | Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals |
title_full | Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals |
title_fullStr | Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals |
title_full_unstemmed | Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals |
title_short | Semi-Supervised Learning for Forklift Activity Recognition from Controller Area Network (CAN) Signals |
title_sort | semi-supervised learning for forklift activity recognition from controller area network (can) signals |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9185299/ https://www.ncbi.nlm.nih.gov/pubmed/35684791 http://dx.doi.org/10.3390/s22114170 |
work_keys_str_mv | AT chenkunru semisupervisedlearningforforkliftactivityrecognitionfromcontrollerareanetworkcansignals AT rognvaldssonthorsteinn semisupervisedlearningforforkliftactivityrecognitionfromcontrollerareanetworkcansignals AT nowaczyksławomir semisupervisedlearningforforkliftactivityrecognitionfromcontrollerareanetworkcansignals AT pashamisepideh semisupervisedlearningforforkliftactivityrecognitionfromcontrollerareanetworkcansignals AT johanssonemilia semisupervisedlearningforforkliftactivityrecognitionfromcontrollerareanetworkcansignals AT sternelovgustav semisupervisedlearningforforkliftactivityrecognitionfromcontrollerareanetworkcansignals |