Cargando…

A Time Series Data Filling Method Based on LSTM—Taking the Stem Moisture as an Example

In order to solve the problem of data loss in sensor data collection, this paper took the stem moisture data of plants as the object, and compared the filling value of missing data in the same data segment with different data filling methods to verify the validity and accuracy of the stem water fill...

Descripción completa

Detalles Bibliográficos
Autores principales: Song, Wei, Gao, Chao, Zhao, Yue, Zhao, Yandong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7571071/
https://www.ncbi.nlm.nih.gov/pubmed/32899485
http://dx.doi.org/10.3390/s20185045
_version_ 1783597091915825152
author Song, Wei
Gao, Chao
Zhao, Yue
Zhao, Yandong
author_facet Song, Wei
Gao, Chao
Zhao, Yue
Zhao, Yandong
author_sort Song, Wei
collection PubMed
description In order to solve the problem of data loss in sensor data collection, this paper took the stem moisture data of plants as the object, and compared the filling value of missing data in the same data segment with different data filling methods to verify the validity and accuracy of the stem water filling data of the LSTM (Long Short-Term Memory) model. This paper compared the accuracy of missing stem water data for plants under different data filling methods to solve the problem of data loss in sensor data collection. Original stem moisture data was selected from Lagerstroemia Indica which was planted in the Haidian District of Beijing in June 2017. Part of the data which treated as missing data was manually deleted. Interpolation methods, time series statistical methods, the RNN (Recurrent Neural Network), and LSTM neural network were used to fill in the missing part and the filling results were compared with the original data. The result shows that the LSTM has more accurate performance than the RNN. The error values of the bidirectional LSTM model are the smallest among several models. The error values of the bidirectional LSTM are much lower than other methods. The MAPE (mean absolute percent error) of the bidirectional LSTM model is 1.813%. After increasing the length of the training data, the results further proved the effectiveness of the model. Further, in order to solve the problem of one-dimensional filling error accumulation, the LSTM model is used to conduct the multi-dimensional filling experiment with environmental data. After comparing the filling results of different environmental parameters, three environmental parameters of air humidity, photosynthetic active radiation, and soil temperature were selected as input. The results show that the multi-dimensional filling can greatly extend the sequence length while maintaining the accuracy, and make up for the defect that the one-dimensional filling accumulates errors with the increase of the sequence. The minimum MAPE of multidimensional filling is 1.499%. In conclusion, the data filling method based on LSTM neural network has a great advantage in filling the long-lost time series data which would provide a new idea for data filling.
format Online
Article
Text
id pubmed-7571071
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-75710712020-10-28 A Time Series Data Filling Method Based on LSTM—Taking the Stem Moisture as an Example Song, Wei Gao, Chao Zhao, Yue Zhao, Yandong Sensors (Basel) Article In order to solve the problem of data loss in sensor data collection, this paper took the stem moisture data of plants as the object, and compared the filling value of missing data in the same data segment with different data filling methods to verify the validity and accuracy of the stem water filling data of the LSTM (Long Short-Term Memory) model. This paper compared the accuracy of missing stem water data for plants under different data filling methods to solve the problem of data loss in sensor data collection. Original stem moisture data was selected from Lagerstroemia Indica which was planted in the Haidian District of Beijing in June 2017. Part of the data which treated as missing data was manually deleted. Interpolation methods, time series statistical methods, the RNN (Recurrent Neural Network), and LSTM neural network were used to fill in the missing part and the filling results were compared with the original data. The result shows that the LSTM has more accurate performance than the RNN. The error values of the bidirectional LSTM model are the smallest among several models. The error values of the bidirectional LSTM are much lower than other methods. The MAPE (mean absolute percent error) of the bidirectional LSTM model is 1.813%. After increasing the length of the training data, the results further proved the effectiveness of the model. Further, in order to solve the problem of one-dimensional filling error accumulation, the LSTM model is used to conduct the multi-dimensional filling experiment with environmental data. After comparing the filling results of different environmental parameters, three environmental parameters of air humidity, photosynthetic active radiation, and soil temperature were selected as input. The results show that the multi-dimensional filling can greatly extend the sequence length while maintaining the accuracy, and make up for the defect that the one-dimensional filling accumulates errors with the increase of the sequence. The minimum MAPE of multidimensional filling is 1.499%. In conclusion, the data filling method based on LSTM neural network has a great advantage in filling the long-lost time series data which would provide a new idea for data filling. MDPI 2020-09-05 /pmc/articles/PMC7571071/ /pubmed/32899485 http://dx.doi.org/10.3390/s20185045 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Song, Wei
Gao, Chao
Zhao, Yue
Zhao, Yandong
A Time Series Data Filling Method Based on LSTM—Taking the Stem Moisture as an Example
title A Time Series Data Filling Method Based on LSTM—Taking the Stem Moisture as an Example
title_full A Time Series Data Filling Method Based on LSTM—Taking the Stem Moisture as an Example
title_fullStr A Time Series Data Filling Method Based on LSTM—Taking the Stem Moisture as an Example
title_full_unstemmed A Time Series Data Filling Method Based on LSTM—Taking the Stem Moisture as an Example
title_short A Time Series Data Filling Method Based on LSTM—Taking the Stem Moisture as an Example
title_sort time series data filling method based on lstm—taking the stem moisture as an example
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7571071/
https://www.ncbi.nlm.nih.gov/pubmed/32899485
http://dx.doi.org/10.3390/s20185045
work_keys_str_mv AT songwei atimeseriesdatafillingmethodbasedonlstmtakingthestemmoistureasanexample
AT gaochao atimeseriesdatafillingmethodbasedonlstmtakingthestemmoistureasanexample
AT zhaoyue atimeseriesdatafillingmethodbasedonlstmtakingthestemmoistureasanexample
AT zhaoyandong atimeseriesdatafillingmethodbasedonlstmtakingthestemmoistureasanexample
AT songwei timeseriesdatafillingmethodbasedonlstmtakingthestemmoistureasanexample
AT gaochao timeseriesdatafillingmethodbasedonlstmtakingthestemmoistureasanexample
AT zhaoyue timeseriesdatafillingmethodbasedonlstmtakingthestemmoistureasanexample
AT zhaoyandong timeseriesdatafillingmethodbasedonlstmtakingthestemmoistureasanexample