Cargando…

BiLSTM-I: A Deep Learning-Based Long Interval Gap-Filling Method for Meteorological Observation Data

Complete and high-resolution temperature observation data are important input parameters for agrometeorological disaster monitoring and ecosystem modelling. Due to the limitation of field meteorological observation conditions, observation data are commonly missing, and an appropriate data imputation...

Descripción completa

Detalles Bibliográficos
Autores principales: Xie, Chuanjie, Huang, Chong, Zhang, Deqiang, He, Wei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8507855/
https://www.ncbi.nlm.nih.gov/pubmed/34639622
http://dx.doi.org/10.3390/ijerph181910321
_version_ 1784581958385270784
author Xie, Chuanjie
Huang, Chong
Zhang, Deqiang
He, Wei
author_facet Xie, Chuanjie
Huang, Chong
Zhang, Deqiang
He, Wei
author_sort Xie, Chuanjie
collection PubMed
description Complete and high-resolution temperature observation data are important input parameters for agrometeorological disaster monitoring and ecosystem modelling. Due to the limitation of field meteorological observation conditions, observation data are commonly missing, and an appropriate data imputation method is necessary in meteorological data applications. In this paper, we focus on filling long gaps in meteorological observation data at field sites. A deep learning-based model, BiLSTM-I, is proposed to impute missing half-hourly temperature observations with high accuracy by considering temperature observations obtained manually at a low frequency. An encoder-decoder structure is adopted by BiLSTM-I, which is conducive to fully learning the potential distribution pattern of data. In addition, the BiLSTM-I model error function incorporates the difference between the final estimates and true observations. Therefore, the error function evaluates the imputation results more directly, and the model convergence error and the imputation accuracy are directly related, thus ensuring that the imputation error can be minimized at the time the model converges. The experimental analysis results show that the BiLSTM-I model designed in this paper is superior to other methods. For a test set with a time interval gap of 30 days, or a time interval gap of 60 days, the root mean square errors (RMSEs) remain stable, indicating the model’s excellent generalization ability for different missing value gaps. Although the model is only applied to temperature data imputation in this study, it also has the potential to be applied to other meteorological dataset-filling scenarios.
format Online
Article
Text
id pubmed-8507855
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-85078552021-10-13 BiLSTM-I: A Deep Learning-Based Long Interval Gap-Filling Method for Meteorological Observation Data Xie, Chuanjie Huang, Chong Zhang, Deqiang He, Wei Int J Environ Res Public Health Article Complete and high-resolution temperature observation data are important input parameters for agrometeorological disaster monitoring and ecosystem modelling. Due to the limitation of field meteorological observation conditions, observation data are commonly missing, and an appropriate data imputation method is necessary in meteorological data applications. In this paper, we focus on filling long gaps in meteorological observation data at field sites. A deep learning-based model, BiLSTM-I, is proposed to impute missing half-hourly temperature observations with high accuracy by considering temperature observations obtained manually at a low frequency. An encoder-decoder structure is adopted by BiLSTM-I, which is conducive to fully learning the potential distribution pattern of data. In addition, the BiLSTM-I model error function incorporates the difference between the final estimates and true observations. Therefore, the error function evaluates the imputation results more directly, and the model convergence error and the imputation accuracy are directly related, thus ensuring that the imputation error can be minimized at the time the model converges. The experimental analysis results show that the BiLSTM-I model designed in this paper is superior to other methods. For a test set with a time interval gap of 30 days, or a time interval gap of 60 days, the root mean square errors (RMSEs) remain stable, indicating the model’s excellent generalization ability for different missing value gaps. Although the model is only applied to temperature data imputation in this study, it also has the potential to be applied to other meteorological dataset-filling scenarios. MDPI 2021-09-30 /pmc/articles/PMC8507855/ /pubmed/34639622 http://dx.doi.org/10.3390/ijerph181910321 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Xie, Chuanjie
Huang, Chong
Zhang, Deqiang
He, Wei
BiLSTM-I: A Deep Learning-Based Long Interval Gap-Filling Method for Meteorological Observation Data
title BiLSTM-I: A Deep Learning-Based Long Interval Gap-Filling Method for Meteorological Observation Data
title_full BiLSTM-I: A Deep Learning-Based Long Interval Gap-Filling Method for Meteorological Observation Data
title_fullStr BiLSTM-I: A Deep Learning-Based Long Interval Gap-Filling Method for Meteorological Observation Data
title_full_unstemmed BiLSTM-I: A Deep Learning-Based Long Interval Gap-Filling Method for Meteorological Observation Data
title_short BiLSTM-I: A Deep Learning-Based Long Interval Gap-Filling Method for Meteorological Observation Data
title_sort bilstm-i: a deep learning-based long interval gap-filling method for meteorological observation data
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8507855/
https://www.ncbi.nlm.nih.gov/pubmed/34639622
http://dx.doi.org/10.3390/ijerph181910321
work_keys_str_mv AT xiechuanjie bilstmiadeeplearningbasedlongintervalgapfillingmethodformeteorologicalobservationdata
AT huangchong bilstmiadeeplearningbasedlongintervalgapfillingmethodformeteorologicalobservationdata
AT zhangdeqiang bilstmiadeeplearningbasedlongintervalgapfillingmethodformeteorologicalobservationdata
AT hewei bilstmiadeeplearningbasedlongintervalgapfillingmethodformeteorologicalobservationdata