Cargando…

Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning

We propose three quality control (QC) techniques using machine learning that depend on the type of input data used for training. These include QC based on time series of a single weather element, QC based on time series in conjunction with other weather elements, and QC using spatiotemporal characte...

Descripción completa

Detalles Bibliográficos
Autores principales: Kim, Hye-Jin, Park, Sung Min, Choi, Byung Jin, Moon, Seung-Hyun, Kim, Yong-Hyuk
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7086422/
https://www.ncbi.nlm.nih.gov/pubmed/32256552
http://dx.doi.org/10.1155/2020/7980434
_version_ 1783509120441122816
author Kim, Hye-Jin
Park, Sung Min
Choi, Byung Jin
Moon, Seung-Hyun
Kim, Yong-Hyuk
author_facet Kim, Hye-Jin
Park, Sung Min
Choi, Byung Jin
Moon, Seung-Hyun
Kim, Yong-Hyuk
author_sort Kim, Hye-Jin
collection PubMed
description We propose three quality control (QC) techniques using machine learning that depend on the type of input data used for training. These include QC based on time series of a single weather element, QC based on time series in conjunction with other weather elements, and QC using spatiotemporal characteristics. We performed machine learning-based QC on each weather element of atmospheric data, such as temperature, acquired from seven types of IoT sensors and applied machine learning algorithms, such as support vector regression, on data with errors to make meaningful estimates from them. By using the root mean squared error (RMSE), we evaluated the performance of the proposed techniques. As a result, the QC done in conjunction with other weather elements had 0.14% lower RMSE on average than QC conducted with only a single weather element. In the case of QC with spatiotemporal characteristic considerations, the QC done via training with AWS data showed performance with 17% lower RMSE than QC done with only raw data.
format Online
Article
Text
id pubmed-7086422
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-70864222020-04-01 Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning Kim, Hye-Jin Park, Sung Min Choi, Byung Jin Moon, Seung-Hyun Kim, Yong-Hyuk Comput Intell Neurosci Research Article We propose three quality control (QC) techniques using machine learning that depend on the type of input data used for training. These include QC based on time series of a single weather element, QC based on time series in conjunction with other weather elements, and QC using spatiotemporal characteristics. We performed machine learning-based QC on each weather element of atmospheric data, such as temperature, acquired from seven types of IoT sensors and applied machine learning algorithms, such as support vector regression, on data with errors to make meaningful estimates from them. By using the root mean squared error (RMSE), we evaluated the performance of the proposed techniques. As a result, the QC done in conjunction with other weather elements had 0.14% lower RMSE on average than QC conducted with only a single weather element. In the case of QC with spatiotemporal characteristic considerations, the QC done via training with AWS data showed performance with 17% lower RMSE than QC done with only raw data. Hindawi 2020-03-11 /pmc/articles/PMC7086422/ /pubmed/32256552 http://dx.doi.org/10.1155/2020/7980434 Text en Copyright © 2020 Hye-Jin Kim et al. http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Kim, Hye-Jin
Park, Sung Min
Choi, Byung Jin
Moon, Seung-Hyun
Kim, Yong-Hyuk
Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
title Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
title_full Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
title_fullStr Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
title_full_unstemmed Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
title_short Spatiotemporal Approaches for Quality Control and Error Correction of Atmospheric Data through Machine Learning
title_sort spatiotemporal approaches for quality control and error correction of atmospheric data through machine learning
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7086422/
https://www.ncbi.nlm.nih.gov/pubmed/32256552
http://dx.doi.org/10.1155/2020/7980434
work_keys_str_mv AT kimhyejin spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning
AT parksungmin spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning
AT choibyungjin spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning
AT moonseunghyun spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning
AT kimyonghyuk spatiotemporalapproachesforqualitycontrolanderrorcorrectionofatmosphericdatathroughmachinelearning