Cargando…

Outlier Detection in Urban Air Quality Sensor Networks

Low-cost urban air quality sensor networks are increasingly used to study the spatio-temporal variability in air pollutant concentrations. Recently installed low-cost urban sensors, however, are more prone to result in erroneous data than conventional monitors, e.g., leading to outliers. Commonly ap...

Descripción completa

Detalles Bibliográficos
Autores principales: van Zoest, V. M., Stein, A., Hoek, G.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5843703/
https://www.ncbi.nlm.nih.gov/pubmed/29563652
http://dx.doi.org/10.1007/s11270-018-3756-7
_version_ 1783305121956888576
author van Zoest, V. M.
Stein, A.
Hoek, G.
author_facet van Zoest, V. M.
Stein, A.
Hoek, G.
author_sort van Zoest, V. M.
collection PubMed
description Low-cost urban air quality sensor networks are increasingly used to study the spatio-temporal variability in air pollutant concentrations. Recently installed low-cost urban sensors, however, are more prone to result in erroneous data than conventional monitors, e.g., leading to outliers. Commonly applied outlier detection methods are unsuitable for air pollutant measurements that have large spatial and temporal variations as occur in urban areas. We present a novel outlier detection method based upon a spatio-temporal classification, focusing on hourly NO(2) concentrations. We divide a full year’s observations into 16 spatio-temporal classes, reflecting urban background vs. urban traffic stations, weekdays vs. weekends, and four periods per day. For each spatio-temporal class, we detect outliers using the mean and standard deviation of the normal distribution underlying the truncated normal distribution of the NO(2) observations. Applying this method to a low-cost air quality sensor network in the city of Eindhoven, the Netherlands, we found 0.1–0.5% of outliers. Outliers could reflect measurement errors or unusual high air pollution events. Additional evaluation using expert knowledge is needed to decide on treatment of the identified outliers. We conclude that our method is able to detect outliers while maintaining the spatio-temporal variability of air pollutant concentrations in urban areas. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (10.1007/s11270-018-3756-7) contains supplementary material, which is available to authorized users.
format Online
Article
Text
id pubmed-5843703
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-58437032018-03-19 Outlier Detection in Urban Air Quality Sensor Networks van Zoest, V. M. Stein, A. Hoek, G. Water Air Soil Pollut Article Low-cost urban air quality sensor networks are increasingly used to study the spatio-temporal variability in air pollutant concentrations. Recently installed low-cost urban sensors, however, are more prone to result in erroneous data than conventional monitors, e.g., leading to outliers. Commonly applied outlier detection methods are unsuitable for air pollutant measurements that have large spatial and temporal variations as occur in urban areas. We present a novel outlier detection method based upon a spatio-temporal classification, focusing on hourly NO(2) concentrations. We divide a full year’s observations into 16 spatio-temporal classes, reflecting urban background vs. urban traffic stations, weekdays vs. weekends, and four periods per day. For each spatio-temporal class, we detect outliers using the mean and standard deviation of the normal distribution underlying the truncated normal distribution of the NO(2) observations. Applying this method to a low-cost air quality sensor network in the city of Eindhoven, the Netherlands, we found 0.1–0.5% of outliers. Outliers could reflect measurement errors or unusual high air pollution events. Additional evaluation using expert knowledge is needed to decide on treatment of the identified outliers. We conclude that our method is able to detect outliers while maintaining the spatio-temporal variability of air pollutant concentrations in urban areas. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (10.1007/s11270-018-3756-7) contains supplementary material, which is available to authorized users. Springer International Publishing 2018-03-08 2018 /pmc/articles/PMC5843703/ /pubmed/29563652 http://dx.doi.org/10.1007/s11270-018-3756-7 Text en © The Author(s) 2018 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
spellingShingle Article
van Zoest, V. M.
Stein, A.
Hoek, G.
Outlier Detection in Urban Air Quality Sensor Networks
title Outlier Detection in Urban Air Quality Sensor Networks
title_full Outlier Detection in Urban Air Quality Sensor Networks
title_fullStr Outlier Detection in Urban Air Quality Sensor Networks
title_full_unstemmed Outlier Detection in Urban Air Quality Sensor Networks
title_short Outlier Detection in Urban Air Quality Sensor Networks
title_sort outlier detection in urban air quality sensor networks
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5843703/
https://www.ncbi.nlm.nih.gov/pubmed/29563652
http://dx.doi.org/10.1007/s11270-018-3756-7
work_keys_str_mv AT vanzoestvm outlierdetectioninurbanairqualitysensornetworks
AT steina outlierdetectioninurbanairqualitysensornetworks
AT hoekg outlierdetectioninurbanairqualitysensornetworks