Cargando…
Outlier Detection in Urban Air Quality Sensor Networks
Low-cost urban air quality sensor networks are increasingly used to study the spatio-temporal variability in air pollutant concentrations. Recently installed low-cost urban sensors, however, are more prone to result in erroneous data than conventional monitors, e.g., leading to outliers. Commonly ap...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer International Publishing
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5843703/ https://www.ncbi.nlm.nih.gov/pubmed/29563652 http://dx.doi.org/10.1007/s11270-018-3756-7 |
_version_ | 1783305121956888576 |
---|---|
author | van Zoest, V. M. Stein, A. Hoek, G. |
author_facet | van Zoest, V. M. Stein, A. Hoek, G. |
author_sort | van Zoest, V. M. |
collection | PubMed |
description | Low-cost urban air quality sensor networks are increasingly used to study the spatio-temporal variability in air pollutant concentrations. Recently installed low-cost urban sensors, however, are more prone to result in erroneous data than conventional monitors, e.g., leading to outliers. Commonly applied outlier detection methods are unsuitable for air pollutant measurements that have large spatial and temporal variations as occur in urban areas. We present a novel outlier detection method based upon a spatio-temporal classification, focusing on hourly NO(2) concentrations. We divide a full year’s observations into 16 spatio-temporal classes, reflecting urban background vs. urban traffic stations, weekdays vs. weekends, and four periods per day. For each spatio-temporal class, we detect outliers using the mean and standard deviation of the normal distribution underlying the truncated normal distribution of the NO(2) observations. Applying this method to a low-cost air quality sensor network in the city of Eindhoven, the Netherlands, we found 0.1–0.5% of outliers. Outliers could reflect measurement errors or unusual high air pollution events. Additional evaluation using expert knowledge is needed to decide on treatment of the identified outliers. We conclude that our method is able to detect outliers while maintaining the spatio-temporal variability of air pollutant concentrations in urban areas. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (10.1007/s11270-018-3756-7) contains supplementary material, which is available to authorized users. |
format | Online Article Text |
id | pubmed-5843703 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Springer International Publishing |
record_format | MEDLINE/PubMed |
spelling | pubmed-58437032018-03-19 Outlier Detection in Urban Air Quality Sensor Networks van Zoest, V. M. Stein, A. Hoek, G. Water Air Soil Pollut Article Low-cost urban air quality sensor networks are increasingly used to study the spatio-temporal variability in air pollutant concentrations. Recently installed low-cost urban sensors, however, are more prone to result in erroneous data than conventional monitors, e.g., leading to outliers. Commonly applied outlier detection methods are unsuitable for air pollutant measurements that have large spatial and temporal variations as occur in urban areas. We present a novel outlier detection method based upon a spatio-temporal classification, focusing on hourly NO(2) concentrations. We divide a full year’s observations into 16 spatio-temporal classes, reflecting urban background vs. urban traffic stations, weekdays vs. weekends, and four periods per day. For each spatio-temporal class, we detect outliers using the mean and standard deviation of the normal distribution underlying the truncated normal distribution of the NO(2) observations. Applying this method to a low-cost air quality sensor network in the city of Eindhoven, the Netherlands, we found 0.1–0.5% of outliers. Outliers could reflect measurement errors or unusual high air pollution events. Additional evaluation using expert knowledge is needed to decide on treatment of the identified outliers. We conclude that our method is able to detect outliers while maintaining the spatio-temporal variability of air pollutant concentrations in urban areas. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (10.1007/s11270-018-3756-7) contains supplementary material, which is available to authorized users. Springer International Publishing 2018-03-08 2018 /pmc/articles/PMC5843703/ /pubmed/29563652 http://dx.doi.org/10.1007/s11270-018-3756-7 Text en © The Author(s) 2018 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. |
spellingShingle | Article van Zoest, V. M. Stein, A. Hoek, G. Outlier Detection in Urban Air Quality Sensor Networks |
title | Outlier Detection in Urban Air Quality Sensor Networks |
title_full | Outlier Detection in Urban Air Quality Sensor Networks |
title_fullStr | Outlier Detection in Urban Air Quality Sensor Networks |
title_full_unstemmed | Outlier Detection in Urban Air Quality Sensor Networks |
title_short | Outlier Detection in Urban Air Quality Sensor Networks |
title_sort | outlier detection in urban air quality sensor networks |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5843703/ https://www.ncbi.nlm.nih.gov/pubmed/29563652 http://dx.doi.org/10.1007/s11270-018-3756-7 |
work_keys_str_mv | AT vanzoestvm outlierdetectioninurbanairqualitysensornetworks AT steina outlierdetectioninurbanairqualitysensornetworks AT hoekg outlierdetectioninurbanairqualitysensornetworks |