Cargando…

Comparison of Three Methodologies for Removal of Random‐Noise‐Induced Biases From Second‐Order Statistical Parameters of Lidar and Radar Measurements

Random‐noise‐induced biases are inherent issues to the accurate derivation of second‐order statistical parameters (e.g., variances, fluxes, energy densities, and power spectra) from lidar and radar measurements. We demonstrate here for the first time an altitude‐interleaved method for eliminating su...

Descripción completa

Detalles Bibliográficos
Autores principales: Jandreau, Jackson, Chu, Xinzhao
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9286857/
https://www.ncbi.nlm.nih.gov/pubmed/35865261
http://dx.doi.org/10.1029/2021EA002073
_version_ 1784748113727062016
author Jandreau, Jackson
Chu, Xinzhao
author_facet Jandreau, Jackson
Chu, Xinzhao
author_sort Jandreau, Jackson
collection PubMed
description Random‐noise‐induced biases are inherent issues to the accurate derivation of second‐order statistical parameters (e.g., variances, fluxes, energy densities, and power spectra) from lidar and radar measurements. We demonstrate here for the first time an altitude‐interleaved method for eliminating such biases, following the original proposals by Gardner and Chu (2020, https://doi.org/10.1364/ao.400375) who demonstrated a time‐interleaved method. Interleaving in altitude bins provides two statistically independent samples over the same time period and nearly the same altitude range, thus enabling the replacement of variances that include the noise‐induced biases with covariances that are intrinsically free of such biases. Comparing the interleaved method with previous variance subtraction (VS) and spectral proportion (SP) methods using gravity wave potential energy density calculated from Antarctic lidar data and from a forward model, this study finds the accuracy and precision of each method differing in various conditions, each with its own strengths and weakness. VS performs well in high‐SNR, yet its accuracy fails at lower‐SNR as it often yields negative values. SP is accurate and precise under high‐SNR, remaining accurate in worse conditions than VS would, yet develops a positive bias under low‐SNR. The interleaved method is accurate in all SNRs but requires a large number of samples to drive random‐noise terms in covariances toward zero and to compensate for the reduced precision due to the splitting of return signals. Therefore, selecting the proper bias removal/elimination method for actual signal and sample conditions is crucial in utilizing lidar/radar data, as neglecting this can conceal trends or overstate atmospheric variability.
format Online
Article
Text
id pubmed-9286857
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-92868572022-07-19 Comparison of Three Methodologies for Removal of Random‐Noise‐Induced Biases From Second‐Order Statistical Parameters of Lidar and Radar Measurements Jandreau, Jackson Chu, Xinzhao Earth Space Sci Research Article Random‐noise‐induced biases are inherent issues to the accurate derivation of second‐order statistical parameters (e.g., variances, fluxes, energy densities, and power spectra) from lidar and radar measurements. We demonstrate here for the first time an altitude‐interleaved method for eliminating such biases, following the original proposals by Gardner and Chu (2020, https://doi.org/10.1364/ao.400375) who demonstrated a time‐interleaved method. Interleaving in altitude bins provides two statistically independent samples over the same time period and nearly the same altitude range, thus enabling the replacement of variances that include the noise‐induced biases with covariances that are intrinsically free of such biases. Comparing the interleaved method with previous variance subtraction (VS) and spectral proportion (SP) methods using gravity wave potential energy density calculated from Antarctic lidar data and from a forward model, this study finds the accuracy and precision of each method differing in various conditions, each with its own strengths and weakness. VS performs well in high‐SNR, yet its accuracy fails at lower‐SNR as it often yields negative values. SP is accurate and precise under high‐SNR, remaining accurate in worse conditions than VS would, yet develops a positive bias under low‐SNR. The interleaved method is accurate in all SNRs but requires a large number of samples to drive random‐noise terms in covariances toward zero and to compensate for the reduced precision due to the splitting of return signals. Therefore, selecting the proper bias removal/elimination method for actual signal and sample conditions is crucial in utilizing lidar/radar data, as neglecting this can conceal trends or overstate atmospheric variability. John Wiley and Sons Inc. 2021-12-30 2022-01 /pmc/articles/PMC9286857/ /pubmed/35865261 http://dx.doi.org/10.1029/2021EA002073 Text en © 2021 The Authors. Earth and Space Science published by Wiley Periodicals LLC on behalf of American Geophysical Union. https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Jandreau, Jackson
Chu, Xinzhao
Comparison of Three Methodologies for Removal of Random‐Noise‐Induced Biases From Second‐Order Statistical Parameters of Lidar and Radar Measurements
title Comparison of Three Methodologies for Removal of Random‐Noise‐Induced Biases From Second‐Order Statistical Parameters of Lidar and Radar Measurements
title_full Comparison of Three Methodologies for Removal of Random‐Noise‐Induced Biases From Second‐Order Statistical Parameters of Lidar and Radar Measurements
title_fullStr Comparison of Three Methodologies for Removal of Random‐Noise‐Induced Biases From Second‐Order Statistical Parameters of Lidar and Radar Measurements
title_full_unstemmed Comparison of Three Methodologies for Removal of Random‐Noise‐Induced Biases From Second‐Order Statistical Parameters of Lidar and Radar Measurements
title_short Comparison of Three Methodologies for Removal of Random‐Noise‐Induced Biases From Second‐Order Statistical Parameters of Lidar and Radar Measurements
title_sort comparison of three methodologies for removal of random‐noise‐induced biases from second‐order statistical parameters of lidar and radar measurements
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9286857/
https://www.ncbi.nlm.nih.gov/pubmed/35865261
http://dx.doi.org/10.1029/2021EA002073
work_keys_str_mv AT jandreaujackson comparisonofthreemethodologiesforremovalofrandomnoiseinducedbiasesfromsecondorderstatisticalparametersoflidarandradarmeasurements
AT chuxinzhao comparisonofthreemethodologiesforremovalofrandomnoiseinducedbiasesfromsecondorderstatisticalparametersoflidarandradarmeasurements