Cargando…

A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter

When using ultraviolet-visible spectroscopy (UV-visible spectroscopy) to detect water quality parameters, the measured absorption spectrum signal often contains a lot of interference information. Therefore, denoising is extremely important in spectrum data processing and analysis, which directly aff...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Jingwei, Tong, Yifei, Guan, Li, Wu, Shaofeng, Li, Dongbo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Royal Society of Chemistry 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9078568/
https://www.ncbi.nlm.nih.gov/pubmed/35539871
http://dx.doi.org/10.1039/c7ra13202f
_version_ 1784702362149978112
author Li, Jingwei
Tong, Yifei
Guan, Li
Wu, Shaofeng
Li, Dongbo
author_facet Li, Jingwei
Tong, Yifei
Guan, Li
Wu, Shaofeng
Li, Dongbo
author_sort Li, Jingwei
collection PubMed
description When using ultraviolet-visible spectroscopy (UV-visible spectroscopy) to detect water quality parameters, the measured absorption spectrum signal often contains a lot of interference information. Therefore, denoising is extremely important in spectrum data processing and analysis, which directly affects the subsequent quantitative analysis and information mining. Choosing an appropriate denoising method is key to improve the spectral analysis accuracy and promote the spectral analysis ability. In this paper, a new UV-visible absorption spectrum denoising method is proposed: a denoising method based on ensemble empirical mode decomposition (EEMD) and improved universal threshold filtering (EEMD-based method). The noisy UV-visible absorption spectrum signal is firstly decomposed into a finite set of band limited signals called intrinsic mode functions (IMFs) via EEMD. Spearman's rank correlation coefficient (Spearman's rho) is then used as a criterion for the IMFs dominated by noise or useful signals, and the improved universal threshold filtering method is applied to the noise dominant IMFs to eliminate the noise. Finally, the denoised UV-visible absorption spectrum signal is reconstructed. In order to discuss the effectiveness of the EEMD-based denoising method proposed in this paper, we compare it with various wavelet-based threshold denoising methods. Both methods have been implemented on synthetic signals with diverse waveforms (‘Blocks’, ‘Bumps’ and ‘Heavy sine’). It is demonstrated that the proposed method outperforms the wavelet-based methods. Then, the measured UV-visible absorption spectra with different SNR were denoised by the wavelet and proposed methods. The method proposed also performs well in the spectrum denoising experiment.
format Online
Article
Text
id pubmed-9078568
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher The Royal Society of Chemistry
record_format MEDLINE/PubMed
spelling pubmed-90785682022-05-09 A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter Li, Jingwei Tong, Yifei Guan, Li Wu, Shaofeng Li, Dongbo RSC Adv Chemistry When using ultraviolet-visible spectroscopy (UV-visible spectroscopy) to detect water quality parameters, the measured absorption spectrum signal often contains a lot of interference information. Therefore, denoising is extremely important in spectrum data processing and analysis, which directly affects the subsequent quantitative analysis and information mining. Choosing an appropriate denoising method is key to improve the spectral analysis accuracy and promote the spectral analysis ability. In this paper, a new UV-visible absorption spectrum denoising method is proposed: a denoising method based on ensemble empirical mode decomposition (EEMD) and improved universal threshold filtering (EEMD-based method). The noisy UV-visible absorption spectrum signal is firstly decomposed into a finite set of band limited signals called intrinsic mode functions (IMFs) via EEMD. Spearman's rank correlation coefficient (Spearman's rho) is then used as a criterion for the IMFs dominated by noise or useful signals, and the improved universal threshold filtering method is applied to the noise dominant IMFs to eliminate the noise. Finally, the denoised UV-visible absorption spectrum signal is reconstructed. In order to discuss the effectiveness of the EEMD-based denoising method proposed in this paper, we compare it with various wavelet-based threshold denoising methods. Both methods have been implemented on synthetic signals with diverse waveforms (‘Blocks’, ‘Bumps’ and ‘Heavy sine’). It is demonstrated that the proposed method outperforms the wavelet-based methods. Then, the measured UV-visible absorption spectra with different SNR were denoised by the wavelet and proposed methods. The method proposed also performs well in the spectrum denoising experiment. The Royal Society of Chemistry 2018-02-23 /pmc/articles/PMC9078568/ /pubmed/35539871 http://dx.doi.org/10.1039/c7ra13202f Text en This journal is © The Royal Society of Chemistry https://creativecommons.org/licenses/by-nc/3.0/
spellingShingle Chemistry
Li, Jingwei
Tong, Yifei
Guan, Li
Wu, Shaofeng
Li, Dongbo
A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter
title A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter
title_full A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter
title_fullStr A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter
title_full_unstemmed A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter
title_short A UV-visible absorption spectrum denoising method based on EEMD and an improved universal threshold filter
title_sort uv-visible absorption spectrum denoising method based on eemd and an improved universal threshold filter
topic Chemistry
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9078568/
https://www.ncbi.nlm.nih.gov/pubmed/35539871
http://dx.doi.org/10.1039/c7ra13202f
work_keys_str_mv AT lijingwei auvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter
AT tongyifei auvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter
AT guanli auvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter
AT wushaofeng auvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter
AT lidongbo auvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter
AT lijingwei uvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter
AT tongyifei uvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter
AT guanli uvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter
AT wushaofeng uvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter
AT lidongbo uvvisibleabsorptionspectrumdenoisingmethodbasedoneemdandanimproveduniversalthresholdfilter