Cargando…

Mutual information measure of visual perception based on noisy spiking neural networks

Note that images of low-illumination are weak aperiodic signals, while mutual information can be used as an effective measure for the shared information between the input stimulus and the output response of nonlinear systems, thus it is possible to develop novel visual perception algorithm based on...

Descripción completa

Detalles Bibliográficos
Autores principales: Xu, Ziheng, Zhai, Yajie, Kang, Yanmei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10467273/
https://www.ncbi.nlm.nih.gov/pubmed/37655008
http://dx.doi.org/10.3389/fnins.2023.1155362
_version_ 1785099080189345792
author Xu, Ziheng
Zhai, Yajie
Kang, Yanmei
author_facet Xu, Ziheng
Zhai, Yajie
Kang, Yanmei
author_sort Xu, Ziheng
collection PubMed
description Note that images of low-illumination are weak aperiodic signals, while mutual information can be used as an effective measure for the shared information between the input stimulus and the output response of nonlinear systems, thus it is possible to develop novel visual perception algorithm based on the principle of aperiodic stochastic resonance within the frame of information theory. To confirm this, we reveal this phenomenon using the integrate-and-fire neural networks of neurons with noisy binary random signal as input first. And then, we propose an improved visual perception algorithm with the image mutual information as assessment index. The numerical experiences show that the target image can be picked up with more easiness by the maximal mutual information than by the minimum of natural image quality evaluation (NIQE), which is one of the most frequently used indexes. Moreover, the advantage of choosing quantile as spike threshold has also been confirmed. The improvement of this research should provide large convenience for potential applications including video tracking in environments of low illumination.
format Online
Article
Text
id pubmed-10467273
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-104672732023-08-31 Mutual information measure of visual perception based on noisy spiking neural networks Xu, Ziheng Zhai, Yajie Kang, Yanmei Front Neurosci Neuroscience Note that images of low-illumination are weak aperiodic signals, while mutual information can be used as an effective measure for the shared information between the input stimulus and the output response of nonlinear systems, thus it is possible to develop novel visual perception algorithm based on the principle of aperiodic stochastic resonance within the frame of information theory. To confirm this, we reveal this phenomenon using the integrate-and-fire neural networks of neurons with noisy binary random signal as input first. And then, we propose an improved visual perception algorithm with the image mutual information as assessment index. The numerical experiences show that the target image can be picked up with more easiness by the maximal mutual information than by the minimum of natural image quality evaluation (NIQE), which is one of the most frequently used indexes. Moreover, the advantage of choosing quantile as spike threshold has also been confirmed. The improvement of this research should provide large convenience for potential applications including video tracking in environments of low illumination. Frontiers Media S.A. 2023-08-16 /pmc/articles/PMC10467273/ /pubmed/37655008 http://dx.doi.org/10.3389/fnins.2023.1155362 Text en Copyright © 2023 Xu, Zhai and Kang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Xu, Ziheng
Zhai, Yajie
Kang, Yanmei
Mutual information measure of visual perception based on noisy spiking neural networks
title Mutual information measure of visual perception based on noisy spiking neural networks
title_full Mutual information measure of visual perception based on noisy spiking neural networks
title_fullStr Mutual information measure of visual perception based on noisy spiking neural networks
title_full_unstemmed Mutual information measure of visual perception based on noisy spiking neural networks
title_short Mutual information measure of visual perception based on noisy spiking neural networks
title_sort mutual information measure of visual perception based on noisy spiking neural networks
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10467273/
https://www.ncbi.nlm.nih.gov/pubmed/37655008
http://dx.doi.org/10.3389/fnins.2023.1155362
work_keys_str_mv AT xuziheng mutualinformationmeasureofvisualperceptionbasedonnoisyspikingneuralnetworks
AT zhaiyajie mutualinformationmeasureofvisualperceptionbasedonnoisyspikingneuralnetworks
AT kangyanmei mutualinformationmeasureofvisualperceptionbasedonnoisyspikingneuralnetworks