Cargando…

Visualization and Object Detection Based on Event Information

A dynamic vision sensor is an optical sensor that focuses on dynamic changes and outputs event information containing only position, time, and polarity. It has the advantages of high temporal resolution, high dynamic range, low data volume, and low power consumption. However, a single event can only...

Descripción completa

Detalles Bibliográficos
Autores principales: Fang, Yinghong, Piao, Yongjie, Xie, Xiaoguang, Li, Miao, Li, Xiaodong, Ji, Haolin, Xu, Wei, Gao, Tan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9962390/
https://www.ncbi.nlm.nih.gov/pubmed/36850443
http://dx.doi.org/10.3390/s23041839
_version_ 1784895992677531648
author Fang, Yinghong
Piao, Yongjie
Xie, Xiaoguang
Li, Miao
Li, Xiaodong
Ji, Haolin
Xu, Wei
Gao, Tan
author_facet Fang, Yinghong
Piao, Yongjie
Xie, Xiaoguang
Li, Miao
Li, Xiaodong
Ji, Haolin
Xu, Wei
Gao, Tan
author_sort Fang, Yinghong
collection PubMed
description A dynamic vision sensor is an optical sensor that focuses on dynamic changes and outputs event information containing only position, time, and polarity. It has the advantages of high temporal resolution, high dynamic range, low data volume, and low power consumption. However, a single event can only indicate that the increase or decrease in light exceeds the threshold at a certain pixel position and a certain moment. In order to further study the ability and characteristics of event information to represent targets, this paper proposes an event information visualization method with adaptive temporal resolution. Compared with methods with constant time intervals and a constant number of events, it can better convert event information into pseudo-frame images. Additionally, in order to explore whether the pseudo-frame image can efficiently complete the task of target detection according to its characteristics, this paper designs a target detection network named YOLOE. Compared with other algorithms, it has a more balanced detection effect. By constructing a dataset and conducting experimental verification, the detection accuracy of the image obtained by the event information visualization method with adaptive temporal resolution was 5.11% and 4.74% higher than that obtained using methods with a constant time interval and number of events, respectively. The average detection accuracy of pseudo-frame images in the YOLOE network designed in this paper is 85.11%, and the number of detection frames per second is 109. Therefore, the effectiveness of the proposed visualization method and the good performance of the designed detection network are verified.
format Online
Article
Text
id pubmed-9962390
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-99623902023-02-26 Visualization and Object Detection Based on Event Information Fang, Yinghong Piao, Yongjie Xie, Xiaoguang Li, Miao Li, Xiaodong Ji, Haolin Xu, Wei Gao, Tan Sensors (Basel) Article A dynamic vision sensor is an optical sensor that focuses on dynamic changes and outputs event information containing only position, time, and polarity. It has the advantages of high temporal resolution, high dynamic range, low data volume, and low power consumption. However, a single event can only indicate that the increase or decrease in light exceeds the threshold at a certain pixel position and a certain moment. In order to further study the ability and characteristics of event information to represent targets, this paper proposes an event information visualization method with adaptive temporal resolution. Compared with methods with constant time intervals and a constant number of events, it can better convert event information into pseudo-frame images. Additionally, in order to explore whether the pseudo-frame image can efficiently complete the task of target detection according to its characteristics, this paper designs a target detection network named YOLOE. Compared with other algorithms, it has a more balanced detection effect. By constructing a dataset and conducting experimental verification, the detection accuracy of the image obtained by the event information visualization method with adaptive temporal resolution was 5.11% and 4.74% higher than that obtained using methods with a constant time interval and number of events, respectively. The average detection accuracy of pseudo-frame images in the YOLOE network designed in this paper is 85.11%, and the number of detection frames per second is 109. Therefore, the effectiveness of the proposed visualization method and the good performance of the designed detection network are verified. MDPI 2023-02-07 /pmc/articles/PMC9962390/ /pubmed/36850443 http://dx.doi.org/10.3390/s23041839 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Fang, Yinghong
Piao, Yongjie
Xie, Xiaoguang
Li, Miao
Li, Xiaodong
Ji, Haolin
Xu, Wei
Gao, Tan
Visualization and Object Detection Based on Event Information
title Visualization and Object Detection Based on Event Information
title_full Visualization and Object Detection Based on Event Information
title_fullStr Visualization and Object Detection Based on Event Information
title_full_unstemmed Visualization and Object Detection Based on Event Information
title_short Visualization and Object Detection Based on Event Information
title_sort visualization and object detection based on event information
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9962390/
https://www.ncbi.nlm.nih.gov/pubmed/36850443
http://dx.doi.org/10.3390/s23041839
work_keys_str_mv AT fangyinghong visualizationandobjectdetectionbasedoneventinformation
AT piaoyongjie visualizationandobjectdetectionbasedoneventinformation
AT xiexiaoguang visualizationandobjectdetectionbasedoneventinformation
AT limiao visualizationandobjectdetectionbasedoneventinformation
AT lixiaodong visualizationandobjectdetectionbasedoneventinformation
AT jihaolin visualizationandobjectdetectionbasedoneventinformation
AT xuwei visualizationandobjectdetectionbasedoneventinformation
AT gaotan visualizationandobjectdetectionbasedoneventinformation