Cargando…

CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection

Salient object-detection models attempt to mimic the human visual system’s ability to select relevant objects in images. To this end, the development of deep neural networks on high-end computers has recently achieved high performance. However, developing deep neural network models with the same per...

Descripción completa

Detalles Bibliográficos
Autores principales: Ndayikengurukiye, Didier, Mignotte, Max
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10386563/
https://www.ncbi.nlm.nih.gov/pubmed/37514744
http://dx.doi.org/10.3390/s23146450
_version_ 1785081698214477824
author Ndayikengurukiye, Didier
Mignotte, Max
author_facet Ndayikengurukiye, Didier
Mignotte, Max
author_sort Ndayikengurukiye, Didier
collection PubMed
description Salient object-detection models attempt to mimic the human visual system’s ability to select relevant objects in images. To this end, the development of deep neural networks on high-end computers has recently achieved high performance. However, developing deep neural network models with the same performance for resource-limited vision sensors or mobile devices remains a challenge. In this work, we propose CoSOV1net, a novel lightweight salient object-detection neural network model, inspired by the cone- and spatial-opponent processes of the primary visual cortex (V1), which inextricably link color and shape in human color perception. Our proposed model is trained from scratch, without using backbones from image classification or other tasks. Experiments on the most widely used and challenging datasets for salient object detection show that CoSOV1Net achieves competitive performance (i.e., [Formula: see text] on the ECSSD dataset) with state-of-the-art salient object-detection models while having a low number of parameters ([Formula: see text] M), low FLOPS ([Formula: see text] G) and high FPS ([Formula: see text]) on GPU (Nvidia GeForce RTX 3090 Ti) compared to the state of the art in lightweight or nonlightweight salient object-detection tasks. Thus, CoSOV1net has turned out to be a lightweight salient object-detection model that can be adapted to mobile environments and resource-constrained devices.
format Online
Article
Text
id pubmed-10386563
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-103865632023-07-30 CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection Ndayikengurukiye, Didier Mignotte, Max Sensors (Basel) Article Salient object-detection models attempt to mimic the human visual system’s ability to select relevant objects in images. To this end, the development of deep neural networks on high-end computers has recently achieved high performance. However, developing deep neural network models with the same performance for resource-limited vision sensors or mobile devices remains a challenge. In this work, we propose CoSOV1net, a novel lightweight salient object-detection neural network model, inspired by the cone- and spatial-opponent processes of the primary visual cortex (V1), which inextricably link color and shape in human color perception. Our proposed model is trained from scratch, without using backbones from image classification or other tasks. Experiments on the most widely used and challenging datasets for salient object detection show that CoSOV1Net achieves competitive performance (i.e., [Formula: see text] on the ECSSD dataset) with state-of-the-art salient object-detection models while having a low number of parameters ([Formula: see text] M), low FLOPS ([Formula: see text] G) and high FPS ([Formula: see text]) on GPU (Nvidia GeForce RTX 3090 Ti) compared to the state of the art in lightweight or nonlightweight salient object-detection tasks. Thus, CoSOV1net has turned out to be a lightweight salient object-detection model that can be adapted to mobile environments and resource-constrained devices. MDPI 2023-07-17 /pmc/articles/PMC10386563/ /pubmed/37514744 http://dx.doi.org/10.3390/s23146450 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Ndayikengurukiye, Didier
Mignotte, Max
CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection
title CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection
title_full CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection
title_fullStr CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection
title_full_unstemmed CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection
title_short CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection
title_sort cosov1net: a cone- and spatial-opponent primary visual cortex-inspired neural network for lightweight salient object detection
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10386563/
https://www.ncbi.nlm.nih.gov/pubmed/37514744
http://dx.doi.org/10.3390/s23146450
work_keys_str_mv AT ndayikengurukiyedidier cosov1netaconeandspatialopponentprimaryvisualcortexinspiredneuralnetworkforlightweightsalientobjectdetection
AT mignottemax cosov1netaconeandspatialopponentprimaryvisualcortexinspiredneuralnetworkforlightweightsalientobjectdetection