Cargando…
CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection
Salient object-detection models attempt to mimic the human visual system’s ability to select relevant objects in images. To this end, the development of deep neural networks on high-end computers has recently achieved high performance. However, developing deep neural network models with the same per...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10386563/ https://www.ncbi.nlm.nih.gov/pubmed/37514744 http://dx.doi.org/10.3390/s23146450 |
_version_ | 1785081698214477824 |
---|---|
author | Ndayikengurukiye, Didier Mignotte, Max |
author_facet | Ndayikengurukiye, Didier Mignotte, Max |
author_sort | Ndayikengurukiye, Didier |
collection | PubMed |
description | Salient object-detection models attempt to mimic the human visual system’s ability to select relevant objects in images. To this end, the development of deep neural networks on high-end computers has recently achieved high performance. However, developing deep neural network models with the same performance for resource-limited vision sensors or mobile devices remains a challenge. In this work, we propose CoSOV1net, a novel lightweight salient object-detection neural network model, inspired by the cone- and spatial-opponent processes of the primary visual cortex (V1), which inextricably link color and shape in human color perception. Our proposed model is trained from scratch, without using backbones from image classification or other tasks. Experiments on the most widely used and challenging datasets for salient object detection show that CoSOV1Net achieves competitive performance (i.e., [Formula: see text] on the ECSSD dataset) with state-of-the-art salient object-detection models while having a low number of parameters ([Formula: see text] M), low FLOPS ([Formula: see text] G) and high FPS ([Formula: see text]) on GPU (Nvidia GeForce RTX 3090 Ti) compared to the state of the art in lightweight or nonlightweight salient object-detection tasks. Thus, CoSOV1net has turned out to be a lightweight salient object-detection model that can be adapted to mobile environments and resource-constrained devices. |
format | Online Article Text |
id | pubmed-10386563 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-103865632023-07-30 CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection Ndayikengurukiye, Didier Mignotte, Max Sensors (Basel) Article Salient object-detection models attempt to mimic the human visual system’s ability to select relevant objects in images. To this end, the development of deep neural networks on high-end computers has recently achieved high performance. However, developing deep neural network models with the same performance for resource-limited vision sensors or mobile devices remains a challenge. In this work, we propose CoSOV1net, a novel lightweight salient object-detection neural network model, inspired by the cone- and spatial-opponent processes of the primary visual cortex (V1), which inextricably link color and shape in human color perception. Our proposed model is trained from scratch, without using backbones from image classification or other tasks. Experiments on the most widely used and challenging datasets for salient object detection show that CoSOV1Net achieves competitive performance (i.e., [Formula: see text] on the ECSSD dataset) with state-of-the-art salient object-detection models while having a low number of parameters ([Formula: see text] M), low FLOPS ([Formula: see text] G) and high FPS ([Formula: see text]) on GPU (Nvidia GeForce RTX 3090 Ti) compared to the state of the art in lightweight or nonlightweight salient object-detection tasks. Thus, CoSOV1net has turned out to be a lightweight salient object-detection model that can be adapted to mobile environments and resource-constrained devices. MDPI 2023-07-17 /pmc/articles/PMC10386563/ /pubmed/37514744 http://dx.doi.org/10.3390/s23146450 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Ndayikengurukiye, Didier Mignotte, Max CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection |
title | CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection |
title_full | CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection |
title_fullStr | CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection |
title_full_unstemmed | CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection |
title_short | CoSOV1Net: A Cone- and Spatial-Opponent Primary Visual Cortex-Inspired Neural Network for Lightweight Salient Object Detection |
title_sort | cosov1net: a cone- and spatial-opponent primary visual cortex-inspired neural network for lightweight salient object detection |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10386563/ https://www.ncbi.nlm.nih.gov/pubmed/37514744 http://dx.doi.org/10.3390/s23146450 |
work_keys_str_mv | AT ndayikengurukiyedidier cosov1netaconeandspatialopponentprimaryvisualcortexinspiredneuralnetworkforlightweightsalientobjectdetection AT mignottemax cosov1netaconeandspatialopponentprimaryvisualcortexinspiredneuralnetworkforlightweightsalientobjectdetection |