Cargando…

Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges

Frequency-modulated continuous wave radar sensors play an essential role for assisted and autonomous driving as they are robust under all weather and light conditions. However, the rising number of transmitters and receivers for obtaining a higher angular resolution increases the cost for digital si...

Descripción completa

Detalles Bibliográficos
Autores principales: Vogginger, Bernhard, Kreutz, Felix, López-Randulfe, Javier, Liu, Chen, Dietrich, Robin, Gonzalez, Hector A., Scholz, Daniel, Reeb, Nico, Auge, Daniel, Hille, Julian, Arsalan, Muhammad, Mirus, Florian, Grassmann, Cyprian, Knoll, Alois, Mayr, Christian
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9012531/
https://www.ncbi.nlm.nih.gov/pubmed/35431782
http://dx.doi.org/10.3389/fnins.2022.851774
_version_ 1784687814716162048
author Vogginger, Bernhard
Kreutz, Felix
López-Randulfe, Javier
Liu, Chen
Dietrich, Robin
Gonzalez, Hector A.
Scholz, Daniel
Reeb, Nico
Auge, Daniel
Hille, Julian
Arsalan, Muhammad
Mirus, Florian
Grassmann, Cyprian
Knoll, Alois
Mayr, Christian
author_facet Vogginger, Bernhard
Kreutz, Felix
López-Randulfe, Javier
Liu, Chen
Dietrich, Robin
Gonzalez, Hector A.
Scholz, Daniel
Reeb, Nico
Auge, Daniel
Hille, Julian
Arsalan, Muhammad
Mirus, Florian
Grassmann, Cyprian
Knoll, Alois
Mayr, Christian
author_sort Vogginger, Bernhard
collection PubMed
description Frequency-modulated continuous wave radar sensors play an essential role for assisted and autonomous driving as they are robust under all weather and light conditions. However, the rising number of transmitters and receivers for obtaining a higher angular resolution increases the cost for digital signal processing. One promising approach for energy-efficient signal processing is the usage of brain-inspired spiking neural networks (SNNs) implemented on neuromorphic hardware. In this article we perform a step-by-step analysis of automotive radar processing and argue how spiking neural networks could replace or complement the conventional processing. We provide SNN examples for two processing steps and evaluate their accuracy and computational efficiency. For radar target detection, an SNN with temporal coding is competitive to the conventional approach at a low compute overhead. Instead, our SNN for target classification achieves an accuracy close to a reference artificial neural network while requiring 200 times less operations. Finally, we discuss the specific requirements and challenges for SNN-based radar processing on neuromorphic hardware. This study proves the general applicability of SNNs for automotive radar processing and sustains the prospect of energy-efficient realizations in automated vehicles.
format Online
Article
Text
id pubmed-9012531
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-90125312022-04-16 Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges Vogginger, Bernhard Kreutz, Felix López-Randulfe, Javier Liu, Chen Dietrich, Robin Gonzalez, Hector A. Scholz, Daniel Reeb, Nico Auge, Daniel Hille, Julian Arsalan, Muhammad Mirus, Florian Grassmann, Cyprian Knoll, Alois Mayr, Christian Front Neurosci Neuroscience Frequency-modulated continuous wave radar sensors play an essential role for assisted and autonomous driving as they are robust under all weather and light conditions. However, the rising number of transmitters and receivers for obtaining a higher angular resolution increases the cost for digital signal processing. One promising approach for energy-efficient signal processing is the usage of brain-inspired spiking neural networks (SNNs) implemented on neuromorphic hardware. In this article we perform a step-by-step analysis of automotive radar processing and argue how spiking neural networks could replace or complement the conventional processing. We provide SNN examples for two processing steps and evaluate their accuracy and computational efficiency. For radar target detection, an SNN with temporal coding is competitive to the conventional approach at a low compute overhead. Instead, our SNN for target classification achieves an accuracy close to a reference artificial neural network while requiring 200 times less operations. Finally, we discuss the specific requirements and challenges for SNN-based radar processing on neuromorphic hardware. This study proves the general applicability of SNNs for automotive radar processing and sustains the prospect of energy-efficient realizations in automated vehicles. Frontiers Media S.A. 2022-04-01 /pmc/articles/PMC9012531/ /pubmed/35431782 http://dx.doi.org/10.3389/fnins.2022.851774 Text en Copyright © 2022 Vogginger, Kreutz, López-Randulfe, Liu, Dietrich, Gonzalez, Scholz, Reeb, Auge, Hille, Arsalan, Mirus, Grassmann, Knoll and Mayr. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Vogginger, Bernhard
Kreutz, Felix
López-Randulfe, Javier
Liu, Chen
Dietrich, Robin
Gonzalez, Hector A.
Scholz, Daniel
Reeb, Nico
Auge, Daniel
Hille, Julian
Arsalan, Muhammad
Mirus, Florian
Grassmann, Cyprian
Knoll, Alois
Mayr, Christian
Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges
title Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges
title_full Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges
title_fullStr Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges
title_full_unstemmed Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges
title_short Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges
title_sort automotive radar processing with spiking neural networks: concepts and challenges
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9012531/
https://www.ncbi.nlm.nih.gov/pubmed/35431782
http://dx.doi.org/10.3389/fnins.2022.851774
work_keys_str_mv AT voggingerbernhard automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT kreutzfelix automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT lopezrandulfejavier automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT liuchen automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT dietrichrobin automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT gonzalezhectora automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT scholzdaniel automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT reebnico automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT augedaniel automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT hillejulian automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT arsalanmuhammad automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT mirusflorian automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT grassmanncyprian automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT knollalois automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges
AT mayrchristian automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges