Cargando…
Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges
Frequency-modulated continuous wave radar sensors play an essential role for assisted and autonomous driving as they are robust under all weather and light conditions. However, the rising number of transmitters and receivers for obtaining a higher angular resolution increases the cost for digital si...
Autores principales: | , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9012531/ https://www.ncbi.nlm.nih.gov/pubmed/35431782 http://dx.doi.org/10.3389/fnins.2022.851774 |
_version_ | 1784687814716162048 |
---|---|
author | Vogginger, Bernhard Kreutz, Felix López-Randulfe, Javier Liu, Chen Dietrich, Robin Gonzalez, Hector A. Scholz, Daniel Reeb, Nico Auge, Daniel Hille, Julian Arsalan, Muhammad Mirus, Florian Grassmann, Cyprian Knoll, Alois Mayr, Christian |
author_facet | Vogginger, Bernhard Kreutz, Felix López-Randulfe, Javier Liu, Chen Dietrich, Robin Gonzalez, Hector A. Scholz, Daniel Reeb, Nico Auge, Daniel Hille, Julian Arsalan, Muhammad Mirus, Florian Grassmann, Cyprian Knoll, Alois Mayr, Christian |
author_sort | Vogginger, Bernhard |
collection | PubMed |
description | Frequency-modulated continuous wave radar sensors play an essential role for assisted and autonomous driving as they are robust under all weather and light conditions. However, the rising number of transmitters and receivers for obtaining a higher angular resolution increases the cost for digital signal processing. One promising approach for energy-efficient signal processing is the usage of brain-inspired spiking neural networks (SNNs) implemented on neuromorphic hardware. In this article we perform a step-by-step analysis of automotive radar processing and argue how spiking neural networks could replace or complement the conventional processing. We provide SNN examples for two processing steps and evaluate their accuracy and computational efficiency. For radar target detection, an SNN with temporal coding is competitive to the conventional approach at a low compute overhead. Instead, our SNN for target classification achieves an accuracy close to a reference artificial neural network while requiring 200 times less operations. Finally, we discuss the specific requirements and challenges for SNN-based radar processing on neuromorphic hardware. This study proves the general applicability of SNNs for automotive radar processing and sustains the prospect of energy-efficient realizations in automated vehicles. |
format | Online Article Text |
id | pubmed-9012531 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-90125312022-04-16 Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges Vogginger, Bernhard Kreutz, Felix López-Randulfe, Javier Liu, Chen Dietrich, Robin Gonzalez, Hector A. Scholz, Daniel Reeb, Nico Auge, Daniel Hille, Julian Arsalan, Muhammad Mirus, Florian Grassmann, Cyprian Knoll, Alois Mayr, Christian Front Neurosci Neuroscience Frequency-modulated continuous wave radar sensors play an essential role for assisted and autonomous driving as they are robust under all weather and light conditions. However, the rising number of transmitters and receivers for obtaining a higher angular resolution increases the cost for digital signal processing. One promising approach for energy-efficient signal processing is the usage of brain-inspired spiking neural networks (SNNs) implemented on neuromorphic hardware. In this article we perform a step-by-step analysis of automotive radar processing and argue how spiking neural networks could replace or complement the conventional processing. We provide SNN examples for two processing steps and evaluate their accuracy and computational efficiency. For radar target detection, an SNN with temporal coding is competitive to the conventional approach at a low compute overhead. Instead, our SNN for target classification achieves an accuracy close to a reference artificial neural network while requiring 200 times less operations. Finally, we discuss the specific requirements and challenges for SNN-based radar processing on neuromorphic hardware. This study proves the general applicability of SNNs for automotive radar processing and sustains the prospect of energy-efficient realizations in automated vehicles. Frontiers Media S.A. 2022-04-01 /pmc/articles/PMC9012531/ /pubmed/35431782 http://dx.doi.org/10.3389/fnins.2022.851774 Text en Copyright © 2022 Vogginger, Kreutz, López-Randulfe, Liu, Dietrich, Gonzalez, Scholz, Reeb, Auge, Hille, Arsalan, Mirus, Grassmann, Knoll and Mayr. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Vogginger, Bernhard Kreutz, Felix López-Randulfe, Javier Liu, Chen Dietrich, Robin Gonzalez, Hector A. Scholz, Daniel Reeb, Nico Auge, Daniel Hille, Julian Arsalan, Muhammad Mirus, Florian Grassmann, Cyprian Knoll, Alois Mayr, Christian Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges |
title | Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges |
title_full | Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges |
title_fullStr | Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges |
title_full_unstemmed | Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges |
title_short | Automotive Radar Processing With Spiking Neural Networks: Concepts and Challenges |
title_sort | automotive radar processing with spiking neural networks: concepts and challenges |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9012531/ https://www.ncbi.nlm.nih.gov/pubmed/35431782 http://dx.doi.org/10.3389/fnins.2022.851774 |
work_keys_str_mv | AT voggingerbernhard automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT kreutzfelix automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT lopezrandulfejavier automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT liuchen automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT dietrichrobin automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT gonzalezhectora automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT scholzdaniel automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT reebnico automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT augedaniel automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT hillejulian automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT arsalanmuhammad automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT mirusflorian automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT grassmanncyprian automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT knollalois automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges AT mayrchristian automotiveradarprocessingwithspikingneuralnetworksconceptsandchallenges |