Cargando…

Wave physics as an analog recurrent neural network

Analog machine learning hardware platforms promise to be faster and more energy efficient than their digital counterparts. Wave physics, as found in acoustics and optics, is a natural candidate for building analog processors for time-varying signals. Here, we identify a mapping between the dynamics...

Descripción completa

Detalles Bibliográficos
Autores principales: Hughes, Tyler W., Williamson, Ian A. D., Minkov, Momchil, Fan, Shanhui
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Association for the Advancement of Science 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6924985/
https://www.ncbi.nlm.nih.gov/pubmed/31903420
http://dx.doi.org/10.1126/sciadv.aay6946
_version_ 1783481829221728256
author Hughes, Tyler W.
Williamson, Ian A. D.
Minkov, Momchil
Fan, Shanhui
author_facet Hughes, Tyler W.
Williamson, Ian A. D.
Minkov, Momchil
Fan, Shanhui
author_sort Hughes, Tyler W.
collection PubMed
description Analog machine learning hardware platforms promise to be faster and more energy efficient than their digital counterparts. Wave physics, as found in acoustics and optics, is a natural candidate for building analog processors for time-varying signals. Here, we identify a mapping between the dynamics of wave physics and the computation in recurrent neural networks. This mapping indicates that physical wave systems can be trained to learn complex features in temporal data, using standard training techniques for neural networks. As a demonstration, we show that an inverse-designed inhomogeneous medium can perform vowel classification on raw audio signals as their waveforms scatter and propagate through it, achieving performance comparable to a standard digital implementation of a recurrent neural network. These findings pave the way for a new class of analog machine learning platforms, capable of fast and efficient processing of information in its native domain.
format Online
Article
Text
id pubmed-6924985
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher American Association for the Advancement of Science
record_format MEDLINE/PubMed
spelling pubmed-69249852020-01-03 Wave physics as an analog recurrent neural network Hughes, Tyler W. Williamson, Ian A. D. Minkov, Momchil Fan, Shanhui Sci Adv Research Articles Analog machine learning hardware platforms promise to be faster and more energy efficient than their digital counterparts. Wave physics, as found in acoustics and optics, is a natural candidate for building analog processors for time-varying signals. Here, we identify a mapping between the dynamics of wave physics and the computation in recurrent neural networks. This mapping indicates that physical wave systems can be trained to learn complex features in temporal data, using standard training techniques for neural networks. As a demonstration, we show that an inverse-designed inhomogeneous medium can perform vowel classification on raw audio signals as their waveforms scatter and propagate through it, achieving performance comparable to a standard digital implementation of a recurrent neural network. These findings pave the way for a new class of analog machine learning platforms, capable of fast and efficient processing of information in its native domain. American Association for the Advancement of Science 2019-12-20 /pmc/articles/PMC6924985/ /pubmed/31903420 http://dx.doi.org/10.1126/sciadv.aay6946 Text en Copyright © 2019 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC). http://creativecommons.org/licenses/by-nc/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial license (http://creativecommons.org/licenses/by-nc/4.0/) , which permits use, distribution, and reproduction in any medium, so long as the resultant use is not for commercial advantage and provided the original work is properly cited.
spellingShingle Research Articles
Hughes, Tyler W.
Williamson, Ian A. D.
Minkov, Momchil
Fan, Shanhui
Wave physics as an analog recurrent neural network
title Wave physics as an analog recurrent neural network
title_full Wave physics as an analog recurrent neural network
title_fullStr Wave physics as an analog recurrent neural network
title_full_unstemmed Wave physics as an analog recurrent neural network
title_short Wave physics as an analog recurrent neural network
title_sort wave physics as an analog recurrent neural network
topic Research Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6924985/
https://www.ncbi.nlm.nih.gov/pubmed/31903420
http://dx.doi.org/10.1126/sciadv.aay6946
work_keys_str_mv AT hughestylerw wavephysicsasananalogrecurrentneuralnetwork
AT williamsonianad wavephysicsasananalogrecurrentneuralnetwork
AT minkovmomchil wavephysicsasananalogrecurrentneuralnetwork
AT fanshanhui wavephysicsasananalogrecurrentneuralnetwork