Cargando…

Transferable learning on analog hardware

While analog neural network (NN) accelerators promise massive energy and time savings, an important challenge is to make them robust to static fabrication error. Present-day training methods for programmable photonic interferometer circuits, a leading analog NN platform, do not produce networks that...

Descripción completa

Detalles Bibliográficos
Autores principales: Vadlamani, Sri Krishna, Englund, Dirk, Hamerly, Ryan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Association for the Advancement of Science 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10337896/
https://www.ncbi.nlm.nih.gov/pubmed/37436989
http://dx.doi.org/10.1126/sciadv.adh3436
_version_ 1785071514637303808
author Vadlamani, Sri Krishna
Englund, Dirk
Hamerly, Ryan
author_facet Vadlamani, Sri Krishna
Englund, Dirk
Hamerly, Ryan
author_sort Vadlamani, Sri Krishna
collection PubMed
description While analog neural network (NN) accelerators promise massive energy and time savings, an important challenge is to make them robust to static fabrication error. Present-day training methods for programmable photonic interferometer circuits, a leading analog NN platform, do not produce networks that perform well in the presence of static hardware errors. Moreover, existing hardware error correction techniques either require individual retraining of every analog NN (which is impractical in an edge setting with millions of devices), place stringent demands on component quality, or introduce hardware overhead. We solve all three problems by introducing one-time error-aware training techniques that produce robust NNs that match the performance of ideal hardware and can be exactly transferred to arbitrary highly faulty photonic NNs with hardware errors up to five times larger than present-day fabrication tolerances.
format Online
Article
Text
id pubmed-10337896
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher American Association for the Advancement of Science
record_format MEDLINE/PubMed
spelling pubmed-103378962023-07-13 Transferable learning on analog hardware Vadlamani, Sri Krishna Englund, Dirk Hamerly, Ryan Sci Adv Physical and Materials Sciences While analog neural network (NN) accelerators promise massive energy and time savings, an important challenge is to make them robust to static fabrication error. Present-day training methods for programmable photonic interferometer circuits, a leading analog NN platform, do not produce networks that perform well in the presence of static hardware errors. Moreover, existing hardware error correction techniques either require individual retraining of every analog NN (which is impractical in an edge setting with millions of devices), place stringent demands on component quality, or introduce hardware overhead. We solve all three problems by introducing one-time error-aware training techniques that produce robust NNs that match the performance of ideal hardware and can be exactly transferred to arbitrary highly faulty photonic NNs with hardware errors up to five times larger than present-day fabrication tolerances. American Association for the Advancement of Science 2023-07-12 /pmc/articles/PMC10337896/ /pubmed/37436989 http://dx.doi.org/10.1126/sciadv.adh3436 Text en Copyright © 2023 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC). https://creativecommons.org/licenses/by-nc/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial license (https://creativecommons.org/licenses/by-nc/4.0/) , which permits use, distribution, and reproduction in any medium, so long as the resultant use is not for commercial advantage and provided the original work is properly cited.
spellingShingle Physical and Materials Sciences
Vadlamani, Sri Krishna
Englund, Dirk
Hamerly, Ryan
Transferable learning on analog hardware
title Transferable learning on analog hardware
title_full Transferable learning on analog hardware
title_fullStr Transferable learning on analog hardware
title_full_unstemmed Transferable learning on analog hardware
title_short Transferable learning on analog hardware
title_sort transferable learning on analog hardware
topic Physical and Materials Sciences
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10337896/
https://www.ncbi.nlm.nih.gov/pubmed/37436989
http://dx.doi.org/10.1126/sciadv.adh3436
work_keys_str_mv AT vadlamanisrikrishna transferablelearningonanaloghardware
AT englunddirk transferablelearningonanaloghardware
AT hamerlyryan transferablelearningonanaloghardware