Cargando…
Transferable learning on analog hardware
While analog neural network (NN) accelerators promise massive energy and time savings, an important challenge is to make them robust to static fabrication error. Present-day training methods for programmable photonic interferometer circuits, a leading analog NN platform, do not produce networks that...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
American Association for the Advancement of Science
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10337896/ https://www.ncbi.nlm.nih.gov/pubmed/37436989 http://dx.doi.org/10.1126/sciadv.adh3436 |
_version_ | 1785071514637303808 |
---|---|
author | Vadlamani, Sri Krishna Englund, Dirk Hamerly, Ryan |
author_facet | Vadlamani, Sri Krishna Englund, Dirk Hamerly, Ryan |
author_sort | Vadlamani, Sri Krishna |
collection | PubMed |
description | While analog neural network (NN) accelerators promise massive energy and time savings, an important challenge is to make them robust to static fabrication error. Present-day training methods for programmable photonic interferometer circuits, a leading analog NN platform, do not produce networks that perform well in the presence of static hardware errors. Moreover, existing hardware error correction techniques either require individual retraining of every analog NN (which is impractical in an edge setting with millions of devices), place stringent demands on component quality, or introduce hardware overhead. We solve all three problems by introducing one-time error-aware training techniques that produce robust NNs that match the performance of ideal hardware and can be exactly transferred to arbitrary highly faulty photonic NNs with hardware errors up to five times larger than present-day fabrication tolerances. |
format | Online Article Text |
id | pubmed-10337896 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | American Association for the Advancement of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-103378962023-07-13 Transferable learning on analog hardware Vadlamani, Sri Krishna Englund, Dirk Hamerly, Ryan Sci Adv Physical and Materials Sciences While analog neural network (NN) accelerators promise massive energy and time savings, an important challenge is to make them robust to static fabrication error. Present-day training methods for programmable photonic interferometer circuits, a leading analog NN platform, do not produce networks that perform well in the presence of static hardware errors. Moreover, existing hardware error correction techniques either require individual retraining of every analog NN (which is impractical in an edge setting with millions of devices), place stringent demands on component quality, or introduce hardware overhead. We solve all three problems by introducing one-time error-aware training techniques that produce robust NNs that match the performance of ideal hardware and can be exactly transferred to arbitrary highly faulty photonic NNs with hardware errors up to five times larger than present-day fabrication tolerances. American Association for the Advancement of Science 2023-07-12 /pmc/articles/PMC10337896/ /pubmed/37436989 http://dx.doi.org/10.1126/sciadv.adh3436 Text en Copyright © 2023 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC). https://creativecommons.org/licenses/by-nc/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial license (https://creativecommons.org/licenses/by-nc/4.0/) , which permits use, distribution, and reproduction in any medium, so long as the resultant use is not for commercial advantage and provided the original work is properly cited. |
spellingShingle | Physical and Materials Sciences Vadlamani, Sri Krishna Englund, Dirk Hamerly, Ryan Transferable learning on analog hardware |
title | Transferable learning on analog hardware |
title_full | Transferable learning on analog hardware |
title_fullStr | Transferable learning on analog hardware |
title_full_unstemmed | Transferable learning on analog hardware |
title_short | Transferable learning on analog hardware |
title_sort | transferable learning on analog hardware |
topic | Physical and Materials Sciences |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10337896/ https://www.ncbi.nlm.nih.gov/pubmed/37436989 http://dx.doi.org/10.1126/sciadv.adh3436 |
work_keys_str_mv | AT vadlamanisrikrishna transferablelearningonanaloghardware AT englunddirk transferablelearningonanaloghardware AT hamerlyryan transferablelearningonanaloghardware |