Cargando…

Material to system-level benchmarking of CMOS-integrated RRAM with ultra-fast switching for low power on-chip learning

Analog hardware-based training provides a promising solution to developing state-of-the-art power-hungry artificial intelligence models. Non-volatile memory hardware such as resistive random access memory (RRAM) has the potential to provide a low power alternative. The training accuracy of analog ha...

Descripción completa

Detalles Bibliográficos
Autores principales: Abedin, Minhaz, Gong, Nanbo, Beckmann, Karsten, Liehr, Maximilian, Saraf, Iqbal, Van der Straten, Oscar, Ando, Takashi, Cady, Nathaniel
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10495451/
https://www.ncbi.nlm.nih.gov/pubmed/37697024
http://dx.doi.org/10.1038/s41598-023-42214-x
_version_ 1785104898852913152
author Abedin, Minhaz
Gong, Nanbo
Beckmann, Karsten
Liehr, Maximilian
Saraf, Iqbal
Van der Straten, Oscar
Ando, Takashi
Cady, Nathaniel
author_facet Abedin, Minhaz
Gong, Nanbo
Beckmann, Karsten
Liehr, Maximilian
Saraf, Iqbal
Van der Straten, Oscar
Ando, Takashi
Cady, Nathaniel
author_sort Abedin, Minhaz
collection PubMed
description Analog hardware-based training provides a promising solution to developing state-of-the-art power-hungry artificial intelligence models. Non-volatile memory hardware such as resistive random access memory (RRAM) has the potential to provide a low power alternative. The training accuracy of analog hardware depends on RRAM switching properties including the number of discrete conductance states and conductance variability. Furthermore, the overall power consumption of the system inversely correlates with the RRAM devices conductance. To study material dependence of these properties, TaOx and HfOx RRAM devices in one-transistor one-RRAM configuration (1T1R) were fabricated using a custom 65 nm CMOS fabrication process. Analog switching performance was studied with a range of initial forming compliance current (200–500 µA) and analog switching tests with ultra-short pulse width (300 ps) was carried out. We report that by utilizing low current during electroforming and high compliance current during analog switching, a large number of RRAM conductance states can be achieved while maintaining low conductance state. While both TaOx and HfOx could be switched to more than 20 distinct states, TaOx devices exhibited 10× lower conductance, which reduces total power consumption for array-level operations. Furthermore, we adopted an analog, fully in-memory training algorithm for system-level training accuracy benchmarking and showed that implementing TaOx 1T1R cells could yield an accuracy of up to 96.4% compared to 97% for the floating-point arithmetic baseline, while implementing HfOx devices would yield a maximum accuracy of 90.5%. Our experimental work and benchmarking approach paves the path for future materials engineering in analog-AI hardware for a low-power environment training.
format Online
Article
Text
id pubmed-10495451
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-104954512023-09-13 Material to system-level benchmarking of CMOS-integrated RRAM with ultra-fast switching for low power on-chip learning Abedin, Minhaz Gong, Nanbo Beckmann, Karsten Liehr, Maximilian Saraf, Iqbal Van der Straten, Oscar Ando, Takashi Cady, Nathaniel Sci Rep Article Analog hardware-based training provides a promising solution to developing state-of-the-art power-hungry artificial intelligence models. Non-volatile memory hardware such as resistive random access memory (RRAM) has the potential to provide a low power alternative. The training accuracy of analog hardware depends on RRAM switching properties including the number of discrete conductance states and conductance variability. Furthermore, the overall power consumption of the system inversely correlates with the RRAM devices conductance. To study material dependence of these properties, TaOx and HfOx RRAM devices in one-transistor one-RRAM configuration (1T1R) were fabricated using a custom 65 nm CMOS fabrication process. Analog switching performance was studied with a range of initial forming compliance current (200–500 µA) and analog switching tests with ultra-short pulse width (300 ps) was carried out. We report that by utilizing low current during electroforming and high compliance current during analog switching, a large number of RRAM conductance states can be achieved while maintaining low conductance state. While both TaOx and HfOx could be switched to more than 20 distinct states, TaOx devices exhibited 10× lower conductance, which reduces total power consumption for array-level operations. Furthermore, we adopted an analog, fully in-memory training algorithm for system-level training accuracy benchmarking and showed that implementing TaOx 1T1R cells could yield an accuracy of up to 96.4% compared to 97% for the floating-point arithmetic baseline, while implementing HfOx devices would yield a maximum accuracy of 90.5%. Our experimental work and benchmarking approach paves the path for future materials engineering in analog-AI hardware for a low-power environment training. Nature Publishing Group UK 2023-09-11 /pmc/articles/PMC10495451/ /pubmed/37697024 http://dx.doi.org/10.1038/s41598-023-42214-x Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Abedin, Minhaz
Gong, Nanbo
Beckmann, Karsten
Liehr, Maximilian
Saraf, Iqbal
Van der Straten, Oscar
Ando, Takashi
Cady, Nathaniel
Material to system-level benchmarking of CMOS-integrated RRAM with ultra-fast switching for low power on-chip learning
title Material to system-level benchmarking of CMOS-integrated RRAM with ultra-fast switching for low power on-chip learning
title_full Material to system-level benchmarking of CMOS-integrated RRAM with ultra-fast switching for low power on-chip learning
title_fullStr Material to system-level benchmarking of CMOS-integrated RRAM with ultra-fast switching for low power on-chip learning
title_full_unstemmed Material to system-level benchmarking of CMOS-integrated RRAM with ultra-fast switching for low power on-chip learning
title_short Material to system-level benchmarking of CMOS-integrated RRAM with ultra-fast switching for low power on-chip learning
title_sort material to system-level benchmarking of cmos-integrated rram with ultra-fast switching for low power on-chip learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10495451/
https://www.ncbi.nlm.nih.gov/pubmed/37697024
http://dx.doi.org/10.1038/s41598-023-42214-x
work_keys_str_mv AT abedinminhaz materialtosystemlevelbenchmarkingofcmosintegratedrramwithultrafastswitchingforlowpoweronchiplearning
AT gongnanbo materialtosystemlevelbenchmarkingofcmosintegratedrramwithultrafastswitchingforlowpoweronchiplearning
AT beckmannkarsten materialtosystemlevelbenchmarkingofcmosintegratedrramwithultrafastswitchingforlowpoweronchiplearning
AT liehrmaximilian materialtosystemlevelbenchmarkingofcmosintegratedrramwithultrafastswitchingforlowpoweronchiplearning
AT sarafiqbal materialtosystemlevelbenchmarkingofcmosintegratedrramwithultrafastswitchingforlowpoweronchiplearning
AT vanderstratenoscar materialtosystemlevelbenchmarkingofcmosintegratedrramwithultrafastswitchingforlowpoweronchiplearning
AT andotakashi materialtosystemlevelbenchmarkingofcmosintegratedrramwithultrafastswitchingforlowpoweronchiplearning
AT cadynathaniel materialtosystemlevelbenchmarkingofcmosintegratedrramwithultrafastswitchingforlowpoweronchiplearning