Cargando…

Realizing a deep reinforcement learning agent for real-time quantum feedback

Realizing the full potential of quantum technologies requires precise real-time control on time scales much shorter than the coherence time. Model-free reinforcement learning promises to discover efficient feedback strategies from scratch without relying on a description of the quantum system. Howev...

Descripción completa

Detalles Bibliográficos
Autores principales: Reuer, Kevin, Landgraf, Jonas, Fösel, Thomas, O’Sullivan, James, Beltrán, Liberto, Akin, Abdulkadir, Norris, Graham J., Remm, Ants, Kerschbaum, Michael, Besse, Jean-Claude, Marquardt, Florian, Wallraff, Andreas, Eichler, Christopher
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10628214/
https://www.ncbi.nlm.nih.gov/pubmed/37932251
http://dx.doi.org/10.1038/s41467-023-42901-3
_version_ 1785131707268071424
author Reuer, Kevin
Landgraf, Jonas
Fösel, Thomas
O’Sullivan, James
Beltrán, Liberto
Akin, Abdulkadir
Norris, Graham J.
Remm, Ants
Kerschbaum, Michael
Besse, Jean-Claude
Marquardt, Florian
Wallraff, Andreas
Eichler, Christopher
author_facet Reuer, Kevin
Landgraf, Jonas
Fösel, Thomas
O’Sullivan, James
Beltrán, Liberto
Akin, Abdulkadir
Norris, Graham J.
Remm, Ants
Kerschbaum, Michael
Besse, Jean-Claude
Marquardt, Florian
Wallraff, Andreas
Eichler, Christopher
author_sort Reuer, Kevin
collection PubMed
description Realizing the full potential of quantum technologies requires precise real-time control on time scales much shorter than the coherence time. Model-free reinforcement learning promises to discover efficient feedback strategies from scratch without relying on a description of the quantum system. However, developing and training a reinforcement learning agent able to operate in real-time using feedback has been an open challenge. Here, we have implemented such an agent for a single qubit as a sub-microsecond-latency neural network on a field-programmable gate array (FPGA). We demonstrate its use to efficiently initialize a superconducting qubit and train the agent based solely on measurements. Our work is a first step towards adoption of reinforcement learning for the control of quantum devices and more generally any physical device requiring low-latency feedback.
format Online
Article
Text
id pubmed-10628214
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-106282142023-11-08 Realizing a deep reinforcement learning agent for real-time quantum feedback Reuer, Kevin Landgraf, Jonas Fösel, Thomas O’Sullivan, James Beltrán, Liberto Akin, Abdulkadir Norris, Graham J. Remm, Ants Kerschbaum, Michael Besse, Jean-Claude Marquardt, Florian Wallraff, Andreas Eichler, Christopher Nat Commun Article Realizing the full potential of quantum technologies requires precise real-time control on time scales much shorter than the coherence time. Model-free reinforcement learning promises to discover efficient feedback strategies from scratch without relying on a description of the quantum system. However, developing and training a reinforcement learning agent able to operate in real-time using feedback has been an open challenge. Here, we have implemented such an agent for a single qubit as a sub-microsecond-latency neural network on a field-programmable gate array (FPGA). We demonstrate its use to efficiently initialize a superconducting qubit and train the agent based solely on measurements. Our work is a first step towards adoption of reinforcement learning for the control of quantum devices and more generally any physical device requiring low-latency feedback. Nature Publishing Group UK 2023-11-06 /pmc/articles/PMC10628214/ /pubmed/37932251 http://dx.doi.org/10.1038/s41467-023-42901-3 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Reuer, Kevin
Landgraf, Jonas
Fösel, Thomas
O’Sullivan, James
Beltrán, Liberto
Akin, Abdulkadir
Norris, Graham J.
Remm, Ants
Kerschbaum, Michael
Besse, Jean-Claude
Marquardt, Florian
Wallraff, Andreas
Eichler, Christopher
Realizing a deep reinforcement learning agent for real-time quantum feedback
title Realizing a deep reinforcement learning agent for real-time quantum feedback
title_full Realizing a deep reinforcement learning agent for real-time quantum feedback
title_fullStr Realizing a deep reinforcement learning agent for real-time quantum feedback
title_full_unstemmed Realizing a deep reinforcement learning agent for real-time quantum feedback
title_short Realizing a deep reinforcement learning agent for real-time quantum feedback
title_sort realizing a deep reinforcement learning agent for real-time quantum feedback
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10628214/
https://www.ncbi.nlm.nih.gov/pubmed/37932251
http://dx.doi.org/10.1038/s41467-023-42901-3
work_keys_str_mv AT reuerkevin realizingadeepreinforcementlearningagentforrealtimequantumfeedback
AT landgrafjonas realizingadeepreinforcementlearningagentforrealtimequantumfeedback
AT foselthomas realizingadeepreinforcementlearningagentforrealtimequantumfeedback
AT osullivanjames realizingadeepreinforcementlearningagentforrealtimequantumfeedback
AT beltranliberto realizingadeepreinforcementlearningagentforrealtimequantumfeedback
AT akinabdulkadir realizingadeepreinforcementlearningagentforrealtimequantumfeedback
AT norrisgrahamj realizingadeepreinforcementlearningagentforrealtimequantumfeedback
AT remmants realizingadeepreinforcementlearningagentforrealtimequantumfeedback
AT kerschbaummichael realizingadeepreinforcementlearningagentforrealtimequantumfeedback
AT bessejeanclaude realizingadeepreinforcementlearningagentforrealtimequantumfeedback
AT marquardtflorian realizingadeepreinforcementlearningagentforrealtimequantumfeedback
AT wallraffandreas realizingadeepreinforcementlearningagentforrealtimequantumfeedback
AT eichlerchristopher realizingadeepreinforcementlearningagentforrealtimequantumfeedback