Cargando…

Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning

A quantum thermal machine is an open quantum system that enables the conversion between heat and work at the micro or nano-scale. Optimally controlling such out-of-equilibrium systems is a crucial yet challenging task with applications to quantum technologies and devices. We introduce a general mode...

Descripción completa

Detalles Bibliográficos
Autores principales: Erdman, Paolo A, Noé, Frank
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10427747/
https://www.ncbi.nlm.nih.gov/pubmed/37593201
http://dx.doi.org/10.1093/pnasnexus/pgad248
_version_ 1785090310998589440
author Erdman, Paolo A
Noé, Frank
author_facet Erdman, Paolo A
Noé, Frank
author_sort Erdman, Paolo A
collection PubMed
description A quantum thermal machine is an open quantum system that enables the conversion between heat and work at the micro or nano-scale. Optimally controlling such out-of-equilibrium systems is a crucial yet challenging task with applications to quantum technologies and devices. We introduce a general model-free framework based on reinforcement learning to identify out-of-equilibrium thermodynamic cycles that are Pareto optimal tradeoffs between power and efficiency for quantum heat engines and refrigerators. The method does not require any knowledge of the quantum thermal machine, nor of the system model, nor of the quantum state. Instead, it only observes the heat fluxes, so it is both applicable to simulations and experimental devices. We test our method on a model of an experimentally realistic refrigerator based on a superconducting qubit, and on a heat engine based on a quantum harmonic oscillator. In both cases, we identify the Pareto-front representing optimal power-efficiency tradeoffs, and the corresponding cycles. Such solutions outperform previous proposals made in the literature, such as optimized Otto cycles, reducing quantum friction.
format Online
Article
Text
id pubmed-10427747
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-104277472023-08-17 Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning Erdman, Paolo A Noé, Frank PNAS Nexus Physical Sciences and Engineering A quantum thermal machine is an open quantum system that enables the conversion between heat and work at the micro or nano-scale. Optimally controlling such out-of-equilibrium systems is a crucial yet challenging task with applications to quantum technologies and devices. We introduce a general model-free framework based on reinforcement learning to identify out-of-equilibrium thermodynamic cycles that are Pareto optimal tradeoffs between power and efficiency for quantum heat engines and refrigerators. The method does not require any knowledge of the quantum thermal machine, nor of the system model, nor of the quantum state. Instead, it only observes the heat fluxes, so it is both applicable to simulations and experimental devices. We test our method on a model of an experimentally realistic refrigerator based on a superconducting qubit, and on a heat engine based on a quantum harmonic oscillator. In both cases, we identify the Pareto-front representing optimal power-efficiency tradeoffs, and the corresponding cycles. Such solutions outperform previous proposals made in the literature, such as optimized Otto cycles, reducing quantum friction. Oxford University Press 2023-08-02 /pmc/articles/PMC10427747/ /pubmed/37593201 http://dx.doi.org/10.1093/pnasnexus/pgad248 Text en © The Author(s) 2023. Published by Oxford University Press on behalf of National Academy of Sciences. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Physical Sciences and Engineering
Erdman, Paolo A
Noé, Frank
Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
title Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
title_full Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
title_fullStr Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
title_full_unstemmed Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
title_short Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
title_sort model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
topic Physical Sciences and Engineering
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10427747/
https://www.ncbi.nlm.nih.gov/pubmed/37593201
http://dx.doi.org/10.1093/pnasnexus/pgad248
work_keys_str_mv AT erdmanpaoloa modelfreeoptimizationofpowerefficiencytradeoffsinquantumthermalmachinesusingreinforcementlearning
AT noefrank modelfreeoptimizationofpowerefficiencytradeoffsinquantumthermalmachinesusingreinforcementlearning