Cargando…
Acquisition of chess knowledge in AlphaZero
We analyze the knowledge acquired by AlphaZero, a neural network engine that learns chess solely by playing against itself yet becomes capable of outperforming human chess players. Although the system trains without access to human games or guidance, it appears to learn concepts analogous to those u...
Autores principales: | , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
National Academy of Sciences
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9704706/ https://www.ncbi.nlm.nih.gov/pubmed/36375061 http://dx.doi.org/10.1073/pnas.2206625119 |
_version_ | 1784840112816783360 |
---|---|
author | McGrath, Thomas Kapishnikov, Andrei Tomašev, Nenad Pearce, Adam Wattenberg, Martin Hassabis, Demis Kim, Been Paquet, Ulrich Kramnik, Vladimir |
author_facet | McGrath, Thomas Kapishnikov, Andrei Tomašev, Nenad Pearce, Adam Wattenberg, Martin Hassabis, Demis Kim, Been Paquet, Ulrich Kramnik, Vladimir |
author_sort | McGrath, Thomas |
collection | PubMed |
description | We analyze the knowledge acquired by AlphaZero, a neural network engine that learns chess solely by playing against itself yet becomes capable of outperforming human chess players. Although the system trains without access to human games or guidance, it appears to learn concepts analogous to those used by human chess players. We provide two lines of evidence. Linear probes applied to AlphaZero’s internal state enable us to quantify when and where such concepts are represented in the network. We also describe a behavioral analysis of opening play, including qualitative commentary by a former world chess champion. |
format | Online Article Text |
id | pubmed-9704706 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | National Academy of Sciences |
record_format | MEDLINE/PubMed |
spelling | pubmed-97047062022-11-29 Acquisition of chess knowledge in AlphaZero McGrath, Thomas Kapishnikov, Andrei Tomašev, Nenad Pearce, Adam Wattenberg, Martin Hassabis, Demis Kim, Been Paquet, Ulrich Kramnik, Vladimir Proc Natl Acad Sci U S A Physical Sciences We analyze the knowledge acquired by AlphaZero, a neural network engine that learns chess solely by playing against itself yet becomes capable of outperforming human chess players. Although the system trains without access to human games or guidance, it appears to learn concepts analogous to those used by human chess players. We provide two lines of evidence. Linear probes applied to AlphaZero’s internal state enable us to quantify when and where such concepts are represented in the network. We also describe a behavioral analysis of opening play, including qualitative commentary by a former world chess champion. National Academy of Sciences 2022-11-14 2022-11-22 /pmc/articles/PMC9704706/ /pubmed/36375061 http://dx.doi.org/10.1073/pnas.2206625119 Text en Copyright © 2022 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by/4.0/This open access article is distributed under Creative Commons Attribution License 4.0 (CC BY) (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Physical Sciences McGrath, Thomas Kapishnikov, Andrei Tomašev, Nenad Pearce, Adam Wattenberg, Martin Hassabis, Demis Kim, Been Paquet, Ulrich Kramnik, Vladimir Acquisition of chess knowledge in AlphaZero |
title | Acquisition of chess knowledge in AlphaZero |
title_full | Acquisition of chess knowledge in AlphaZero |
title_fullStr | Acquisition of chess knowledge in AlphaZero |
title_full_unstemmed | Acquisition of chess knowledge in AlphaZero |
title_short | Acquisition of chess knowledge in AlphaZero |
title_sort | acquisition of chess knowledge in alphazero |
topic | Physical Sciences |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9704706/ https://www.ncbi.nlm.nih.gov/pubmed/36375061 http://dx.doi.org/10.1073/pnas.2206625119 |
work_keys_str_mv | AT mcgraththomas acquisitionofchessknowledgeinalphazero AT kapishnikovandrei acquisitionofchessknowledgeinalphazero AT tomasevnenad acquisitionofchessknowledgeinalphazero AT pearceadam acquisitionofchessknowledgeinalphazero AT wattenbergmartin acquisitionofchessknowledgeinalphazero AT hassabisdemis acquisitionofchessknowledgeinalphazero AT kimbeen acquisitionofchessknowledgeinalphazero AT paquetulrich acquisitionofchessknowledgeinalphazero AT kramnikvladimir acquisitionofchessknowledgeinalphazero |