Cargando…

Acquisition of chess knowledge in AlphaZero

We analyze the knowledge acquired by AlphaZero, a neural network engine that learns chess solely by playing against itself yet becomes capable of outperforming human chess players. Although the system trains without access to human games or guidance, it appears to learn concepts analogous to those u...

Descripción completa

Detalles Bibliográficos
Autores principales: McGrath, Thomas, Kapishnikov, Andrei, Tomašev, Nenad, Pearce, Adam, Wattenberg, Martin, Hassabis, Demis, Kim, Been, Paquet, Ulrich, Kramnik, Vladimir
Formato: Online Artículo Texto
Lenguaje:English
Publicado: National Academy of Sciences 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9704706/
https://www.ncbi.nlm.nih.gov/pubmed/36375061
http://dx.doi.org/10.1073/pnas.2206625119
_version_ 1784840112816783360
author McGrath, Thomas
Kapishnikov, Andrei
Tomašev, Nenad
Pearce, Adam
Wattenberg, Martin
Hassabis, Demis
Kim, Been
Paquet, Ulrich
Kramnik, Vladimir
author_facet McGrath, Thomas
Kapishnikov, Andrei
Tomašev, Nenad
Pearce, Adam
Wattenberg, Martin
Hassabis, Demis
Kim, Been
Paquet, Ulrich
Kramnik, Vladimir
author_sort McGrath, Thomas
collection PubMed
description We analyze the knowledge acquired by AlphaZero, a neural network engine that learns chess solely by playing against itself yet becomes capable of outperforming human chess players. Although the system trains without access to human games or guidance, it appears to learn concepts analogous to those used by human chess players. We provide two lines of evidence. Linear probes applied to AlphaZero’s internal state enable us to quantify when and where such concepts are represented in the network. We also describe a behavioral analysis of opening play, including qualitative commentary by a former world chess champion.
format Online
Article
Text
id pubmed-9704706
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher National Academy of Sciences
record_format MEDLINE/PubMed
spelling pubmed-97047062022-11-29 Acquisition of chess knowledge in AlphaZero McGrath, Thomas Kapishnikov, Andrei Tomašev, Nenad Pearce, Adam Wattenberg, Martin Hassabis, Demis Kim, Been Paquet, Ulrich Kramnik, Vladimir Proc Natl Acad Sci U S A Physical Sciences We analyze the knowledge acquired by AlphaZero, a neural network engine that learns chess solely by playing against itself yet becomes capable of outperforming human chess players. Although the system trains without access to human games or guidance, it appears to learn concepts analogous to those used by human chess players. We provide two lines of evidence. Linear probes applied to AlphaZero’s internal state enable us to quantify when and where such concepts are represented in the network. We also describe a behavioral analysis of opening play, including qualitative commentary by a former world chess champion. National Academy of Sciences 2022-11-14 2022-11-22 /pmc/articles/PMC9704706/ /pubmed/36375061 http://dx.doi.org/10.1073/pnas.2206625119 Text en Copyright © 2022 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by/4.0/This open access article is distributed under Creative Commons Attribution License 4.0 (CC BY) (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Physical Sciences
McGrath, Thomas
Kapishnikov, Andrei
Tomašev, Nenad
Pearce, Adam
Wattenberg, Martin
Hassabis, Demis
Kim, Been
Paquet, Ulrich
Kramnik, Vladimir
Acquisition of chess knowledge in AlphaZero
title Acquisition of chess knowledge in AlphaZero
title_full Acquisition of chess knowledge in AlphaZero
title_fullStr Acquisition of chess knowledge in AlphaZero
title_full_unstemmed Acquisition of chess knowledge in AlphaZero
title_short Acquisition of chess knowledge in AlphaZero
title_sort acquisition of chess knowledge in alphazero
topic Physical Sciences
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9704706/
https://www.ncbi.nlm.nih.gov/pubmed/36375061
http://dx.doi.org/10.1073/pnas.2206625119
work_keys_str_mv AT mcgraththomas acquisitionofchessknowledgeinalphazero
AT kapishnikovandrei acquisitionofchessknowledgeinalphazero
AT tomasevnenad acquisitionofchessknowledgeinalphazero
AT pearceadam acquisitionofchessknowledgeinalphazero
AT wattenbergmartin acquisitionofchessknowledgeinalphazero
AT hassabisdemis acquisitionofchessknowledgeinalphazero
AT kimbeen acquisitionofchessknowledgeinalphazero
AT paquetulrich acquisitionofchessknowledgeinalphazero
AT kramnikvladimir acquisitionofchessknowledgeinalphazero