HAL - INRIA :: [inria-00117266, version 3] Modiﬁcation of UCT with Patterns in Monte-Carlo Go

inria-00117266, version 3

Modiﬁcation of UCT with Patterns in Monte-Carlo Go

Sylvain Gelly () ¹, Yizao Wang ^1, 2, Rémi Munos ^2, 3, Olivier Teytaud ¹

N° RR-6062 (2006)

Abstract: Algorithm UCB1 for multi-armed bandit problem has already been extended to Algorithm UCT (Upper bound Confidence for Tree) which works for minimax tree search. We have developed a Monte-Carlo Go program, MoGo, which is the first computer Go program using UCT. We explain our modification of UCT for Go application and also the intelligent random simulation with patterns which has improved significantly the performance of MoGo. UCT combined with pruning techniques for large Go board is discussed, as well as parallelization of UCT. MoGo is now a top level Go program on $9\times9$ and $13\times13$ Go boards.

1: TAO (INRIA Futurs)
INRIA – CNRS : UMR8623 – Université Paris XI - Paris Sud
2: Centre de Mathématiques Appliquées (CMAP)
CNRS : UMR7641 – Université de Versailles Saint-Quentin-en-Yvelines – Polytechnique - X
3: SEQUEL (INRIA Futurs)
INRIA – CNRS : UMR8022 – CNRS : UMR8146 – Université Lille 1 - Sciences et Technologies – Université Charles de Gaulle - Lille III – Ecole Centrale de Lille

inria-00117266, version 3
http://hal.inria.fr/inria-00117266
oai:hal.inria.fr:inria-00117266
From: Sylvain Gelly <>
Submitted on: Wednesday, 20 December 2006 18:52:43
Updated on: Thursday, 21 December 2006 09:49:17

See detailed view

Associated documents

PDF :

Export

Bibtex EndNote TEI RefWorks

<?xml version="1.0" encoding="UTF-8"?>
<listBibl xmlns="http://www.tei-c.org/ns/1.0" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML">
<listBibl type="report"><head>Research reports</head>
<biblStruct type="report" xml:id="inria-00117266"><monogr>
<author><persName><forename>Sylvain</forename><surname>Gelly</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA Futurs</orgName>
<orgName type="team">TAO</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR8623</orgName>
<orgName type="institution">Université Paris XI - Paris Sud</orgName>
</affiliation>
</author>
<author><persName><forename>Yizao</forename><surname>Wang</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA Futurs</orgName>
<orgName type="team">TAO</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR8623</orgName>
<orgName type="institution">Université Paris XI - Paris Sud</orgName>
</affiliation>
<affiliation>
<orgName type="laboratory">CMAP</orgName>
<orgName type="team">Centre de Mathématiques Appliquées</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR7641</orgName>
<orgName type="institution">Université de Versailles Saint-Quentin-en-Yvelines</orgName>
<orgName type="institution">Polytechnique - X</orgName>
</affiliation>
</author>
<author><persName><forename>Rémi</forename><surname>Munos</surname></persName>
<affiliation>
<orgName type="laboratory">CMAP</orgName>
<orgName type="team">Centre de Mathématiques Appliquées</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR7641</orgName>
<orgName type="institution">Université de Versailles Saint-Quentin-en-Yvelines</orgName>
<orgName type="institution">Polytechnique - X</orgName>
</affiliation>
<affiliation>
<orgName type="laboratory">INRIA Futurs</orgName>
<orgName type="team">SEQUEL</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR8022</orgName>
<orgName type="institution">CNRS : UMR8146</orgName>
<orgName type="institution">Université Lille 1 - Sciences et Technologies</orgName>
<orgName type="institution">Université Charles de Gaulle - Lille III</orgName>
<orgName type="institution">Ecole Centrale de Lille</orgName>
</affiliation>
</author>
<author><persName><forename>Olivier</forename><surname>Teytaud</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA Futurs</orgName>
<orgName type="team">TAO</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">CNRS : UMR8623</orgName>
<orgName type="institution">Université Paris XI - Paris Sud</orgName>
</affiliation>
</author>
<title type="main" level="m">Modiﬁcation of UCT with Patterns in Monte-Carlo Go</title><title type="main" level="m">Modiﬁcation of UCT with Patterns in Monte-Carlo Go</title><imprint><biblScope type="publicationDate">2006-00-00</biblScope></imprint></monogr><idno type="HALid">http://hal.inria.fr/inria-00117266</idno><idno type="HALFile">http://hal.inria.fr/inria-00117266/PDF/RR-6062.pdf</idno></biblStruct>
</listBibl>
</listBibl>