D. Silver, T. Hubert, J. Schrittwieser, I. Antonoglou, M. Lai et al., A general reinforcement learning algorithm that masters chess, shogi, and go through self-play, Science, vol.362, issue.6419, pp.1140-1144, 2018.

V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness et al., Human-level control through deep reinforcement learning, Nature, vol.518, issue.7540, pp.529-533, 2015.

N. Justesen, M. S. Debus, and S. Risi, When are we done with games, 2019 IEEE Conference on Games (CoG), pp.1-8, 2019.

D. Churchill, M. Preuss, F. Richoux, G. Synnaeve, A. Uriarte et al., Starcraft bots and competitions, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01436110

O. Vinyals, T. Ewalds, S. Bartunov, P. Georgiev, A. S. Vezhnevets et al., Starcraft II: A new challenge for reinforcement learning, 2017.

O. Vinyals, Grandmaster level in starcraft ii using multi-agent reinforcement learning, Nature, vol.575, issue.7782, pp.350-354, 2019.

J. K. Pugh, L. B. Soros, and K. O. Stanley, Quality diversity: A new frontier for evolutionary computation, Frontiers in Robotics and AI, vol.3, p.40, 2016.

J. Mouret and J. Clune, Illuminating search spaces by mapping elites, 2015.

D. Churchill and M. Buro, Build order optimization in Starcraft, Seventh Artificial Intelligence and Interactive Digital Entertainment Conference, 2011.

N. Justesen and S. Risi, Learning macromanagement in StarCraft from replays using deep learning, 2017 IEEE Conference on Computational Intelligence and Games (CIG), pp.162-169, 2017.

Z. Tang, D. Zhao, Y. Zhu, and P. Guo, Reinforcement learning for build-order production in StarCraft II, 2018 Eighth International Conference on Information Science and Technology (ICIST), pp.153-158, 2018.

P. Sun, X. Sun, L. Han, J. Xiong, Q. Wang et al., TStarBots: Defeating the Cheating Level Built-in AI in StarCraft II in the Full Game, 2018.

M. Buro, Real-time strategy games: A new ai research challenge, International Joint Conference on Artificial Intelligence (IJCAI), pp.1534-1535, 2003.

S. Ontanón, G. Synnaeve, A. Uriarte, F. Richoux, D. Churchill et al., A survey of real-time strategy game ai research and competition in Starcraft, IEEE Transactions on Computational Intelligence and AI in games, vol.5, issue.4, pp.293-311, 2013.

P. Bakker and Y. Kuniyoshi, Robot see, robot do: An overview of robot imitation, AISB96 Workshop on Learning in Robots and Animals, pp.3-11, 1996.

C. G. Atkeson and S. Schaal, Robot learning from demonstration, ICML, vol.97, pp.12-20, 1997.

S. , Is imitation learning the route to humanoid robots?, Trends in cognitive sciences, vol.3, issue.6, pp.233-242, 1999.

B. D. Argall, S. Chernova, M. Veloso, and B. Browning, A survey of robot learning from demonstration, Robotics and autonomous systems, vol.57, issue.5, pp.469-483, 2009.

A. Nair, B. Mcgrew, M. Andrychowicz, W. Zaremba, and P. Abbeel, Overcoming exploration in reinforcement learning with demonstrations, IEEE International Conference on Robotics and Automation (ICRA), pp.6292-6299, 2018.

D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre et al., Mastering the game of Go with deep neural networks and tree search, nature, vol.529, issue.7587, pp.484-489, 2016.

S. F. Gudmundsson, P. Eisen, E. Poromaa, A. Nodet, S. Purmonen et al., Human-like playtesting with deep learning, 2018 IEEE Conference on Computational Intelligence and Games (CIG), pp.1-8, 2018.

C. Thurau, C. Bauckhage, and G. Sagerer, Imitation learning at all levels of game-AI, Proceedings of the international conference on computer games, artificial intelligence, design and education, vol.5, 2004.

B. Gorman and M. Humphrys, Imitative learning of combat behaviours in first-person computer games, 2007.

J. Harmer, L. Gisslén, J. Val, H. Holst, J. Bergdahl et al., Imitation learning with concurrent actions in 3D games, 2018 IEEE Conference on Computational Intelligence and Games (CIG), pp.1-8, 2018.

J. Ho and S. Ermon, Generative adversarial imitation learning, Advances in Neural Information Processing Systems, pp.4565-4573, 2016.

Z. Wang, J. S. Merel, S. E. Reed, N. Freitas, G. Wayne et al., Robust imitation of diverse behaviors, Advances in Neural Information Processing Systems, pp.5320-5329, 2017.

Y. Li, J. Song, and S. Ermon, InfoGAIL: Interpretable imitation learning from visual demonstrations, Advances in Neural Information Processing Systems, pp.3812-3822, 2017.

J. Lehman and K. O. Stanley, Evolving a diversity of virtual creatures through novelty search and local competition, Proceedings of the 13th annual conference on Genetic and evolutionary computation, pp.211-218, 2011.

A. Cully and J. Mouret, Evolving a behavioral repertoire for a walking robot, Evolutionary computation, vol.24, issue.1, pp.59-88, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01095543

J. Lehman and K. O. Stanley, Abandoning objectives: Evolution through the search for novelty alone, Evolutionary computation, vol.19, issue.2, pp.189-223, 2011.

A. Cully, J. Clune, D. Tarapore, and J. Mouret, Robots that can adapt like animals, Nature, vol.521, issue.7553, pp.503-507, 2015.
URL : https://hal.archives-ouvertes.fr/hal-01158243

R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, 2018.

P. Auer, N. Cesa-bianchi, and P. Fischer, Finite-time analysis of the multiarmed bandit problem, Machine Learning, vol.47, pp.235-256, 2002.

L. V. Maaten and G. Hinton, Visualizing data using t-SNE, Journal of machine learning research, vol.9, pp.2579-2605, 2008.

T. Schaul, D. Horgan, K. Gregor, and D. Silver, Universal value function approximators, International conference on machine learning, pp.1312-1320, 2015.

M. Andrychowicz, F. Wolski, A. Ray, J. Schneider, R. Fong et al.,

W. Abbeel and . Zaremba, Hindsight experience replay, Advances in Neural Information Processing Systems, pp.5048-5058, 2017.

J. Merel, Y. Tassa, S. Srinivasan, J. Lemmon, Z. Wang et al., Learning human behaviors from motion capture by adversarial imitation, 2017.

M. Ester, H. Kriegel, J. Sander, and X. Xu, A density-based algorithm for discovering clusters in large spatial databases with noise, The Thirteenth National Conference on Artificial Intelligence, pp.1-8, 1996.

J. B. Tenenbaum, V. D. Silva, and J. C. Langford, A Global Geometric Framework for Nonlinear Dimensionality Reduction, Science Reports, vol.290, pp.151-180, 2000.

L. Saul and S. Roweis, An introduction to locally linear embedding, Journal of Machine Learning Research, vol.7, 2001.

L. Mcinnes, J. Healy, and J. Melville, Umap: Uniform manifold approximation and projection for dimension reduction, 2018.