P. Abbeel, A. Coates, M. Quigley, and A. Ng, An application of reinforcement learning to aerobatic helicopter flight, Advances in Neural Information Processing Systems (NIPS), 2007.

M. Amil, N. Bredeche, C. Gagné, S. Gelly, M. Schoenauer et al., A Statistical Learning Perspective of Genetic Programming, Proceedings of the 12th European Conference on Genetic Programming at Evostar, 2009.
DOI : 10.1007/978-1-4757-2440-0
URL : https://hal.archives-ouvertes.fr/inria-00369782

M. Asada, K. Hosoda, Y. Kuniyoshi, H. Ishiguro, T. Inui et al., Cognitive Developmental Robotics: A Survey, IEEE Transactions on Autonomous Mental Development, vol.1, issue.1, pp.12-34, 2009.
DOI : 10.1109/TAMD.2009.2021702

J. Auerbach and J. Bongard, How robot morphology and training order affect the learning of multiple behaviors, 2009 IEEE Congress on Evolutionary Computation, 2009.
DOI : 10.1109/CEC.2009.4982928

G. Baele, N. Bredeche, E. Haasdijk, S. Maere, N. Michiels et al., Open-ended on-board Evolutionary Robotics for robot swarms, 2009 IEEE Congress on Evolutionary Computation, p.2009, 2009.
DOI : 10.1109/CEC.2009.4983072
URL : https://hal.archives-ouvertes.fr/inria-00413274

T. Bartz-beielstein and M. Preuss, Experimental research in evolutionary computation, Proceedings of the 2007 GECCO Conference Companion on Genetic and Evolutionary Computation, pp.3001-3020, 2007.

H. G. Beyer, The Theory of Evolution Strategies, 2001.
DOI : 10.1007/978-3-662-04378-3

H. G. Beyer and H. P. Schwefel, Evolution strategies ? A comprehensive introduction, Natural Computing, vol.1, issue.1, pp.3-52, 2002.
DOI : 10.1023/A:1015059928466

M. Birattari, M. Zlochin, and M. Dorigo, Towards a theory of practice in??metaheuristics design: A machine learning perspective, RAIRO - Theoretical Informatics and Applications, vol.40, issue.2, pp.353-369, 2006.
DOI : 10.1051/ita:2006009

A. Blum, On-Line Algorithms in Machine Learning, Proceedings of the Workshop on On-Line Algorithms, Dagstuhl, pp.306-325, 1996.
DOI : 10.1007/BFb0029575

J. Bongard and H. Lipson, Nonlinear System Identification Using Coevolution of Models and Tests, IEEE Transactions on Evolutionary Computation, vol.9, issue.4, pp.361-384, 2005.
DOI : 10.1109/TEVC.2005.850293

J. Bongard and H. Lipson, Automated reverse engineering of nonlinear dynamical systems, Proceedings of the National Academy of Sciences, vol.104, issue.24, pp.9943-9948, 2007.
DOI : 10.1073/pnas.0609476104

J. Bongard, V. Zykov, and H. Lipson, Resilient Machines Through Continuous Self-Modeling, Science, vol.314, issue.5802, pp.1118-1121, 2006.
DOI : 10.1126/science.1133687

N. Bredeche, E. Haasdijk, and A. Eiben, On-Line, On-Board Evolution of Robot Controllers, Evolution Artificielle / Artificial Evolution, 2009.
DOI : 10.1007/978-3-642-14156-0_10
URL : https://hal.archives-ouvertes.fr/inria-00413259

N. Bredeche and J. Montanier, Environment-Driven Embodied Evolution in a Population of Autonomous Agents, PPSN XI, pp.290-299, 2010.
DOI : 10.1007/978-3-642-15871-1_30
URL : https://hal.archives-ouvertes.fr/inria-00506771

D. 'ambrosio, D. B. Stanley, and K. O. , A novel generative encoding for exploiting neural network sensor and output geometry, Proceedings of the Genetic and Evolutionary Computation Conference, p.2007, 2007.

C. Darwin, On the Origin of Species by Means of Natural Selection or the Preservation of Favoured Races in the Struggle for Life, 1859.

K. Deb, Multi-objectives optimization using evolutionnary algorithms, 2001.

K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, A fast and elitist multiobjective genetic algorithm: NSGA-II, IEEE Transactions on Evolutionary Computation, vol.6, issue.2, pp.182-197, 2002.
DOI : 10.1109/4235.996017

K. Deb and A. Srinivasan, Innovization, Proceedings of the 8th annual conference on Genetic and evolutionary computation , GECCO '06, pp.1629-1636, 2006.
DOI : 10.1145/1143997.1144266

K. Deb and A. Srinivasan, Innovization: Discovery of Innovative Design Principles Through Multiobjective Evolutionary Optimization, Multiobjective Problem Solving from Nature: From Concepts to Applications, pp.243-262, 2007.
DOI : 10.1007/978-3-540-72964-8_12

S. Doncieux and M. Hamdaoui, Evolutionary Algorithms to Analyse and Design a Controller for a Flapping Wings Aircraft, New Horizons in Evolutionary Robotics: Post- Proceedings of the 2009 EvoDeRob Workshop, 2010.
DOI : 10.1007/978-3-642-18272-3_6

S. Doncieux and J. B. Mouret, Behavioral diversity measures for Evolutionary Robotics, IEEE Congress on Evolutionary Computation, 2010.
DOI : 10.1109/CEC.2010.5586100
URL : https://hal.archives-ouvertes.fr/hal-00687641

A. Eiben, E. Haasdijk, and N. Bredeche, Embodied, on-line, on-board evolution for autonomous robotics, Symbiotic Multi-Robot Organisms: Reliability, Adaptability, Evolution, Cognitive Systems Monographs, pp.361-382, 2010.
URL : https://hal.archives-ouvertes.fr/inria-00531455

A. E. Eiben and J. E. Smith, Introduction to Evolutionary Computing. Natural Computing Series, 2003.

R. Fisher, Design of Experiments, BMJ, vol.1, issue.3923, p.554, 1936.
DOI : 10.1136/bmj.1.3923.554-a

P. J. Fleming and R. C. Purshouse, Evolutionary algorithms in control systems engineering: a survey, Control Engineering Practice, vol.10, issue.11, pp.1223-1241, 2002.
DOI : 10.1016/S0967-0661(02)00081-3

D. Floreano and C. Mattiussi, Bio-Inspired Artificial Intelligence: Theories, Methods, and Technologies. In: Intelligent Robotics and Autonomous Agents, 2008.

D. Floreano and F. Mondada, Evolution of homing navigation in a real mobile robot, IEEE Transactions on Systems, Man and Cybernetics, Part B (Cybernetics), vol.26, issue.3, 1996.
DOI : 10.1109/3477.499791

D. Floreano and F. Mondada, Evolutionary neurocontrollers for autonomous mobile robots, Neural Networks, vol.11, issue.7-8, pp.1461-1478, 1998.
DOI : 10.1016/S0893-6080(98)00082-3
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.93.6766

S. García, D. Molina, M. Lozano, and F. Herrera, A study on the use of non-parametric tests for analyzing the evolutionary algorithms??? behaviour: a??case study on??the??CEC???2005 Special Session on??Real Parameter Optimization, Journal of Heuristics, vol.48, issue.1, pp.617-644, 2009.
DOI : 10.1007/s10732-008-9080-4

J. J. Gauci and K. O. Stanley, Generating large-scale neural networks through discovering geometric regularities, Proceedings of the 9th annual conference on Genetic and evolutionary computation , GECCO '07, p.2007, 2007.
DOI : 10.1145/1276958.1277158

A. Gloye, F. Wiesel, O. Tenchio, and M. Simon, Reinforcing the driving quality of soccer playing robots by anticipation (verbesserung der fahreigenschaften von fu ballspielenden robotern durch antizipation) IT -Information Technology, pp.250-257, 2005.

N. Godzik, M. Schoenauer, and M. Sebag, Evolving Symbolic Controllers, pp.638-650, 2003.
DOI : 10.1007/3-540-36605-9_58
URL : https://hal.archives-ouvertes.fr/inria-00145206

D. Goldberg, Genetic Algorithms in Search and Optimization, 1989.

F. Gomez and R. Miikkulainen, Incremental Evolution of Complex General Behavior, Adaptive Behavior, vol.5, issue.3-4, pp.317-342, 1997.
DOI : 10.1177/105971239700500305

G. W. Greenwood and A. M. Tyrrell, Introduction to Evolvable Hardware: A Practical Guide for Designing Self-Adaptive Systems, 2006.
DOI : 10.1002/0470049715

R. Gross, M. Bonani, F. Mondada, and M. Dorigo, Autonomous self-assembly in swarmbots, IEEE Transactions on Robotics, vol.22, issue.6, pp.1115-1130, 2006.

F. Gruau, Neural Network Synthesis Using Cellular Encoding and the Genetic Algorithm, 1994.

F. Gruau, Automatic Definition of Modular Neural Networks, Adaptive Behavior, vol.3, issue.2, pp.151-183, 1995.
DOI : 10.1177/105971239400300202

H. Hamda, F. Jouve, E. Lutton, M. Schoenauer, and M. Sebag, Compact unstructured representations in evolutionary topological optimum design, Applied Intelligence, vol.16, issue.2, pp.139-155, 2002.
DOI : 10.1023/A:1013666503249

H. Hamda and M. Schoenauer, Adaptive Techniques for Evolutionary Topological Optimum Design, Evolutionary Design and Manufacture, pp.123-136, 2000.
DOI : 10.1007/978-1-4471-0519-0_10
URL : https://hal.archives-ouvertes.fr/inria-00001276

N. Hansen, S. D. Muller, and P. Koumoutsakos, Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES), Evolutionary Computation, vol.11, issue.1, pp.1-18, 2003.
DOI : 10.1162/106365601750190398

N. Hansen and A. Ostermeier, Completely Derandomized Self-Adaptation in Evolution Strategies, Evolutionary Computation, vol.9, issue.2, pp.159-195, 2001.
DOI : 10.1016/0004-3702(95)00124-7

F. Hara and R. Pfeifer, Morpho-Functional Machines: The New Species: Designing Embodied Intelligence, 2003.

C. Hartland, N. Bredeche, and M. Sebag, Memory-enhanced evolutionary robotics, 2009.
DOI : 10.1109/cec.2009.4983292
URL : https://hal.archives-ouvertes.fr/inria-00413238

S. Hauert, J. C. Zufferey, and D. Floreano, Reverse-engineering of artificially evolved controllers for swarms of robots, 2009 IEEE Congress on Evolutionary Computation, 2009.
DOI : 10.1109/CEC.2009.4982930

J. H. Holland, Adaptation in natural and artificial systems: an introductory analysis with applications to biology, control, and artificial intelligence, 1975.

G. S. Hornby, Measuring, enabling and comparing modularity, regularity and hierarchy in evolutionary design, Proceedings of the 2005 conference on Genetic and evolutionary computation , GECCO '05, pp.1729-1736, 2005.
DOI : 10.1145/1068009.1068297

G. S. Hornby, S. Takamura, J. Yokono, O. Hanagata, T. Yamamoto et al., Evolving robust gaits with AIBO, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065), pp.3040-3045, 2000.
DOI : 10.1109/ROBOT.2000.846489
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.36.524

N. Jakobi, Evolutionary Robotics and the Radical Envelope-of-Noise Hypothesis, Adaptive Behavior, vol.161, issue.4, pp.325-368, 1997.
DOI : 10.1177/105971239700600205

W. Khalil and E. Dombre, Modeling, Identification and Control of Robots, Applied Mechanics Reviews, vol.56, issue.3, 2002.
DOI : 10.1115/1.1566397

R. Kicinger, T. Arciszewski, and K. Jong, Evolutionary computation and structural design: A survey of the state-of-the-art, Computers & Structures, vol.83, issue.23-24, pp.23-24, 2005.
DOI : 10.1016/j.compstruc.2005.03.002

K. J. Kim and S. B. Cho, Robot Action Selection for Higher Behaviors with CAM-Brain Modules, Proceedings of the 32nd ISR (International Symposium on Robotics), p.21, 2001.

J. Kodjabachian and J. A. Meyer, Evolution and development of neural controllers for locomotion, gradient-following, and obstacle-avoidance in artificial insects, IEEE Transactions on Neural Networks, vol.9, issue.5, pp.796-812, 1997.
DOI : 10.1109/72.712153
URL : https://hal.archives-ouvertes.fr/hal-01184992

S. Koos, J. B. Mouret, and S. Doncieux, Automatic system identification based on coevolution of models and tests, 2009 IEEE Congress on Evolutionary Computation, p.2009, 2009.
DOI : 10.1109/CEC.2009.4982995
URL : https://hal.archives-ouvertes.fr/hal-00473153

S. Koos, J. B. Mouret, and S. Doncieux, Crossing the reality gap in evolutionary robotics by promoting transferable controllers, Proceedings of the 12th annual conference on Genetic and evolutionary computation, GECCO '10, 2010.
DOI : 10.1145/1830483.1830505
URL : https://hal.archives-ouvertes.fr/hal-00633927

O. Kramer, B. Gloger, and A. Goebels, An experimental analysis of evolution strategies and particle swarm optimisers using design of experiments, Proceedings of the 9th annual conference on Genetic and evolutionary computation , GECCO '07, pp.674-681, 2007.
DOI : 10.1145/1276958.1277099

D. P. Kwok and F. Sheng, Genetic algorithm and simulated annealing for optimal robot arm PID control, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence, pp.707-713, 1994.
DOI : 10.1109/ICEC.1994.349971

J. Lehman and K. O. Stanley, Exploiting Open-Endedness to Solve Problems Through the Search for Novelty, Artificial Life, vol.11, p.329, 2008.

J. Lehman and K. O. Stanley, Abandoning Objectives: Evolution Through the Search for Novelty Alone, Evolutionary Computation, vol.7, issue.3, 2010.
DOI : 10.1016/0165-6074(93)90215-7

H. Lipson, Principles of modularity, regularity, and hierarchy for scalable systems, Genetic and Evolutionary Computation Conference (GECCO 2004) Workshop on Modularity, regularity and Hierarchy, 2004.
DOI : 10.4024/40701.jbpc.07.04

H. Lipson, J. Bongard, V. Zykov, and E. Malone, Evolutionary robotics for legged machines: from simulation to physical reality, Intelligent Autonomous Systems, vol.9, issue.9, 2006.

H. Lipson and J. B. Pollack, Automatic design and manufacture of robotic life forms, Nature, vol.406, issue.406, pp.974-978, 2000.

J. Lohn, J. Crawford, A. Globus, G. S. Hornby, W. Kraus et al., Evolvable systems for space applications, International Conference on Space Mission Challenges for Information Technology, 2003.

J. Lohn, G. Hornby, and D. Linden, An evolved antenna for deployment on NASAs space technology 5 mission, In: Genetic Programming Theory and Practice II, pp.301-315, 2004.

J. D. Lohn, D. S. Linden, G. S. Hornby, W. F. Kraus, and A. Rodriguez-arroyo, Evolutionary design of an x-band antenna for nasa's space technology 5 mission, Proceedings of the 2003 NASA/DoD Conference on Evolvable Hardware, 2003.

S. Manos, M. C. Large, and L. Poladian, Evolutionary design of single-mode microstructured polymer optical fibres using an artificial embryogeny representation, Proceedings of the 2007 GECCO conference companion on Genetic and evolutionary computation , GECCO '07, pp.2549-2556, 2007.
DOI : 10.1145/1274000.1274024

G. Metta, G. Sandini, D. Vernon, L. Natale, and F. Nori, The iCub humanoid robot, Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems, PerMIS '08, 2008.
DOI : 10.1145/1774674.1774683

J. A. Meyer and A. Guillot, Biologically Inspired Robots, Handbook of Robotics, 2008.
DOI : 10.1007/978-3-540-30301-5_61

J. M. Montanier and N. Bredeche, Embedded Evolutionary Robotics: The (1+1)-Restart-Online Adaptation Algorithm, Proceedings of IROS Workshop Exploring New Horizons in the Evolutionary Design of Robots, 2009.
DOI : 10.1007/978-3-642-18272-3_11
URL : https://hal.archives-ouvertes.fr/inria-00566898

J. B. Mouret, Novelty-Based Multiobjectivization, Proceedings of IROS Workshop Exploring New Horizons in the Evolutionary Design of Robots, 2009.
DOI : 10.1007/978-3-642-18272-3_10
URL : https://hal.archives-ouvertes.fr/hal-01300711

J. B. Mouret and S. Doncieux, Incremental evolution of animats' behaviors as a multiobjective optimization, SAB 2008, pp.210-219, 2008.
URL : https://hal.archives-ouvertes.fr/hal-00687647

J. B. Mouret and S. Doncieux, MENNAG: a modular, regular and hierarchical encoding for neural-networks based on attribute grammars, Evolutionary Intelligence, vol.87, issue.9, pp.187-207, 2008.
DOI : 10.1007/s12065-008-0015-7
URL : https://hal.archives-ouvertes.fr/hal-00687646

J. B. Mouret and S. Doncieux, Evolving modular neural-networks through exaptation, 2009 IEEE Congress on Evolutionary Computation, p.2009, 2009.
DOI : 10.1109/CEC.2009.4983129
URL : https://hal.archives-ouvertes.fr/hal-00473135

J. B. Mouret and S. Doncieux, Overcoming the bootstrap problem in evolutionary robotics using behavioral diversity, 2009 IEEE Congress on Evolutionary Computation, p.2009, 2009.
DOI : 10.1109/CEC.2009.4983077
URL : https://hal.archives-ouvertes.fr/hal-00473147

J. B. Mouret and S. Doncieux, Using behavioral exploration objectives to solve deceptive problems in neuro-evolution, Proceedings of the 11th Annual conference on Genetic and evolutionary computation, GECCO '09, 2009.
DOI : 10.1145/1569901.1569988
URL : https://hal.archives-ouvertes.fr/hal-00473132

J. B. Mouret, S. Doncieux, J. A. Meyer, S. Nolfi, G. Baldassarre et al., Incremental Evolution of Target-Following Neuro-controllers for Flapping-Wing Animats, SAB 2006, pp.606-618, 2006.
DOI : 10.1007/11840541_50
URL : https://hal.archives-ouvertes.fr/hal-01300724

S. Nolfi and D. Floreano, How co-evolution can enhance the adaptive power of artificial evolution: Implications for evolutionary robotics, Proceedings of the First European Workshop on Evolutionary Robotics, pp.22-38, 1998.
DOI : 10.1007/3-540-64957-3_62

S. Nolfi and D. Floreano, Evolutionary Robotics, 2001.
DOI : 10.1007/978-3-319-32552-1_76

P. Y. Oudeyer, F. Kaplan, and V. Hafner, Intrinsic Motivation Systems for Autonomous Mental Development, IEEE Transactions on Evolutionary Computation, vol.11, issue.2, pp.265-286, 2007.
DOI : 10.1109/TEVC.2006.890271

J. B. Pollack and H. Lipson, The GOLEM project: evolving hardware bodies and brains, Proceedings. The Second NASA/DoD Workshop on Evolvable Hardware, p.37, 2000.
DOI : 10.1109/EH.2000.869340

S. Preble, H. Lipson, and M. Lipson, Two-dimensional photonic crystals designed by evolutionary algorithms, Applied Physics Letters, vol.86, issue.6, 2005.
DOI : 10.1063/1.1862783

N. Radcliffe, The algebra of genetic algorithms, Annals of Mathematics and Artificial Intelligence, vol.5, issue.2, pp.339-384, 1994.
DOI : 10.1007/BF01531276

I. Rechenberg, Evolutionsstrategie: Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. Frommann-Holzboog, 1973.

S. Ronald, Robust encodings in genetic algorithms: a survey of encoding issues, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97), pp.43-48, 1997.
DOI : 10.1109/ICEC.1997.592265

F. Rothlauf, Representations for Genetic And Evolutionary Algorithms, 2006.
DOI : 10.1007/978-3-642-88094-0

M. Schmidt and H. Lipson, Distilling Free-Form Natural Laws from Experimental Data, Science, vol.324, issue.5923, pp.81-85, 2009.
DOI : 10.1126/science.1165893
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.308.2245

H. P. Schwefel, Numerical Optimization of Computer Models, 1981.

Y. Shim, P. Husbands, F. Almeida-e-costa, L. M. Rocha, E. Costa et al., Feathered Flyer: Integrating Morphological Computation and Sensory Reflexes into a Physically Simulated Flapping-Wing Robot for Robust Flight Manoeuvre, ECAL 2007, pp.756-765, 2007.
DOI : 10.1007/978-3-540-74913-4_76

B. Siciliano, L. Sciavicco, L. Villani, and G. Oriolo, Robotics: Modelling, Planning and Control, 2008.
DOI : 10.1007/978-1-84628-642-1

O. Sigaud and J. Peters, From Motor Learning to Interaction Learning in Robots, Studies in Computational Intelligence, vol.264, pp.1-12, 2010.

K. Sims, Evolving virtual creatures, Proceedings of the 21st annual conference on Computer graphics and interactive techniques , SIGGRAPH '94, pp.15-22, 1994.
DOI : 10.1145/192161.192167
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.380.2734

K. O. Stanley and R. Miikkulainen, Evolving Neural Networks through Augmenting Topologies, Evolutionary Computation, vol.7, issue.2, pp.99-127, 2002.
DOI : 10.1016/S0096-3003(97)10005-4
URL : http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.18.4591

K. O. Stanley and R. Miikkulainen, A Taxonomy for Artificial Embryogeny, Artificial Life, vol.13, issue.1, pp.93-130, 2003.
DOI : 10.1002/cne.902460104

K. O. Stanley and R. Miikkulainen, Competitive Coevolution through Evolutionary Complexification, Journal of Artificial Intelligence Research, vol.21, pp.63-100, 2004.

Y. Usui and T. Arita, Situated and embodied evolution in collective evolutionary robotics, Proc. of the 8th International Symposium on Artificial Life and Robotics, pp.212-215, 2003.

B. Vanderborght, B. Verrelest, R. Van-ham, M. Van-damme, P. Beyl et al., Development of a compliance controller to reduce energy consumption for bipedal robots, Autonomous Robots, vol.20, issue.7, pp.419-434, 2008.
DOI : 10.1007/s10514-008-9088-5

M. Wahde, A method for behavioural organization for autonomous robots based on evolutionary optimization of utility functions, Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, vol.20, issue.1, pp.249-258, 2003.
DOI : 10.1177/095965180321700401

R. A. Watson, S. G. Ficici, and J. B. Pollack, Embodied evolution: embodying an evolutionary algorithm in a population of robots, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406), pp.335-342, 1999.
DOI : 10.1109/CEC.1999.781944

R. A. Watson, S. G. Ficici, and J. B. Pollack, Embodied Evolution: Distributing an evolutionary algorithm in a population of robots, Robotics and Autonomous Systems, vol.39, issue.1, pp.1-18, 2002.
DOI : 10.1016/S0921-8890(02)00170-7

K. Wolff, D. Sandberg, and M. Wahde, Evolutionary optimization of a bipedal gait in a physical robot, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence), pp.440-445, 2008.
DOI : 10.1109/CEC.2008.4630835

M. Zinn, O. Khatib, B. Roth, and J. Salisbury, Playing it safe, IEEE Robotics & Automation Magazine, vol.11, issue.2, pp.12-2110, 2004.
DOI : 10.1109/MRA.2004.1310938