Skip to Main content Skip to Navigation
Conference papers

Discovering Representations for Black-box Optimization

Adam Gaier 1, 2 Alexander Asteroth 1 Jean-Baptiste Mouret 2
2 LARSEN - Lifelong Autonomy and interaction skills for Robots in a Sensing ENvironment
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
Abstract : The encoding of solutions in black-box optimization is a delicate, handcrafted balance between expressiveness and domain knowledge between exploring a wide variety of solutions, and ensuring that those solutions are useful. Our main insight is that this process can be automated by generating a dataset of high-performing solutions with a quality diversity algorithm (here, MAP-Elites), then learning a representation with a generative model (here, a Varia-tional Autoencoder) from that dataset. Our second insight is that this representation can be used to scale quality diversity optimization to higher dimensions-but only if we carefully mix solutions generated with the learned representation and those generated with traditional variation operators. We demonstrate these capabilities by learning an low-dimensional encoding for the inverse kinemat-ics of a thousand joint planar arm. The results show that learned representations make it possible to solve high-dimensional problems with orders of magnitude fewer evaluations than the standard MAP-Elites, and that, once solved, the produced encoding can be used for rapid optimization of novel, but similar, tasks. The presented techniques not only scale up quality diversity algorithms to high dimensions, but show that black-box optimization encodings can be automatically learned, rather than hand designed.
Complete list of metadata

Cited literature [58 references]  Display  Hide  Download

https://hal.inria.fr/hal-02555221
Contributor : Jean-Baptiste Mouret <>
Submitted on : Monday, April 27, 2020 - 10:40:35 AM
Last modification on : Thursday, March 18, 2021 - 2:02:34 PM

File

dde_gecco.pdf
Publication funded by an institution

Identifiers

Citation

Adam Gaier, Alexander Asteroth, Jean-Baptiste Mouret. Discovering Representations for Black-box Optimization. GECCO'20 - Genetic and Evolutionary Computation Conference, Jul 2020, Cancun, Mexico. ⟨10.1145/3377930.3390221⟩. ⟨hal-02555221⟩

Share

Metrics

Record views

276

Files downloads

806