Unsupervised Learning of Artistic Styles with Archetypal Style Analysis

Daan Wynen 1 Cordelia Schmid 1 Julien Mairal 1
1 Thoth - Apprentissage de modèles à partir de données massives
LJK - Laboratoire Jean Kuntzmann, Inria Grenoble - Rhône-Alpes
Abstract : In this paper, we introduce an unsupervised learning approach to automatically discover , summarize, and manipulate artistic styles from large collections of paintings. Our method is based on archetypal analysis, which is an unsupervised learning technique akin to sparse coding with a geometric interpretation. When applied to deep image representations from a collection of artworks, it learns a dictionary of archetypal styles, which can be easily visualized. After training the model, the style of a new image, which is characterized by local statistics of deep visual features, is approximated by a sparse convex combination of archetypes. This enables us to interpret which archetypal styles are present in the input image, and in which proportion. Finally, our approach allows us to manipulate the coefficients of the latent archetypal decomposition, and achieve various special effects such as style enhancement, transfer, and interpolation between multiple archetypes.
Complete list of metadatas

Cited literature [24 references]  Display  Hide  Download

https://hal.inria.fr/hal-01802131
Contributor : Daan Wynen <>
Submitted on : Tuesday, May 29, 2018 - 9:10:32 AM
Last modification on : Tuesday, June 18, 2019 - 3:14:07 PM
Long-term archiving on: Thursday, August 30, 2018 - 12:42:01 PM

File

archetypal_style.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01802131, version 1

Citation

Daan Wynen, Cordelia Schmid, Julien Mairal. Unsupervised Learning of Artistic Styles with Archetypal Style Analysis. 2018. ⟨hal-01802131v1⟩

Share

Metrics

Record views

347

Files downloads

191