Skip to Main content Skip to Navigation
New interface
Journal articles

Increasing Image Memorability with Neural Style Transfer

Aliaksandr Siarohin 1 Gloria Zen 1 Cveta Majtanovic 1 Xavier Alameda-Pineda 2 Elisa Ricci 1, 3 Nicu Sebe 1 
2 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology, LJK - Laboratoire Jean Kuntzmann
Abstract : Recent works in computer vision and multimedia have shown that image memorability can be automatically inferred exploiting powerful deep learning models. This paper advances the state of the art in this area by addressing a novel and more challenging issue: "Given an arbitrary input image, can we make it more memorable?". To tackle this problem we introduce an approach based on an editing-by-applying-filters paradigm: given an input image, we propose to automatically retrieve a set of "style seeds", i.e. a set of style images which, applied to the input image through a neural style transfer algorithm, provide the highest increase in memorability. We show the effectiveness of the proposed approach with experiments on the publicly available LaMem dataset, performing both a quantitative evaluation and a user study. To demonstrate the flexibility of the proposed framework, we also analyze the impact of different implementation choices, such as using different state of the art neural style transfer methods. Finally, we show several qualitative results to provide additional insights on the link between image style and memorability.
Complete list of metadata

Cited literature [47 references]  Display  Hide  Download
Contributor : Perception team Connect in order to contact the contributor
Submitted on : Tuesday, November 3, 2020 - 11:50:21 AM
Last modification on : Saturday, July 23, 2022 - 3:53:08 AM
Long-term archiving on: : Thursday, February 4, 2021 - 6:03:51 PM


Files produced by the author(s)



Aliaksandr Siarohin, Gloria Zen, Cveta Majtanovic, Xavier Alameda-Pineda, Elisa Ricci, et al.. Increasing Image Memorability with Neural Style Transfer. ACM Transactions on Multimedia Computing, Communications and Applications, 2019, 15 (2), ⟨10.1145/3311781⟩. ⟨hal-01858389⟩



Record views


Files downloads