Skip to Main content Skip to Navigation
Journal articles

Increasing Image Memorability with Neural Style Transfer

Abstract : Recent works in computer vision and multimedia have shown that image memorability can be automatically inferred exploiting powerful deep learning models. This paper advances the state of the art in this area by addressing a novel and more challenging issue: "Given an arbitrary input image, can we make it more memorable?". To tackle this problem we introduce an approach based on an editing-by-applying-filters paradigm: given an input image, we propose to automatically retrieve a set of "style seeds", i.e. a set of style images which, applied to the input image through a neural style transfer algorithm, provide the highest increase in memorability. We show the effectiveness of the proposed approach with experiments on the publicly available LaMem dataset, performing both a quantitative evaluation and a user study. To demonstrate the flexibility of the proposed framework, we also analyze the impact of different implementation choices, such as using different state of the art neural style transfer methods. Finally, we show several qualitative results to provide additional insights on the link between image style and memorability.
Complete list of metadata

Cited literature [47 references]  Display  Hide  Download

https://hal.inria.fr/hal-01858389
Contributor : Team Perception Connect in order to contact the contributor
Submitted on : Tuesday, November 3, 2020 - 11:50:21 AM
Last modification on : Tuesday, October 19, 2021 - 11:27:15 AM
Long-term archiving on: : Thursday, February 4, 2021 - 6:03:51 PM

File

Siarohin-TOMM-2019.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Aliaksandr Siarohin, Gloria Zen, Cveta Majtanovic, Xavier Alameda-Pineda, Elisa Ricci, et al.. Increasing Image Memorability with Neural Style Transfer. ACM Transactions on Multimedia Computing, Communications and Applications, Association for Computing Machinery, 2019, 15 (2), ⟨10.1145/3311781⟩. ⟨hal-01858389⟩

Share

Metrics

Record views

493

Files downloads

395