Finding Groups of Duplicate Images In Very Large Dataset - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2012

Finding Groups of Duplicate Images In Very Large Dataset

Abstract

This paper addresses the problem of detecting groups of duplicates in large-scale unstructured image datasets such as the Internet. Leveraging the recent progress in data mining, we propose an efficient approach based on the search of closed patterns. Moreover, we present a novel way to encode the bag-of-words image representation into data mining transactions. We validate our approach on a new dataset of one million Internet images obtained with random searches on Google image search. Using the proposed method, we find more than 80 thousands groups of duplicates among the one million images in less than three minutes while using only 150 Megabytes of memory. Unlike other existing approaches, our method can scale gracefully to larger datasets as it has linear time and space (memory) complexities. Furthermore, the approach does not need (to build or use) any precomputed indexing structure.
Fichier principal
Vignette du fichier
12_bmvc_LargeDataetsMining.pdf (4.5 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-00806196 , version 1 (29-03-2013)

Identifiers

  • HAL Id : hal-00806196 , version 1

Cite

Winn Voravuthikunchai, Bruno Crémilleux, Frédéric Jurie. Finding Groups of Duplicate Images In Very Large Dataset. Proceedings of the British Machine Vision Conference (BMVC 2012), Sep 2012, Guildford, United Kingdom. pp.105.1--105.12. ⟨hal-00806196⟩
316 View
356 Download

Share

Gmail Facebook X LinkedIn More