NV-tree: An Efficient Disk-Based Index for Approximate Search in Very Large High-Dimensional Collections - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Pattern Analysis and Machine Intelligence Année : 2009

NV-tree: An Efficient Disk-Based Index for Approximate Search in Very Large High-Dimensional Collections

Résumé

Over the last two decades, much research effort has been spent on nearest neighbor search in high-dimensional data sets. Most of the approaches published thus far have, however, only been tested on rather small collections. When large collections have been considered, high-performance environments have been used, in particular systems with a large main memory. Accessing data on disk has largely been avoided because disk operations are considered to be too slow. It has been shown, however, that using large amounts of memory is generally not an economic choice. Therefore, we propose the NV-tree, which is a very efficient disk-based data structure that can give good approximate answers to nearest neighbor queries with a single disk operation, even for very large collections of high-dimensional data. Using a single NV-tree, the returned results have high recall but contain a number of false positives. By combining two or three NV-trees, most of those false positives can be avoided while retaining the high recall. Finally, we compare the NV-tree to locality sensitive hashing, a popular method for ??-distance search. We show that they return results of similar quality, but the NV-tree uses many fewer disk reads
Fichier non déposé

Dates et versions

hal-00794359 , version 1 (25-02-2013)

Identifiants

Citer

Herwig Lejsek, Friðrik-Heidar Heiðar Ásmundsson, Björn Þór Jónsson, Laurent Amsaleg. NV-tree: An Efficient Disk-Based Index for Approximate Search in Very Large High-Dimensional Collections. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009, 31 (5), pp.869-883. ⟨10.1109/TPAMI.2008.130⟩. ⟨hal-00794359⟩
330 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More