Skip to Main content Skip to Navigation
New interface
Conference papers

Enlarging hacker's toolbox: deluding image recognition by attacking keypoint orientations

Thanh-Toan Do 1 Ewa Kijak 1 Laurent Amsaleg 1 Teddy Furon 1 
1 TEXMEX - Multimedia content-based indexing
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, Inria Rennes – Bretagne Atlantique
Abstract : Content-Based Image Retrieval Systems (CBIRS) used in forensics related contexts require very good image recognition capabilities. Whereas the robustness criterion has been extensively covered by Computer Vision or Multimedia literature, none of these communities explored the security of CBIR systems. Recently, preliminary studies have shown real systems can be deluded by applying transformations to images that are very specific to the SIFT local description scheme commonly used for recognition. The work presented in this paper adds one %offensive strategy for attacking images, and somehow enlarges the box of tools hackers can use for deluding systems. This paper shows how the orientation of keypoints can be tweaked, which in turn lowers matches since this deeply changes the final SIFT feature vectors. The method learns what visual patch should be applied to change the orientation of keypoints thanks to an SVM-based process. Experiments with a database made of 100,000 real world images confirms the effectiveness of this keypoint-orientation attacking scheme.
Complete list of metadata

Cited literature [6 references]  Display  Hide  Download
Contributor : Teddy Furon Connect in order to contact the contributor
Submitted on : Wednesday, April 11, 2012 - 11:50:23 AM
Last modification on : Thursday, January 20, 2022 - 4:18:37 PM
Long-term archiving on: : Thursday, July 12, 2012 - 9:57:53 AM


Files produced by the author(s)


  • HAL Id : hal-00686809, version 1


Thanh-Toan Do, Ewa Kijak, Laurent Amsaleg, Teddy Furon. Enlarging hacker's toolbox: deluding image recognition by attacking keypoint orientations. ICASSP - 37th International Conference on Acoustics, Speech, and Signal Processing, Mar 2012, Kyoto, Japan. ⟨hal-00686809⟩



Record views


Files downloads