Skip to Main content Skip to Navigation
Journal articles

Recognizing Gestures by Learning Local Motion Signatures of HOG Descriptors

Abstract : We introduce a new gesture recognition framework based on learning local motion signatures (LMSs) of HOG descriptors . Our main contribution is to propose a new probabilistic learning-classification scheme based on a reliable tracking of local features. After the generation of these LMSs computed on one individual by tracking Histograms of Oriented Gradient (HOG) descriptor, we learn a code-book of video-words (i.e. clusters of LMSs) using kmeans algorithm on a learning gesture video database. Then the video-words are compacted to a code-book of code-words by the Maximization of Mutual Information (MMI) algorithm. At the final step, we compare the LMSs generated for a new gesture w.r.t. the learned code-book via the k-nearest neighbors (k-NN) algorithm and a novel voting strategy. Our main contribution is the handling of the N to N mapping between code-words and gesture labels within the proposed voting strategy. Experiments have been carried out on two public gesture databases: KTH and IXMAS . Results show that the proposed method outperforms recent state-of-the-art methods
Document type :
Journal articles
Complete list of metadata

Cited literature [31 references]  Display  Hide  Download
Contributor : Francois Bremond <>
Submitted on : Friday, May 11, 2012 - 3:22:24 PM
Last modification on : Thursday, March 5, 2020 - 5:34:13 PM
Long-term archiving on: : Sunday, August 12, 2012 - 2:38:50 AM


Files produced by the author(s)


  • HAL Id : hal-00696371, version 1



Mohamed Kaâniche, Francois Bremond. Recognizing Gestures by Learning Local Motion Signatures of HOG Descriptors. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2012. ⟨hal-00696371⟩



Record views


Files downloads