Face detection and tracking in a video by propagating detection probabilities

Ragini Choudhury Verma 1 Cordelia Schmid 2 Krystian Mikolajczyk 2
2 MOVI - Modeling, localization, recognition and interpretation in computer vision
GRAVIR - IMAG - Graphisme, Vision et Robotique, Inria Grenoble - Rhône-Alpes, CNRS - Centre National de la Recherche Scientifique : FR71
Abstract : This paper presents a new probabilistic method for detecting and tracking multiple faces in a video sequence. The proposed method integrates the information of face probabilities provided by the detector and the temporal information provided by the tracker to produce a method superior to the available detection and tracking methods. The three novel contributions of the paper are: 1) Accumulation of probabilities of detection over a sequence. This leads to coherent detection over time and, thus, improves detection results. 2) Prediction of the detection parameters which are position, scale, and pose. This guarantees the accuracy of accumulation as well as a continuous detection. 3) The representation of pose is based on the combination of two detectors, one for frontal views and one for profiles. Face detection is fully automatic and is based on the method developed by Schneiderman and Kanade (2000). It uses local histograms of wavelet coefficients represented with respect to a coordinate frame fixed to the object. A probability of detection is obtained for each image position and at several scales and poses. The probabilities of detection are propagated over time using a Condensation filter and factored sampling. Prediction is based on a zero order model for position, scale, and pose; update uses the probability maps produced by the detection routine. The proposed method can handle multiple faces, appearing/disappearing faces as well as changing scale and pose. Experiments carried out on a large number of sequences taken from commercial movies and the Web show a clear improvement over the results of frame-based detection (in which the detector is applied to each frame of the video sequence).
Type de document :
Article dans une revue
IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2003, 25 (10), pp.1215--1228. 〈http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1233896〉. 〈10.1109/TPAMI.2003.1233896〉
Liste complète des métadonnées

https://hal.inria.fr/inria-00548243
Contributeur : Thoth Team <>
Soumis le : lundi 20 décembre 2010 - 08:42:14
Dernière modification le : jeudi 11 janvier 2018 - 06:20:04

Identifiants

Collections

IMAG | INRIA | UGA

Citation

Ragini Choudhury Verma, Cordelia Schmid, Krystian Mikolajczyk. Face detection and tracking in a video by propagating detection probabilities. IEEE Transactions on Pattern Analysis and Machine Intelligence, Institute of Electrical and Electronics Engineers, 2003, 25 (10), pp.1215--1228. 〈http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1233896〉. 〈10.1109/TPAMI.2003.1233896〉. 〈inria-00548243〉

Partager

Métriques

Consultations de la notice

123