A New Evaluation Approach for Video Processing Algorithms

Abstract : We present a new evaluation methodology to better evaluate video processing performance. Recent evaluation methods depend heavily on the benchmark dataset. The result may be different if we change the testing video sequences. The difference is mainly due to the video sequence content which usually includes many video processing problems (illumination changes, weak contrast etc.) at different difficulty levels. Hence it is difficult to extrapolate the evaluation result on new sequences. In this paper, we propose an evaluation methodology that help to reuse the evaluation result. We try to isolate each video processing problem and define quantitative measures to compute the difficulty level of a video relatively to the given problem. The maximum difficulty level of the videos at which the algorithm is performing good enough is defined as the upper bound of the algorithm capacity for handling the problem. To illustrate this methodology, we present metrics that evaluate the algorithm performance relatively to the problems of handling weakly contrasted objects and shadows.
Type de document :
Communication dans un congrès
IEEE Workshop on Motion and Video Computing, Feb 2007, Austin, Texas, United States. 2007
Liste complète des métadonnées

Littérature citée [5 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00502955
Contributeur : Anh-Tuan Nghiem <>
Soumis le : vendredi 16 juillet 2010 - 11:05:06
Dernière modification le : mercredi 15 septembre 2010 - 16:33:11
Document(s) archivé(s) le : vendredi 22 octobre 2010 - 11:56:32

Fichier

nghiem-evaluationApproach.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : inria-00502955, version 1

Collections

Citation

Anh-Tuan Nghiem, François Bremond, Monique Thonnat, Ma Ruihua. A New Evaluation Approach for Video Processing Algorithms. IEEE Workshop on Motion and Video Computing, Feb 2007, Austin, Texas, United States. 2007. 〈inria-00502955〉

Partager

Métriques

Consultations de
la notice

201

Téléchargements du document

156