A New Evaluation Approach for Video Processing Algorithms

Abstract : We present a new evaluation methodology to better evaluate video processing performance. Recent evaluation methods depend heavily on the benchmark dataset. The result may be different if we change the testing video sequences. The difference is mainly due to the video sequence content which usually includes many video processing problems (illumination changes, weak contrast etc.) at different difficulty levels. Hence it is difficult to extrapolate the evaluation result on new sequences. In this paper, we propose an evaluation methodology that help to reuse the evaluation result. We try to isolate each video processing problem and define quantitative measures to compute the difficulty level of a video relatively to the given problem. The maximum difficulty level of the videos at which the algorithm is performing good enough is defined as the upper bound of the algorithm capacity for handling the problem. To illustrate this methodology, we present metrics that evaluate the algorithm performance relatively to the problems of handling weakly contrasted objects and shadows.
Document type :
Conference papers
Complete list of metadatas

Cited literature [5 references]  Display  Hide  Download

https://hal.inria.fr/inria-00502955
Contributor : Anh-Tuan Nghiem <>
Submitted on : Friday, July 16, 2010 - 11:05:06 AM
Last modification on : Tuesday, July 24, 2018 - 3:48:06 PM
Long-term archiving on : Friday, October 22, 2010 - 11:56:32 AM

File

nghiem-evaluationApproach.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00502955, version 1

Collections

Citation

Anh-Tuan Nghiem, François Bremond, Monique Thonnat, Ma Ruihua. A New Evaluation Approach for Video Processing Algorithms. IEEE Workshop on Motion and Video Computing, Feb 2007, Austin, Texas, United States. ⟨inria-00502955⟩

Share

Metrics

Record views

246

Files downloads

223