Representing Visual Appearance by Video Brownian Covariance Descriptor for Human Action Recognition

Abstract : This paper addresses a problem of recognizing human actions in video sequences. Recent studies have shown that methods which use bag-of-features and space-time features achieve high recognition accuracy. Such methods extract both appearance-based and motion-based features. This paper focuses only on appearance features. We proposeto model relationships between different pixel-level appearance features such as intensity and gradient using Brownian covariance, which is a natural extension of classical covariance measure. While classical covariance can model only linear relationships, Brownian covariance models all kinds of possible relationships. We propose a method to compute Brownian covariance on space-time volume of a video sequence. We show that proposed Video Brownian Covariance (VBC) descriptor carries complementary information to the Histogram of Oriented Gradients (HOG) descriptor. The fusion of these two descriptors gives a significant improvement in performance on three challenging action recognition datasets.
Document type :
Conference papers
AVSS - 11th IEEE International Conference on Advanced Video and Signal-Based Surveillance, Aug 2014, Seoul, South Korea. 2014
Liste complète des métadonnées


https://hal.inria.fr/hal-01054943
Contributor : Michal Koperski <>
Submitted on : Thursday, November 6, 2014 - 3:00:51 PM
Last modification on : Monday, October 5, 2015 - 5:01:12 PM
Document(s) archivé(s) le : Friday, April 14, 2017 - 3:02:39 PM

File

Bilinski-VideoBrownianCovarian...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01054943, version 2

Collections

Citation

Piotr Bilinski, Michal Koperski, Slawomir Bak, François Bremond. Representing Visual Appearance by Video Brownian Covariance Descriptor for Human Action Recognition. AVSS - 11th IEEE International Conference on Advanced Video and Signal-Based Surveillance, Aug 2014, Seoul, South Korea. 2014. <hal-01054943v2>

Share

Metrics

Record views

193

Document downloads

239