Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, Epiciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Conference papers

Representing Visual Appearance by Video Brownian Covariance Descriptor for Human Action Recognition

Piotr Bilinski 1 Michal Koperski 1 Slawomir Bak 1 François Bremond 1 
1 STARS - Spatio-Temporal Activity Recognition Systems
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : This paper addresses a problem of recognizing human actions in video sequences. Recent studies have shown that methods which use bag-of-features and space-time features achieve high recognition accuracy. Such methods extract both appearance-based and motion-based features. This paper focuses only on appearance features. We proposeto model relationships between different pixel-level appearance features such as intensity and gradient using Brownian covariance, which is a natural extension of classical covariance measure. While classical covariance can model only linear relationships, Brownian covariance models all kinds of possible relationships. We propose a method to compute Brownian covariance on space-time volume of a video sequence. We show that proposed Video Brownian Covariance (VBC) descriptor carries complementary information to the Histogram of Oriented Gradients (HOG) descriptor. The fusion of these two descriptors gives a significant improvement in performance on three challenging action recognition datasets.
Document type :
Conference papers
Complete list of metadata

Cited literature [22 references]  Display  Hide  Download
Contributor : Michal Koperski Connect in order to contact the contributor
Submitted on : Thursday, November 6, 2014 - 3:00:51 PM
Last modification on : Saturday, June 25, 2022 - 11:14:54 PM
Long-term archiving on: : Friday, April 14, 2017 - 3:02:39 PM


Files produced by the author(s)


  • HAL Id : hal-01054943, version 2



Piotr Bilinski, Michal Koperski, Slawomir Bak, François Bremond. Representing Visual Appearance by Video Brownian Covariance Descriptor for Human Action Recognition. AVSS - 11th IEEE International Conference on Advanced Video and Signal-Based Surveillance, IEEE, Aug 2014, Seoul, South Korea. ⟨hal-01054943v2⟩



Record views


Files downloads