Recognition of Group Activities in Videos Based on Single- and Two-Person Descriptors

Stéphane Lathuilière 1 Georgios Evangelidis 1 Radu Horaud 1
1 PERCEPTION - Interpretation and Modelling of Images and Videos
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : Group activity recognition from videos is a very challenging problem that has barely been addressed. We propose an activity recognition method using group context. In order to encode both single-person description and two-person interactions, we learn mappings from high-dimensional feature spaces to low-dimensional dictionaries. In particular the proposed two-person descriptor takes into account geometric characteristics of the relative pose and motion between the two persons. Both single-person and two-person representations are then used to define unary and pairwise potentials of an energy function, whose optimization leads to the structured labeling of persons involved in the same activity. An interesting feature of the proposed method is that, unlike the vast majority of existing methods, it is able to recognize multiple distinct group activities occurring simultaneously in a video. The proposed method is evaluated with datasets widely used for group activity recognition, and is compared with several baseline methods.
Document type :
Conference papers
Complete list of metadatas

Cited literature [38 references]  Display  Hide  Download


https://hal.inria.fr/hal-01430732
Contributor : Team Perception <>
Submitted on : Tuesday, January 10, 2017 - 11:03:20 AM
Last modification on : Thursday, May 24, 2018 - 5:56:55 PM
Long-term archiving on : Tuesday, April 11, 2017 - 2:06:20 PM

Files

main.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Stéphane Lathuilière, Georgios Evangelidis, Radu Horaud. Recognition of Group Activities in Videos Based on Single- and Two-Person Descriptors. IEEE Winter Conference on Applications of Computer Vision, Mar 2017, Santa Rosa, CA, United States. pp.217-225, ⟨10.1109/WACV.2017.31⟩. ⟨hal-01430732⟩

Share

Metrics

Record views

1213

Files downloads

476