Skip to Main content Skip to Navigation
Conference papers

Group-Level Emotion Recognition Using a Unimodal Privacy-Safe Non-Individual Approach

Abstract : This article presents our unimodal privacy-safe and non-individual proposal for the audio-video group emotion recognition subtask at the Emotion Recognition in the Wild (EmotiW) Challenge 2020 1. This sub challenge aims to classify in the wild videos into three categories: Positive, Neutral and Negative. Recent deep learning models have shown tremendous advances in analyzing interactions between people, predicting human behavior and affective evaluation. Nonetheless, their performance comes from individual-based analysis, which means summing up and averaging scores from individual detections, which inevitably leads to some privacy issues. In this research, we investigated a frugal approach towards a model able to capture the global moods from the whole image without using face or pose detection, or any individual-based feature as input. The proposed methodology mixes state-of-the-art and dedicated synthetic corpora as training sources. With an in-depth exploration of neural network architectures for group-level emotion recognition, we built a VGG-based model achieving 59.13% accuracy on the VGAF test set (eleventh place of the challenge). Given that the analysis is unimodal based only on global features and that the performance is evaluated on a real-world dataset, these results are promising and let us envision extending this model to multimodality for classroom ambiance evaluation, our final target application.
Complete list of metadata

Cited literature [46 references]  Display  Hide  Download
Contributor : Dominique Vaufreydaz Connect in order to contact the contributor
Submitted on : Tuesday, September 15, 2020 - 1:51:56 PM
Last modification on : Friday, August 5, 2022 - 10:31:50 AM
Long-term archiving on: : Thursday, December 3, 2020 - 4:11:35 AM


Files produced by the author(s)


  • HAL Id : hal-02937871, version 1
  • ARXIV : 2009.07013


Anastasia Petrova, Dominique Vaufreydaz, Philippe Dessus. Group-Level Emotion Recognition Using a Unimodal Privacy-Safe Non-Individual Approach. EmotiW2020 Challenge at the 22nd ACM International Conference on Multimodal Interaction (ICMI2020), Oct 2020, Utrecht, Netherlands. ⟨hal-02937871⟩



Record views


Files downloads