Skip to Main content Skip to Navigation
Conference papers

Semi-supervised Emotion Recognition using Inconsistently Annotated Data

Abstract : Expression recognition remains challenging, predominantly due to (a) lack of sufficient data, (b) subtle emotion intensity, (c) subjective and inconsistent annotation, as well as due to (d) in-the-wild data containing variations in pose, intensity, and occlusion. To address such challenges in a unified framework, we propose a self-training based semi-supervised convolutional neural network (CNN) framework, which directly addresses the problem of (a) limited data by leveraging information from unannotated samples. Our method uses 'successive label smoothing' to adapt to the subtle expressions and improve the model performance for (b) low-intensity expression samples. Further, we address (c) inconsistent annotations by assigning sample weights during loss computation, thereby ignoring the effect of incorrect ground-truth. We observe significant performance improvement in in-the-wild datasets by leveraging the information from the in-the-lab datasets, related to challenge (d). Associated to that, experiments on four publicly available datasets demonstrate large performance gains in cross-database performance, as well as show that the proposed method achieves to learn different expression intensities, even when trained with categorical samples.
Document type :
Conference papers
Complete list of metadatas

Cited literature [38 references]  Display  Hide  Download

https://hal.inria.fr/hal-02969840
Contributor : Antitza Dantcheva <>
Submitted on : Friday, October 16, 2020 - 10:18:26 PM
Last modification on : Tuesday, October 20, 2020 - 3:37:24 AM

File

happy-FG20.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02969840, version 1

Citation

S Happy, Antitza Dantcheva, Francois Bremond. Semi-supervised Emotion Recognition using Inconsistently Annotated Data. FG 2020 - 15th IEEE International Conference on Automatic Face and Gesture Recognition, May 2020, Buenos Aires / Virtual, Argentina. ⟨hal-02969840⟩

Share

Metrics

Record views

18

Files downloads

52