Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, EpiSciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Journal articles

A Weakly Supervised Learning Technique for Classifying Facial Expressions

S L Happy 1 Antitza Dantcheva 1 Francois F Bremond 1 
1 STARS - Spatio-Temporal Activity Recognition Systems
CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : The universal hypothesis suggests that the six basic emotions-anger, disgust, fear, happiness, sadness, and surprise-are being expressed by similar facial expressions by all humans. While existing datasets support the universal hypothesis and comprise of images and videos with discrete disjoint labels of profound emotions, real-life data contains jointly occurring emotions and expressions of different intensities. Models, which are trained using categorical one-hot vectors often over-fit and fail to recognize low or moderate expression intensities. Motivated by the above, as well as by the lack of sufficient annotated data, we here propose a weakly supervised learning technique for expression classification, which leverages the information of unannotated data. Crucial in our approach is that we first train a convolutional neural network (CNN) with label smoothing in a supervised manner and proceed to tune the CNN-weights with both labelled and unlabelled data simultaneously. Experiments on four datasets demonstrate large performance gains in cross-database performance, as well as show that the proposed method achieves to learn different expression intensities, even when trained with categorical samples.
Document type :
Journal articles
Complete list of metadata

Cited literature [40 references]  Display  Hide  Download
Contributor : Antitza Dantcheva Connect in order to contact the contributor
Submitted on : Tuesday, November 26, 2019 - 3:58:33 PM
Last modification on : Saturday, June 25, 2022 - 11:40:58 PM


Files produced by the author(s)



S L Happy, Antitza Dantcheva, Francois F Bremond. A Weakly Supervised Learning Technique for Classifying Facial Expressions. Pattern Recognition Letters, Elsevier, 2019, ⟨10.1016/j.patrec.2019.08.025⟩. ⟨hal-02381439⟩



Record views


Files downloads