Multimodal Approach for Emotion Recognition Using a Formal Computational Model

Abstract : — Emotions play a crucial role in human-computer interaction. They are generally expressed and perceived through multiple modalities such as speech, facial expressions, physiological signals. Indeed, the complexity of emotions makes the acquisition very difficult and makes unimodal systems (i.e., the observation of only one source of emotion) unreliable and often unfeasible in applications of high complexity. Moreover the lack of a standard in human emotions modeling hinders the sharing of affective information between applications. In this paper, we present a multimodal approach for the emotion recognition from many sources of information. This paper aims to provide a multi-modal system for emotion recognition and exchange that will facilitate inter-systems exchanges and improve the credibility of emotional interaction between users and computers. We elaborate a multimodal emotion recognition method from Physiological Data based on signal processing algorithms. Our method permits to recognize emotion composed of several aspects like simulated and masked emotions. This method uses a new multidimensional model to represent emotional states based on an algebraic representation. The experimental results show that the proposed multimodal emotion recognition method improves the recognition rates in comparison to the unimodal approach. Compared to the state of art multimodal techniques, the proposed method gives a good results with 72% of correct.
Liste complète des métadonnées

Littérature citée [40 références]  Voir  Masquer  Télécharger
Contributeur : Nhan Le Thanh <>
Soumis le : mardi 18 août 2015 - 18:22:11
Dernière modification le : lundi 5 novembre 2018 - 15:52:09
Document(s) archivé(s) le : jeudi 19 novembre 2015 - 10:58:21


Multimodal Approach for Emotio...
Fichiers produits par l'(les) auteur(s)




Imen Tayari-Meftah, Nhan Le Thanh, Chokri Ben-Amar. Multimodal Approach for Emotion Recognition Using a Formal Computational Model. IJAEC, IGI Publishing, 2013, Applied Evolutionary Computation, 4 (3), pp.15. 〈〉. 〈10.4018/jaec.2013070102〉. 〈hal-01185001〉



Consultations de la notice


Téléchargements de fichiers