Multimodal Approach for Emotion Recognition Using a Formal Computational Model

Abstract : — Emotions play a crucial role in human-computer interaction. They are generally expressed and perceived through multiple modalities such as speech, facial expressions, physiological signals. Indeed, the complexity of emotions makes the acquisition very difficult and makes unimodal systems (i.e., the observation of only one source of emotion) unreliable and often unfeasible in applications of high complexity. Moreover the lack of a standard in human emotions modeling hinders the sharing of affective information between applications. In this paper, we present a multimodal approach for the emotion recognition from many sources of information. This paper aims to provide a multi-modal system for emotion recognition and exchange that will facilitate inter-systems exchanges and improve the credibility of emotional interaction between users and computers. We elaborate a multimodal emotion recognition method from Physiological Data based on signal processing algorithms. Our method permits to recognize emotion composed of several aspects like simulated and masked emotions. This method uses a new multidimensional model to represent emotional states based on an algebraic representation. The experimental results show that the proposed multimodal emotion recognition method improves the recognition rates in comparison to the unimodal approach. Compared to the state of art multimodal techniques, the proposed method gives a good results with 72% of correct.
Liste complète des métadonnées
Contributeur : Nhan Le Thanh <>
Soumis le : mardi 18 août 2015 - 18:22:11
Dernière modification le : mercredi 14 décembre 2016 - 01:07:16
Document(s) archivé(s) le : jeudi 19 novembre 2015 - 10:58:21


Multimodal Approach for Emotio...
Fichiers produits par l'(les) auteur(s)




Imen Tayari Meftah, Nhan Le Thanh, Chokri Ben Amar. Multimodal Approach for Emotion Recognition Using a Formal Computational Model. IJAEC, IGI Publishing, 2013, Applied Evolutionary Computation, 4 (3), pp.15. <>. <10.4018/jaec.2013070102>. <hal-01185001>



Consultations de
la notice


Téléchargements du document