Skip to Main content Skip to Navigation
New interface
Journal articles

Multimodal Approach for Emotion Recognition Using a Formal Computational Model

Abstract : — Emotions play a crucial role in human-computer interaction. They are generally expressed and perceived through multiple modalities such as speech, facial expressions, physiological signals. Indeed, the complexity of emotions makes the acquisition very difficult and makes unimodal systems (i.e., the observation of only one source of emotion) unreliable and often unfeasible in applications of high complexity. Moreover the lack of a standard in human emotions modeling hinders the sharing of affective information between applications. In this paper, we present a multimodal approach for the emotion recognition from many sources of information. This paper aims to provide a multi-modal system for emotion recognition and exchange that will facilitate inter-systems exchanges and improve the credibility of emotional interaction between users and computers. We elaborate a multimodal emotion recognition method from Physiological Data based on signal processing algorithms. Our method permits to recognize emotion composed of several aspects like simulated and masked emotions. This method uses a new multidimensional model to represent emotional states based on an algebraic representation. The experimental results show that the proposed multimodal emotion recognition method improves the recognition rates in comparison to the unimodal approach. Compared to the state of art multimodal techniques, the proposed method gives a good results with 72% of correct.
Complete list of metadata

Cited literature [40 references]  Display  Hide  Download
Contributor : Nhan Le Thanh Connect in order to contact the contributor
Submitted on : Tuesday, August 18, 2015 - 6:22:11 PM
Last modification on : Thursday, August 4, 2022 - 4:54:57 PM
Long-term archiving on: : Thursday, November 19, 2015 - 10:58:21 AM


Multimodal Approach for Emotio...
Files produced by the author(s)




Imen Tayari-Meftah, Nhan Le Thanh, Chokri Ben-Amar. Multimodal Approach for Emotion Recognition Using a Formal Computational Model. International Journal of Applied Evolutionary Computation, 2013, Applied Evolutionary Computation, 4 (3), pp.15. ⟨10.4018/jaec.2013070102⟩. ⟨hal-01185001⟩



Record views


Files downloads