Multimodal Approach for Emotion Recognition Using a Formal Computational Model

Abstract : — Emotions play a crucial role in human-computer interaction. They are generally expressed and perceived through multiple modalities such as speech, facial expressions, physiological signals. Indeed, the complexity of emotions makes the acquisition very difficult and makes unimodal systems (i.e., the observation of only one source of emotion) unreliable and often unfeasible in applications of high complexity. Moreover the lack of a standard in human emotions modeling hinders the sharing of affective information between applications. In this paper, we present a multimodal approach for the emotion recognition from many sources of information. This paper aims to provide a multi-modal system for emotion recognition and exchange that will facilitate inter-systems exchanges and improve the credibility of emotional interaction between users and computers. We elaborate a multimodal emotion recognition method from Physiological Data based on signal processing algorithms. Our method permits to recognize emotion composed of several aspects like simulated and masked emotions. This method uses a new multidimensional model to represent emotional states based on an algebraic representation. The experimental results show that the proposed multimodal emotion recognition method improves the recognition rates in comparison to the unimodal approach. Compared to the state of art multimodal techniques, the proposed method gives a good results with 72% of correct.
Complete list of metadatas

Cited literature [40 references]  Display  Hide  Download

https://hal.inria.fr/hal-01185001
Contributor : Nhan Le Thanh <>
Submitted on : Tuesday, August 18, 2015 - 6:22:11 PM
Last modification on : Monday, November 5, 2018 - 3:52:09 PM
Long-term archiving on : Thursday, November 19, 2015 - 10:58:21 AM

File

Multimodal Approach for Emotio...
Files produced by the author(s)

Identifiers

Collections

Citation

Imen Tayari-Meftah, Nhan Le Thanh, Chokri Ben-Amar. Multimodal Approach for Emotion Recognition Using a Formal Computational Model. IJAEC, IGI Publishing, 2013, Applied Evolutionary Computation, 4 (3), pp.15. ⟨http://www.igi-global.com/article/multimodal-approach-for-emotion-recognition-using-a-formal-computational-model/95955⟩. ⟨10.4018/jaec.2013070102⟩. ⟨hal-01185001⟩

Share

Metrics

Record views

460

Files downloads

1076