Facial Expressions Recognition: Development and Application to HMI

Abstract : We present in this paper, a facial expressions recognition system to command a mobile robot (Pionner-3DX). The proposed system mainly consists of two modules: facial expression recognition and robot command. The first module aims to recognize the facial expressions like happiness, sadness, surprise, anger, fear, disgust and neutral using Gradient Vector Flow (GVF) snake to find ROI (Region Of Interest like: mouth, eyes, eyebrow) segmentation from FEEDTUM database (video file). While the second module, analyses the segmented ROI to recognize with Euclidian distance calculation (compatible with the MPEG-4 description of the six universal emotions) and Time Delay Neural Network classifier. Finally, the recognized facial expressions were used as control commands for the mobile robot displacement (forward; backward; turn left; turn right) in ROS (Robot Operating System).
Document type :
Conference papers
Liste complète des métadonnées

Contributor : Hal Ifip <>
Submitted on : Wednesday, November 7, 2018 - 10:51:44 AM
Last modification on : Thursday, November 8, 2018 - 1:01:56 PM
Document(s) archivé(s) le : Friday, February 8, 2019 - 1:23:52 PM


 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : 2021-01-01

Please log in to resquest access to the document


Distributed under a Creative Commons Attribution 4.0 International License



Zekhnine Chérifa, Berrached Nasr Eddine. Facial Expressions Recognition: Development and Application to HMI. Abdelmalek Amine; Malek Mouhoub; Otmane Ait Mohamed; Bachir Djebbar. 6th IFIP International Conference on Computational Intelligence and Its Applications (CIIA), May 2018, Oran, Algeria. Springer International Publishing, IFIP Advances in Information and Communication Technology, AICT-522, pp.573-584, 2018, Computational Intelligence and Its Applications. 〈10.1007/978-3-319-89743-1_49〉. 〈hal-01913915〉



Record views