Facial Expressions Recognition: Development and Application to HMI

Abstract : We present in this paper, a facial expressions recognition system to command a mobile robot (Pionner-3DX). The proposed system mainly consists of two modules: facial expression recognition and robot command. The first module aims to recognize the facial expressions like happiness, sadness, surprise, anger, fear, disgust and neutral using Gradient Vector Flow (GVF) snake to find ROI (Region Of Interest like: mouth, eyes, eyebrow) segmentation from FEEDTUM database (video file). While the second module, analyses the segmented ROI to recognize with Euclidian distance calculation (compatible with the MPEG-4 description of the six universal emotions) and Time Delay Neural Network classifier. Finally, the recognized facial expressions were used as control commands for the mobile robot displacement (forward; backward; turn left; turn right) in ROS (Robot Operating System).
Document type :
Conference papers
Complete list of metadatas

Contributor : Hal Ifip <>
Submitted on : Wednesday, November 7, 2018 - 10:51:44 AM
Last modification on : Thursday, November 8, 2018 - 1:01:56 PM
Long-term archiving on : Friday, February 8, 2019 - 1:23:52 PM


 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : 2021-01-01

Please log in to resquest access to the document


Distributed under a Creative Commons Attribution 4.0 International License



Zekhnine Chérifa, Berrached Nasr Eddine. Facial Expressions Recognition: Development and Application to HMI. 6th IFIP International Conference on Computational Intelligence and Its Applications (CIIA), May 2018, Oran, Algeria. pp.573-584, ⟨10.1007/978-3-319-89743-1_49⟩. ⟨hal-01913915⟩



Record views