Abstract : We present in this paper, a facial expressions recognition system to command a mobile robot (Pionner-3DX). The proposed system mainly consists of two modules: facial expression recognition and robot command. The first module aims to recognize the facial expressions like happiness, sadness, surprise, anger, fear, disgust and neutral using Gradient Vector Flow (GVF) snake to find ROI (Region Of Interest like: mouth, eyes, eyebrow) segmentation from FEEDTUM database (video file). While the second module, analyses the segmented ROI to recognize with Euclidian distance calculation (compatible with the MPEG-4 description of the six universal emotions) and Time Delay Neural Network classifier. Finally, the recognized facial expressions were used as control commands for the mobile robot displacement (forward; backward; turn left; turn right) in ROS (Robot Operating System).
https://hal.inria.fr/hal-01913915
Contributor : Hal Ifip
<>
Submitted on : Wednesday, November 7, 2018 - 10:51:44 AM
Last modification on : Thursday, November 8, 2018 - 1:01:56 PM
Long-term archiving on : Friday, February 8, 2019 - 1:23:52 PM
File
Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed
until : 2021-01-01
Zekhnine Chérifa, Berrached Nasr Eddine. Facial Expressions Recognition: Development and Application to HMI. 6th IFIP International Conference on Computational Intelligence and Its Applications (CIIA), May 2018, Oran, Algeria. pp.573-584, ⟨10.1007/978-3-319-89743-1_49⟩. ⟨hal-01913915⟩
