Skip to Main content Skip to Navigation
Conference papers

Characterizing the State of Apathy with Facial Expression and Motion Analysis

Abstract : Reduced emotional response, lack of motivation, and limited social interaction comprise the major symptoms of apathy. Current methods for apathy diagnosis require the patient's presence in a clinic, and time consuming clinical interviews and questionnaires involving medical personnel, which are costly and logistically inconvenient for patients and clinical staff, hindering among other large scale diagnostics. In this paper we introduce a novel machine learning framework to classify apathetic and non-apathetic patients based on analysis of facial dynamics, entailing both emotion and facial movement. Our approach caters to the challenging setting of current apathy assessment interviews, which include short video clips with wide face pose variations, very low-intensity expressions, and insignificant inter-class variations. We test our algorithm on a dataset consisting of 90 video sequences acquired from 45 subjects and obtained an accuracy of 84% in apathy classification. Based on extensive experiments, we show that the fusion of emotion and facial local motion produces the best feature set for apathy classification. In addition, we train regression models to predict the clinical scores related to the mental state examination (MMSE) and the neuropsychiatric apathy inventory (NPI) using the motion and emotion features. Our results suggest that the performance can be further improved by appending the predicted clinical scores to the video-based feature representation.
Complete list of metadata

Cited literature [41 references]  Display  Hide  Download

https://hal.inria.fr/hal-02379341
Contributor : Antitza Dantcheva <>
Submitted on : Monday, November 25, 2019 - 4:08:25 PM
Last modification on : Thursday, January 21, 2021 - 2:32:02 PM
Long-term archiving on: : Wednesday, February 26, 2020 - 7:03:32 PM

File

apathy.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02379341, version 1

Citation

S Happy, Antitza Dantcheva, Abhijit Das, Radia Zeghari, Philippe Robert, et al.. Characterizing the State of Apathy with Facial Expression and Motion Analysis. FG 2019 - 14th IEEE International Conference on Automatic Face and Gesture Recognition, May 2019, Lille, France. ⟨hal-02379341⟩

Share

Metrics

Record views

131

Files downloads

664