Skip to Main content Skip to Navigation
Conference papers

Comparing methods for assessment of facial dynamics in patients with major neurocognitive disorders

Abstract : Assessing facial dynamics in patients with major neurocogni-tive disorders and specifically with Alzheimers disease (AD) has shown to be highly challenging. Classically such assessment is performed by clinical staff, evaluating verbal and non-verbal language of AD-patients, since they have lost a substantial amount of their cognitive capacity, and hence communication ability. In addition, patients need to communicate important messages, such as discomfort or pain. Automated methods would support the current healthcare system by allowing for telemedicine, i.e., lesser costly and logistically inconvenient examination. In this work we compare methods for assessing facial dynamics such as talking, singing, neutral and smiling in AD-patients, captured during music mnemotherapy sessions. Specifically, we compare 3D Con-vNets, Very Deep Neural Network based Two-Stream ConvNets, as well as Improved Dense Trajectories. We have adapted these methods from prominent action recognition methods and our promising results suggest that the methods generalize well to the context of facial dynamics. The Two-Stream ConvNets in combination with ResNet-152 obtains the best performance on our dataset, capturing well even minor facial dynamics and has thus sparked high interest in the medical community.
Document type :
Conference papers
Complete list of metadata

Cited literature [46 references]  Display  Hide  Download
Contributor : Antitza Dantcheva Connect in order to contact the contributor
Submitted on : Friday, October 12, 2018 - 10:58:21 AM
Last modification on : Saturday, June 25, 2022 - 11:32:02 PM
Long-term archiving on: : Sunday, January 13, 2019 - 1:15:56 PM


Files produced by the author(s)


  • HAL Id : hal-01894162, version 1



Yaohui Wang, Antitza Dantcheva, Jean-Claude Broutart, Philippe Robert, Francois Bremond, et al.. Comparing methods for assessment of facial dynamics in patients with major neurocognitive disorders. ECCVW 2018 - European Conference of Computer Vision Workshops, Sep 2018, Munich, Germany. ⟨hal-01894162⟩



Record views


Files downloads