Comparing methods for assessment of facial dynamics in patients with major neurocognitive disorders

Abstract : Assessing facial dynamics in patients with major neurocogni-tive disorders and specifically with Alzheimers disease (AD) has shown to be highly challenging. Classically such assessment is performed by clinical staff, evaluating verbal and non-verbal language of AD-patients, since they have lost a substantial amount of their cognitive capacity, and hence communication ability. In addition, patients need to communicate important messages, such as discomfort or pain. Automated methods would support the current healthcare system by allowing for telemedicine, i.e., lesser costly and logistically inconvenient examination. In this work we compare methods for assessing facial dynamics such as talking, singing, neutral and smiling in AD-patients, captured during music mnemotherapy sessions. Specifically, we compare 3D Con-vNets, Very Deep Neural Network based Two-Stream ConvNets, as well as Improved Dense Trajectories. We have adapted these methods from prominent action recognition methods and our promising results suggest that the methods generalize well to the context of facial dynamics. The Two-Stream ConvNets in combination with ResNet-152 obtains the best performance on our dataset, capturing well even minor facial dynamics and has thus sparked high interest in the medical community.
Document type :
Conference papers
Complete list of metadatas

Cited literature [7 references]  Display  Hide  Download

https://hal.inria.fr/hal-01894162
Contributor : Antitza Dantcheva <>
Submitted on : Friday, October 12, 2018 - 10:58:21 AM
Last modification on : Thursday, February 7, 2019 - 5:08:13 PM
Long-term archiving on : Sunday, January 13, 2019 - 1:15:56 PM

File

WangDantchevaBroutartRobertBre...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01894162, version 1

Collections

Citation

Yaohui Wang, Antitza Dantcheva, Jean-Claude Broutart, Philippe Robert, Francois Bremond, et al.. Comparing methods for assessment of facial dynamics in patients with major neurocognitive disorders. ECCVW 2018 - European Conference of Computer Vision Workshops, Sep 2018, Munich, Germany. ⟨hal-01894162⟩

Share

Metrics

Record views

112

Files downloads

64