Comparing methods for assessment of facial dynamics in patients with major neurocognitive disorders - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2018

Comparing methods for assessment of facial dynamics in patients with major neurocognitive disorders

Résumé

Assessing facial dynamics in patients with major neurocogni-tive disorders and specifically with Alzheimers disease (AD) has shown to be highly challenging. Classically such assessment is performed by clinical staff, evaluating verbal and non-verbal language of AD-patients, since they have lost a substantial amount of their cognitive capacity, and hence communication ability. In addition, patients need to communicate important messages, such as discomfort or pain. Automated methods would support the current healthcare system by allowing for telemedicine, i.e., lesser costly and logistically inconvenient examination. In this work we compare methods for assessing facial dynamics such as talking, singing, neutral and smiling in AD-patients, captured during music mnemotherapy sessions. Specifically, we compare 3D Con-vNets, Very Deep Neural Network based Two-Stream ConvNets, as well as Improved Dense Trajectories. We have adapted these methods from prominent action recognition methods and our promising results suggest that the methods generalize well to the context of facial dynamics. The Two-Stream ConvNets in combination with ResNet-152 obtains the best performance on our dataset, capturing well even minor facial dynamics and has thus sparked high interest in the medical community.
Fichier principal
Vignette du fichier
WangDantchevaBroutartRobertBremondBilinski_ECCVW_18.pdf (955.1 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01894162 , version 1 (12-10-2018)

Identifiants

  • HAL Id : hal-01894162 , version 1

Citer

Yaohui Wang, Antitza Dantcheva, Jean-Claude Broutart, Philippe Robert, Francois Bremond, et al.. Comparing methods for assessment of facial dynamics in patients with major neurocognitive disorders. ECCVW 2018 - European Conference of Computer Vision Workshops, Sep 2018, Munich, Germany. ⟨hal-01894162⟩
118 Consultations
164 Téléchargements

Partager

Gmail Facebook X LinkedIn More