Multimodal acquisition of articulatory data: Geometrical and temporal registration

Michaël Aron 1 Marie-Odile Berger 2 Erwan Kerrien 2 Brigitte Wrobel-Dautcourt 2 Blaise Potard 3 Yves Laprie 4
2 MAGRIT - Visual Augmentation of Complex Environments
Inria Nancy - Grand Est, LORIA - ALGO - Department of Algorithms, Computation, Image and Geometry
3 PAROLE - Analysis, perception and recognition of speech
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
4 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Acquisition of dynamic articulatory data is of major importance for studying speech production. It turns out that one technique alone often is not enough to get a correct coverage of the whole vocal tract at a sufficient sampling rate. Ultrasound (US) imaging has been proposed as a good acquisition technique for the tongue surface because it offers a good temporal sampling, does not alter speech production, is cheap and widely available. However, it cannot be used alone and this paper describes a multimodal acquisition system which uses electromagnetography sensors to locate the US probe. The paper particularly focuses on the calibration of the ultrasound modality which is the key point of the system. This approach enables ultrasound data to be merged with other data. The use of the system is illustrated via an experiment consisting of measuring the minimal tongue to palate distance in order to evaluate and design Magnetic Resonance Imaging protocols well suited for the acquisition of 3D images of the vocal tract. Compared to manual registration of acquisition modalities which is often used in acquisition of articulatory data, the approach presented relies on automatic techniques well founded from geometrical and mathematical points of view.
Type de document :
Article dans une revue
Journal of the Acoustical Society of America, Acoustical Society of America, 2016, 139 (2), pp.13. 〈10.1121/1.4940666〉
Liste complète des métadonnées

Littérature citée [24 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/hal-01269578
Contributeur : Yves Laprie <>
Soumis le : vendredi 5 février 2016 - 09:33:59
Dernière modification le : vendredi 30 mars 2018 - 10:02:01
Document(s) archivé(s) le : samedi 12 novembre 2016 - 10:24:03

Fichier

acquisitionSystemJASADepotHAL....
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Michaël Aron, Marie-Odile Berger, Erwan Kerrien, Brigitte Wrobel-Dautcourt, Blaise Potard, et al.. Multimodal acquisition of articulatory data: Geometrical and temporal registration. Journal of the Acoustical Society of America, Acoustical Society of America, 2016, 139 (2), pp.13. 〈10.1121/1.4940666〉. 〈hal-01269578〉

Partager

Métriques

Consultations de la notice

390

Téléchargements de fichiers

315