Skip to Main content Skip to Navigation
Conference papers

Multimodal fusion of electromagnetic, ultrasound and MRI data for building an articulatory model

Michael Aron 1 Marie-Odile Berger 1 Erwan Kerrien 1
1 MAGRIT - Visual Augmentation of Complex Environments
INRIA Lorraine, LORIA - Laboratoire Lorrain de Recherche en Informatique et ses Applications
Abstract : Data fusion from multiple sensors is of significant interest to the speech research community, as it can potentially provide a better picture of speech production through the use of complementary sensor modalities. This paper deals with the practical aspects of this problem, such as acquisition and processing of the dynamic US and EM data of the tongue during speech production, static MRI images of the vocal tract using repetitions, and registration of the data from these different sources to a common reference frame. To the best of our knowledge, this is the first work that demonstrates the potential of static and dynamic data fusion in the construction of articulatory databases.
Complete list of metadatas

https://hal.inria.fr/inria-00326290
Contributor : Michael Aron <>
Submitted on : Tuesday, January 6, 2009 - 2:07:56 PM
Last modification on : Friday, March 30, 2018 - 10:02:03 AM
Long-term archiving on: : Friday, June 4, 2010 - 12:06:55 PM

File

aron_issp2008.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00326290, version 1

Collections

Citation

Michael Aron, Marie-Odile Berger, Erwan Kerrien. Multimodal fusion of electromagnetic, ultrasound and MRI data for building an articulatory model. 8th International Seminar On Speech Production - ISSP'08, Dec 2008, Strasbourg, France. ⟨inria-00326290⟩

Share

Metrics

Record views

472

Files downloads

147