Phoneme-to-Articulatory mapping using bidirectional gated RNN

Théo Biasutto– Lervat 1 Slim Ouni 1
1 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Deriving articulatory dynamics from the acoustic speech signal has been addressed in several speech production studies. In this paper, we investigate whether it is possible to predict articulatory dynamics from phonetic information without having the acoustic speech signal. The input data may be considered as not sufficiently rich acoustically, as probably there is no explicit coarticulation information but we expect that the phonetic sequence provides compact yet rich knowledge. Motivated by the recent success of deep learning techniques used in the acoustic-to-articulatory inversion, we have experimented around the bidirectional gated recurrent neural network archi-tectures. We trained these models with an EMA corpus, and have obtained good performances similar to the state-of-the-art articulatory inversion from LSF features, but using only the phoneme labels and durations.
Type de document :
Communication dans un congrès
Interspeech 2018 - 19th Annual Conference of the International Speech Communication Association, Sep 2018, Hyderabad, India
Liste complète des métadonnées

https://hal.inria.fr/hal-01862587
Contributeur : Slim Ouni <>
Soumis le : lundi 27 août 2018 - 14:40:29
Dernière modification le : mardi 18 décembre 2018 - 16:38:02
Document(s) archivé(s) le : mercredi 28 novembre 2018 - 16:15:47

Fichier

1202_Paper.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

  • HAL Id : hal-01862587, version 1

Citation

Théo Biasutto– Lervat, Slim Ouni. Phoneme-to-Articulatory mapping using bidirectional gated RNN. Interspeech 2018 - 19th Annual Conference of the International Speech Communication Association, Sep 2018, Hyderabad, India. 〈hal-01862587〉

Partager

Métriques

Consultations de la notice

117

Téléchargements de fichiers

89