Phone Merging for Code-switched Speech Recognition

Abstract : Speakers in multilingual communities often switch between or mix multiple languages in the same conversation. Automatic Speech Recognition (ASR) of code-switched speech faces many challenges including the influence of phones of different languages on each other. This paper shows evidence that phone sharing between languages improves the Acoustic Model performance for Hindi-English code-switched speech. We compare base-line system built with separate phones for Hindi and English with systems where the phones were manually merged based on linguistic knowledge. Encouraged by the improved ASR performance after manually merging the phones, we further investigate multiple data-driven methods to identify phones to be merged across the languages. We show detailed analysis of automatic phone merging in this language pair and the impact it has on individual phone accuracies and WER. Though the best performance gain of 1.2% WER was observed with manually merged phones, we show experimentally that the manual phone merge is not optimal.
Complete list of metadatas

Cited literature [26 references]  Display  Hide  Download

https://hal.inria.fr/hal-01800466
Contributor : Sunit Sivasankaran <>
Submitted on : Saturday, May 26, 2018 - 11:57:03 AM
Last modification on : Tuesday, December 18, 2018 - 4:38:02 PM
Long-term archiving on: Monday, August 27, 2018 - 12:23:44 PM

File

phone-merging-acl.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01800466, version 1

Collections

Citation

Sunit Sivasankaran, Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Monojit Choudhury. Phone Merging for Code-switched Speech Recognition. Third Workshop on Computational Approaches to Linguistic Code-switching, collocated with ACL 2018 Jul 2018, Melbourne, Australia. ⟨hal-01800466⟩

Share

Metrics

Record views

262

Files downloads

136