Skip to Main content Skip to Navigation
Conference papers

Phone Merging for Code-switched Speech Recognition

Abstract : Speakers in multilingual communities often switch between or mix multiple languages in the same conversation. Automatic Speech Recognition (ASR) of code-switched speech faces many challenges including the influence of phones of different languages on each other. This paper shows evidence that phone sharing between languages improves the Acoustic Model performance for Hindi-English code-switched speech. We compare base-line system built with separate phones for Hindi and English with systems where the phones were manually merged based on linguistic knowledge. Encouraged by the improved ASR performance after manually merging the phones, we further investigate multiple data-driven methods to identify phones to be merged across the languages. We show detailed analysis of automatic phone merging in this language pair and the impact it has on individual phone accuracies and WER. Though the best performance gain of 1.2% WER was observed with manually merged phones, we show experimentally that the manual phone merge is not optimal.
Complete list of metadata

Cited literature [26 references]  Display  Hide  Download
Contributor : Sunit Sivasankaran Connect in order to contact the contributor
Submitted on : Saturday, May 26, 2018 - 11:57:03 AM
Last modification on : Saturday, October 16, 2021 - 11:26:10 AM
Long-term archiving on: : Monday, August 27, 2018 - 12:23:44 PM


Files produced by the author(s)


  • HAL Id : hal-01800466, version 1




Sunit Sivasankaran, Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Monojit Choudhury. Phone Merging for Code-switched Speech Recognition. Third Workshop on Computational Approaches to Linguistic Code-switching, collocated with ACL 2018 Jul 2018, Melbourne, Australia. ⟨hal-01800466⟩



Record views


Files downloads