HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Conference papers

CGCNN: COMPLEX GABOR CONVOLUTIONAL NEURAL NETWORK ON RAW SPEECH

Abstract : Convolutional Neural Networks (CNN) have been used in Automatic Speech Recognition (ASR) to learn representations directly from the raw signal instead of hand-crafted acoustic features, providing a richer and lossless input signal. Recent researches propose to inject prior acoustic knowledge to the first convolutional layer by integrating the shape of the impulse responses in order to increase both the interpretability of the learnt acoustic model, and its performances. We propose to combine the complex Gabor filter with complex-valued deep neural networks to replace usual CNN weights kernels, to fully take advantage of its optimal time-frequency resolution and of the complex domain. The conducted experiments on the TIMIT phoneme recognition task shows that the proposed approach reaches top-of-the-line performances while remaining interpretable.
Document type :
Conference papers
Complete list of metadata

Cited literature [27 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02474746
Contributor : Paul-Gauthier Noé Connect in order to contact the contributor
Submitted on : Tuesday, February 11, 2020 - 3:46:50 PM
Last modification on : Wednesday, November 3, 2021 - 10:00:34 AM
Long-term archiving on: : Tuesday, May 12, 2020 - 3:18:43 PM

File

gabor_complex_cnn_final.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02474746, version 1

Collections

Citation

Paul-Gauthier Noé, Titouan Parcollet, Mohamed Morchid. CGCNN: COMPLEX GABOR CONVOLUTIONAL NEURAL NETWORK ON RAW SPEECH. ICASSP 2020, May 2020, Barcelona, Spain. ⟨hal-02474746⟩

Share

Metrics

Record views

162

Files downloads

159