Speech Processing and Prosody

Denis Jouvet 1
1 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : The prosody of the speech signal conveys information over the linguistic content of the message: prosody structures the utterance, and also brings information on speaker's attitude and speaker's emotion. Duration of sounds, energy and fundamental frequency are the prosodic features. However their automatic computation and usage are not obvious. Sound duration features are usually extracted from speech recognition results or from a force speech-text alignment. Although the resulting segmentation is usually acceptable on clean native speech data, performance degrades on noisy or not non-native speech. Many algorithms have been developed for computing the fundamental frequency, they lead to rather good performance on clean speech, but again, performance degrades in noisy conditions. However, in some applications, as for example in computer assisted language learning, the relevance of the prosodic features is critical; indeed, the quality of the diagnostic on the learner's pronunciation will heavily depend on the precision and reliability of the estimated prosodic parameters. The paper considers the computation of prosodic features, shows the limitations of automatic approaches, and discusses the problem of computing confidence measures on such features. Then the paper discusses the role of prosodic features and how they can be handled for automatic processing in some tasks such as the detection of discourse particles, the characterization of emotions, the classification of sentence modalities, as well as in computer assisted language learning and in expressive speech synthesis.
Document type :
Conference papers
Complete list of metadatas

Cited literature [57 references]  Display  Hide  Download

https://hal.inria.fr/hal-02177210
Contributor : Denis Jouvet <>
Submitted on : Monday, July 8, 2019 - 5:08:25 PM
Last modification on : Thursday, December 12, 2019 - 3:44:40 PM

File

D.Jouvet--SpeechProsodyAndProc...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02177210, version 1

Collections

Citation

Denis Jouvet. Speech Processing and Prosody. TSD 2019 - 22nd International Conference of Text, Speech and Dialogue, Sep 2019, Ljubljana, Slovenia. ⟨hal-02177210⟩

Share

Metrics

Record views

66

Files downloads

479