Skip to Main content Skip to Navigation
Conference papers

WEB-based listening test system for speech synthesis and speech conversion evaluation

Laurent Blin 1 Olivier Boëffard 1 Vincent Barreaud 1
1 CORDIAL - Human-machine spoken dialogue
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, INRIA Rennes, ENSSAT - École Nationale Supérieure des Sciences Appliquées et de Technologie
Abstract : In this article, we propose a web based listening test system that can be used with a large range of listeners. Our main goals were to make the configuration of the tests as simple and flexible as possible, to simplify the recruiting of the testees and, of course, to keep track of the results using a relational database. This first version of our system can perform the most widely used listening tests in the speech processing community (AB-BA, ABX and MOS tests). It can also easily evolve and propose other tests implemented by the tester by means of a module interface. This scenario is explored in this article which proposes an implementation of a module for Comparison Mean Opinion Score (CMOS) tests and conduct of such an experiment. This test allowed us to extract from the BREF120 corpus a couple of voices of distinct supra-segmental characteristics. This system is offered to the speech synthesis and speech conversion community under free license.
Complete list of metadata

Cited literature [9 references]  Display  Hide  Download
Contributor : Vincent Barreaud <>
Submitted on : Monday, February 11, 2019 - 8:52:28 AM
Last modification on : Tuesday, June 15, 2021 - 4:22:12 PM


  • HAL Id : hal-02012732, version 1


Laurent Blin, Olivier Boëffard, Vincent Barreaud. WEB-based listening test system for speech synthesis and speech conversion evaluation. Language Resources and Evaluation Conference, May 2008, Marrakech, Morocco. ⟨hal-02012732⟩



Record views