Skip to Main content Skip to Navigation
Conference papers

A comparative study of speech anonymization metrics

Mohamed Maouche 1 Brij Mohan Lal Srivastava 1 Nathalie Vauquier 1 Aurélien Bellet 1 Marc Tommasi 1 Emmanuel Vincent 2 
1 MAGNET - Machine Learning in Information Networks
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
2 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Speech anonymization techniques have recently been proposed for preserving speakers' privacy. They aim at concealing speak-ers' identities while preserving the spoken content. In this study, we compare three metrics proposed in the literature to assess the level of privacy achieved. We exhibit through simulation the differences and blindspots of some metrics. In addition, we conduct experiments on real data and state-of-the-art anonymiza-tion techniques to study how they behave in a practical scenario. We show that the application-independent log-likelihood-ratio cost function C min llr provides a more robust evaluation of privacy than the equal error rate (EER), and that detection-based metrics provide different information from linkability metrics. Interestingly , the results on real data indicate that current anonymiza-tion design choices do not induce a regime where the differences between those metrics become apparent.
Document type :
Conference papers
Complete list of metadata

Cited literature [26 references]  Display  Hide  Download
Contributor : Emmanuel Vincent Connect in order to contact the contributor
Submitted on : Tuesday, July 28, 2020 - 4:26:22 PM
Last modification on : Thursday, September 8, 2022 - 3:50:07 AM
Long-term archiving on: : Tuesday, December 1, 2020 - 9:01:56 AM


Files produced by the author(s)


  • HAL Id : hal-02907918, version 1


Mohamed Maouche, Brij Mohan Lal Srivastava, Nathalie Vauquier, Aurélien Bellet, Marc Tommasi, et al.. A comparative study of speech anonymization metrics. INTERSPEECH 2020, Oct 2020, Shanghai, China. ⟨hal-02907918⟩



Record views


Files downloads