Skip to Main content Skip to Navigation
Conference papers

A comparative study of speech anonymization metrics

Mohamed Maouche 1 Brij Mohan Lal Srivastava 1 Nathalie Vauquier 1 Aurélien Bellet 1 Marc Tommasi 1 Emmanuel Vincent 2
1 MAGNET - Machine Learning in Information Networks
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
2 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Speech anonymization techniques have recently been proposed for preserving speakers' privacy. They aim at concealing speak-ers' identities while preserving the spoken content. In this study, we compare three metrics proposed in the literature to assess the level of privacy achieved. We exhibit through simulation the differences and blindspots of some metrics. In addition, we conduct experiments on real data and state-of-the-art anonymiza-tion techniques to study how they behave in a practical scenario. We show that the application-independent log-likelihood-ratio cost function C min llr provides a more robust evaluation of privacy than the equal error rate (EER), and that detection-based metrics provide different information from linkability metrics. Interestingly , the results on real data indicate that current anonymiza-tion design choices do not induce a regime where the differences between those metrics become apparent.
Document type :
Conference papers
Complete list of metadatas

Cited literature [26 references]  Display  Hide  Download

https://hal.inria.fr/hal-02907918
Contributor : Emmanuel Vincent <>
Submitted on : Tuesday, July 28, 2020 - 4:26:22 PM
Last modification on : Tuesday, July 28, 2020 - 5:19:13 PM

File

anonymization_metrics_IS2020.p...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02907918, version 1

Citation

Mohamed Maouche, Brij Mohan Lal Srivastava, Nathalie Vauquier, Aurélien Bellet, Marc Tommasi, et al.. A comparative study of speech anonymization metrics. INTERSPEECH 2020, Oct 2020, Shanghai, China. ⟨hal-02907918⟩

Share

Metrics

Record views

52

Files downloads

93