Evaluating Voice Conversion-based Privacy Protection against Informed Attackers

Brij Mohan Lal Srivastava 1, 2 Nathalie Vauquier 1 Md Sahidullah 2 Aurélien Bellet 1 Marc Tommasi 1 Emmanuel Vincent 2
1 MAGNET - Machine Learning in Information Networks
Inria Lille - Nord Europe, CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille (CRIStAL) - UMR 9189
2 MULTISPEECH - Speech Modeling for Facilitating Oral-Based Communication
Inria Nancy - Grand Est, LORIA - NLPKD - Department of Natural Language Processing & Knowledge Discovery
Abstract : Speech data conveys sensitive speaker attributes like identity or accent. With a small amount of found data, such attributes can be inferred and exploited for malicious purposes: voice cloning, spoofing, etc. Anonymization aims to make the data unlinkable, i.e., ensure that no utterance can be linked to its original speaker. In this paper, we investigate anonymization methods based on voice conversion. In contrast to prior work, we argue that various linkage attacks can be designed depending on the attackers' knowledge about the anonymization scheme. We compare two frequency warping-based conversion methods and a deep learning based method in three attack scenarios. The utility of converted speech is measured via the word error rate achieved by automatic speech recognition, while privacy protection is assessed by the increase in equal error rate achieved by state-of-the-art i-vector or x-vector based speaker verification. Our results show that voice conversion schemes are unable to effectively protect against an attacker that has extensive knowledge of the type of conversion and how it has been applied, but may provide some protection against less knowledgeable attackers.
Keywords : voice conversion speech recognition attacker speaker verification privacy linkage attack
Document type :
Conference papers
Complete list of metadatas

Cited literature [27 references]  Display  Hide  Download
https://hal.inria.fr/hal-02355115
Contributor : Brij Mohan Lal Srivastava <>
Submitted on : Thursday, February 13, 2020 - 7:26:44 PM
Last modification on : Saturday, February 15, 2020 - 1:36:41 AM

File

ppvc_final.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02355115, version 2

Collections

CRISTAL | UNIV-LORRAINE | INRIA | LORIA-NLPKD | LORIA | UNIV-LILLE | CRISTAL-MAGNET | CNRS

Citation

Brij Mohan Lal Srivastava, Nathalie Vauquier, Md Sahidullah, Aurélien Bellet, Marc Tommasi, et al.. Evaluating Voice Conversion-based Privacy Protection against Informed Attackers. 45th International Conference on Acoustics, Speech, and Signal Processing (ICASSP), IEEE Signal Processing Society, May 2020, Barcelona, Spain. ⟨hal-02355115v2⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

29

Files downloads

20

 

 

Contact

archive-ouverte@inria.fr