Exploring the anatomical encoding of voice with a mathematical model of the vocal system.

M Florencia Assaneo 1, 2 Jacobo Sitt 3 Gaël Varoquaux 4 Mariano Sigman 5 Laurent Cohen 3 Marcos A Trevisan 6
1 NYU - New York University [New York]
2 UBA - Universidad de Buenos Aires [Buenos Aires]
3 ICM - Institut du Cerveau et de la Moëlle Epinière = Brain and Spine Institute
4 PARIETAL - Modelling brain structure, function and variability based on high-field MRI data
Inria Saclay - Ile de France, NEUROSPIN - Service NEUROSPIN
5 Laboratorio de Neurociencia Integrativa/Integrative Neurosciences Laboratory [Buenos Aires]
6 Università Cattolica del Sacro Cuore
Abstract : The faculty of language depends on the interplay between the production and perception of speech sounds. A relevant open question is whether the dimensions that organize voice perception in the brain are acoustical or depend on properties of the vocal system that produced it. One of the main empirical difficulties in answering this question is to generate sounds that vary along a continuum according to the anatomical properties the vocal apparatus that produced them. Here we use a mathematical model that offers the unique possibility of synthesizing vocal sounds by controlling a small set of anatomically based parameters. In a first stage the quality of the synthetic voice was evaluated. Using specific time traces for sub-glottal pressure and tension of the vocal folds, the synthetic voices generated perceptual responses, which are indistinguishable from those of real speech. The synthesizer was then used to investigate how the auditory cortex responds to the perception of voice depending on the anatomy of the vocal apparatus. Our fMRI results show that sounds are perceived as human vocalizations when produced by a vocal system that follows a simple relationship between the size of the vocal folds and the vocal tract. We found that these anatomical parameters encode the perceptual vocal identity (male, female, child) and show that the brain areas that respond to human speech also encode vocal identity. On the basis of these results, we propose that this low-dimensional model of the vocal system is capable of generating realistic voices and represents a novel tool to explore the voice perception with a precise control of the anatomical variables that generate speech. Furthermore, the model provides an explanation of how auditory cortices encode voices in terms of the anatomical parameters of the vocal system.
Keywords : Neural coding of voice Voice identity Auditory cortex Biomechanical model of the vocal system
Document type :
Journal articles
Complete list of metadatas
https://hal.inria.fr/hal-01498364
Contributor : Gaël Varoquaux <>
Submitted on : Wednesday, March 29, 2017 - 9:14:14 PM
Last modification on : Wednesday, August 14, 2019 - 10:46:03 AM

Identifiers

Collections

UPMC | ICM | INRIA | UNIV-PARIS-SACLAY | CEA | CEA-DRF | JOLIOT | NEUROSPIN | SORBONNE-UNIVERSITE | SU-MEDECINE

Citation

M Florencia Assaneo, Jacobo Sitt, Gaël Varoquaux, Mariano Sigman, Laurent Cohen, et al.. Exploring the anatomical encoding of voice with a mathematical model of the vocal system.. NeuroImage, Elsevier, 2016, 141, pp.31-9. ⟨10.1016/j.neuroimage.2016.07.033⟩. ⟨hal-01498364⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

410

Contact


archive-ouverte@inria.fr