3D Models of the Lips for Realistic Speech Animation

Thierry Guiard-Marigny; Nicolas Tsingos; Ali Adjoudani; Christian Benoit; Marie-Paule Cani

inria-00537531, version 1

3D Models of the Lips for Realistic Speech Animation

Thierry Guiard-Marigny ¹, Nicolas Tsingos ( Auteur à contacter de préférence ) ², Ali Adjoudani ¹, Christian Benoit ¹, Marie-Paule Cani ()^a^, 2

Computer Animation (1996) 80-89

Résumé : 3D models of the lips have been developed in the framework of an audiovisual articulatory speech synthetizer. Unlike most of the regions of the human face, the lips are essentially characterized by their border contours. The internal and external contours of the vermilion zone can be fitted by means of algebraic equations. The coefficients of these equations must be controlled so that the lip shape can be adapted to various speakers conformations and to any speech gesture. To reach this goal, a 3D model of the lips has been worked out from geometrical analysis of the natural lips of a French speaker. Our lip model was developed to adjust a set of continuous functions best fitting the contours of 22 reference lip shapes. Only five parameters are necessary to predict all the equations of the contours of the lip model. From this model, a volumic model based on implicit surfaces was also developped to take in account lip contact.

a – Grenoble INP
1 : Institut de la communication parlée (ICP)
CNRS : UMR5009 – Université Stendhal - Grenoble III – Institut National Polytechnique de Grenoble (INPG)
2 : iMAGIS (IMAG-INRIA Rhône-Alpes / GRAVIR)
INRIA – Université Joseph Fourier - Grenoble I – Institut National Polytechnique de Grenoble (INPG)

inria-00537531, version 1
http://hal.inria.fr/inria-00537531
oai:hal.inria.fr:inria-00537531
Contributeur : Team Artis <>
Déposé pour le compte de : Laure BENAC <>
Soumis le : Lundi 29 Novembre 2010, 10:11:46
Dernière modification le : Mardi 21 Décembre 2010, 16:42:03

Voir la fiche détaillée

Documents associés

PDF :

DOI : 10.1109/CA.1996.540490

Texte intégral chez l'éditeur

Exporter

Bibtex EndNote TEI RefWorks

%% inria-00537531, version 1
%% http://hal.inria.fr/inria-00537531
@inproceedings{guiardmarigny:inria-00537531,
    hal_id = {inria-00537531},
    url = {http://hal.inria.fr/inria-00537531},
    title = {{3D Models of the Lips for Realistic Speech Animation}},
    author = {Guiard-Marigny, Thierry and Tsingos, Nicolas and Adjoudani, Ali and Benoit, Christian and Cani, Marie-Paule},
    abstract = {{3D models of the lips have been developed in the framework of an audiovisual articulatory speech synthetizer. Unlike most of the regions of the human face, the lips are essentially characterized by their border contours. The internal and external contours of the vermilion zone can be fitted by means of algebraic equations. The coefficients of these equations must be controlled so that the lip shape can be adapted to various speakers conformations and to any speech gesture. To reach this goal, a 3D model of the lips has been worked out from geometrical analysis of the natural lips of a French speaker. Our lip model was developed to adjust a set of continuous functions best fitting the contours of 22 reference lip shapes. Only five parameters are necessary to predict all the equations of the contours of the lip model. From this model, a volumic model based on implicit surfaces was also developped to take in account lip contact.}},
    keywords = {speech synthesis; natural languages; audio-visual systems; computer animation; realistic images; 3D models; lip modelling; realistic speech animation; audio visual articulatory speech synthesizer; human face; border contours; vermilion zone; algebraic equations; lip shape; speaker dependent conformations; geometrical analysis; natural lips; French speaker; continuous functions; reference lip shapes; volumetric model; implicit surfaces; lip contact},
    language = {Anglais},
    affiliation = {Institut de la communication parl{\'e}e - ICP , iMAGIS - IMAG-INRIA Rh{\^o}ne-Alpes / GRAVIR},
    booktitle = {{Computer Animation}},
    publisher = {IEEE Computer Society},
    pages = {80-89},
    address = {Geneva, Suisse},
    note = {Published under the name Marie-Paule Gascuel },
    audience = {internationale },
    doi = {10.1109/CA.1996.540490 },
    year = {1996},
    pdf = {http://hal.inria.fr/inria-00537531/PDF/10.1.1.43.7094.pdf},
}

%F inria-00537531, version 1
%0 Conference Proceedings
%U http://hal.inria.fr/inria-00537531
%2 INFO:INFO_GR
%T 3D Models of the Lips for Realistic Speech Animation
%A Guiard-Marigny, Thierry
%A Tsingos, Nicolas
%A Adjoudani, Ali
%A Benoit, Christian
%A Cani, Marie-Paule
%+ Institut de la communication parlée - ICP , iMAGIS - IMAG-INRIA Rhône-Alpes / GRAVIR
%X 3D models of the lips have been developed in the framework of an audiovisual articulatory speech synthetizer. Unlike most of the regions of the human face, the lips are essentially characterized by their border contours. The internal and external contours of the vermilion zone can be fitted by means of algebraic equations. The coefficients of these equations must be controlled so that the lip shape can be adapted to various speakers conformations and to any speech gesture. To reach this goal, a 3D model of the lips has been worked out from geometrical analysis of the natural lips of a French speaker. Our lip model was developed to adjust a set of continuous functions best fitting the contours of 22 reference lip shapes. Only five parameters are necessary to predict all the equations of the contours of the lip model. From this model, a volumic model based on implicit surfaces was also developped to take in account lip contact.
%G Anglais
%8 1996-00-00
%2 internationale
%B Computer Animation
%2 Geneva
%2 Suisse
%8 1996-06-03
%8 1996-06-04
%I IEEE Computer Society
%P 80-89
%R 10.1109/CA.1996.540490
%2 http://www.computer.org/portal/web/csdl/doi/10.1109/CA.1996.540490
%K speech synthesis; natural languages; audio-visual systems; computer animation; realistic images; 3D models; lip modelling; realistic speech animation; audio visual articulatory speech synthesizer; human face; border contours; vermilion zone; algebraic equations; lip shape; speaker dependent conformations; geometrical analysis; natural lips; French speaker; continuous functions; reference lip shapes; volumetric model; implicit surfaces; lip contact
%2 1996
%Z Published under the name Marie-Paule Gascuel

<?xml version="1.0" encoding="UTF-8"?>
<listBibl xmlns="http://www.tei-c.org/ns/1.0" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML">
<listBibl type="inproceedings"><head>Communications avec actes</head>
<biblStruct type="inproceedings" xml:id="inria-00537531"><analytic>
<author><persName><forename>Thierry</forename><surname>Guiard-Marigny</surname></persName>
<affiliation>
<orgName type="laboratory">ICP</orgName>
<orgName type="team">Institut de la communication parlée</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5009</orgName>
<orgName type="institution">Université Stendhal - Grenoble III</orgName>
<orgName type="institution">Institut National Polytechnique de Grenoble (INPG)</orgName>
</affiliation>
</author>
<author><persName><forename>Nicolas</forename><surname>Tsingos</surname></persName>
<affiliation>
<orgName type="laboratory">IMAG-INRIA Rhône-Alpes / GRAVIR</orgName>
<orgName type="team">iMAGIS</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Université Joseph Fourier - Grenoble I</orgName>
<orgName type="institution">Institut National Polytechnique de Grenoble (INPG)</orgName>
</affiliation>
</author>
<author><persName><forename>Ali</forename><surname>Adjoudani</surname></persName>
<affiliation>
<orgName type="laboratory">ICP</orgName>
<orgName type="team">Institut de la communication parlée</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5009</orgName>
<orgName type="institution">Université Stendhal - Grenoble III</orgName>
<orgName type="institution">Institut National Polytechnique de Grenoble (INPG)</orgName>
</affiliation>
</author>
<author><persName><forename>Christian</forename><surname>Benoit</surname></persName>
<affiliation>
<orgName type="laboratory">ICP</orgName>
<orgName type="team">Institut de la communication parlée</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5009</orgName>
<orgName type="institution">Université Stendhal - Grenoble III</orgName>
<orgName type="institution">Institut National Polytechnique de Grenoble (INPG)</orgName>
</affiliation>
</author>
<author><persName><forename>Marie-Paule</forename><surname>Cani</surname></persName>
<affiliation>
<orgName type="laboratory">IMAG-INRIA Rhône-Alpes / GRAVIR</orgName>
<orgName type="team">iMAGIS</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Université Joseph Fourier - Grenoble I</orgName>
<orgName type="institution">Institut National Polytechnique de Grenoble (INPG)</orgName>
</affiliation>
</author>
<title type="main" level="a">3D Models of the Lips for Realistic Speech Animation</title></analytic><monogr><meeting>Computer Animation</meeting><imprint><publisher>IEEE Computer Society</publisher><pubPlace><settlement>Geneva</settlement><country>Suisse</country></pubPlace><biblScope type="publicationDate">1996-00-00</biblScope><biblScope type="pp">80-89</biblScope></imprint></monogr><idno type="doi">10.1109/CA.1996.540490</idno><idno type="HALid">http://hal.inria.fr/inria-00537531</idno><idno type="HALFile">http://hal.inria.fr/inria-00537531/PDF/10.1.1.43.7094.pdf</idno></biblStruct>
</listBibl>
</listBibl>