Skip to Main content Skip to Navigation
Conference papers

A Combined Semantic and Motion Capture Database for Real-Time Sign Language Synthesis

Charly Awad 1 Nicolas Courty 1 Kyle Duarte 1 Thibaut Le Naour 2 Sylvie Gibet 1, 3
2 SEASIDE - SEarch, Analyze, Synthesize and Interact with Data Ecosystems
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, UBS - Université de Bretagne Sud
3 BUNRAKU - Perception, decision and action of real and virtual humans in virtual environments and impact on real environments
IRISA - Institut de Recherche en Informatique et Systèmes Aléatoires, ENS Cachan - École normale supérieure - Cachan, Inria Rennes – Bretagne Atlantique
Abstract : Over the past decade, many elds of discovery have begun to use motion capture data, leading to an exponential growth in the size of motion databases. Querying, indexing and retrieving motion capture data has thus become a crucial problem for the accessibility and usability of such databases. Our aim is to make this approach feasible for virtual agents signing in French Sign Language, taking into account the semantic information implicitly contained in sign language data.We propose a new methodology for accessing our database, by simultaneously using both a semantic and a captured-motion database, with dierent ways of index- ing the two database parts. This approach is used to eectively retrieve stored motions for the purposes of producing real-time sign language an- imations. The complete process and its in-use eciency are described, from querying motion in the semantic database to computing transitory segments between signs, and producing animations of a realistic virtual character.
Document type :
Conference papers
Complete list of metadata

Cited literature [22 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00493426
Contributor : Nicolas Courty Connect in order to contact the contributor
Submitted on : Friday, June 18, 2010 - 4:58:45 PM
Last modification on : Friday, February 4, 2022 - 3:14:17 AM
Long-term archiving on: : Monday, October 22, 2012 - 12:00:25 PM

File

IVA2009.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00493426, version 1

Citation

Charly Awad, Nicolas Courty, Kyle Duarte, Thibaut Le Naour, Sylvie Gibet. A Combined Semantic and Motion Capture Database for Real-Time Sign Language Synthesis. 9th Int. Conference on Intelligent Virtual Agent (IVA 2009), Sep 2009, Amsterdam, Netherlands. pp.432-438. ⟨hal-00493426⟩

Share

Metrics

Record views

253

Files downloads

310