Skip to Main content Skip to Navigation
Journal articles

Motion synthesis and editing for the generation of new sign language content

Abstract : Existing work on the animation of signing avatars often relies on pure procedural techniques or on the playback of Motion Capture (MoCap) data. While the first solution results in robotic and unnatural motions, the second one is very limited in the number of signs that it can produce. In this paper, we propose to implement data-driven motion synthesis techniques to increase the variety of Sign Language (SL) motions that can be made from a limited database. In order to generate new signs and inflection mechanisms based on an annotated French Sign Language MoCap corpus, we rely on phonological recombination, i.e. on the motion retrieval and modular reconstruction of SL content at a phonological level with a particular focus on three phonological components of SL: hand placement, hand configuration and hand movement. We propose to modify the values taken by those components in different signs to create their inflected version or completely new signs by (i) applying motion retrieval at a phonological level to exchange the value of one component without any modification, (ii) editing the retrieved data with different operators, or, (iii) using conventional motion generation techniques such as interpolation or inverse kinematics, which are parameterized to comply to the kinematic properties of real motion observed in the data set. The quality of the synthesized motions is perceptually assessed through two distinct evaluations that involved 75 and 53 participants respectively.
Document type :
Journal articles
Complete list of metadata

https://hal.inria.fr/hal-03324348
Contributor : Sylvie Gibet Connect in order to contact the contributor
Submitted on : Friday, April 1, 2022 - 4:37:36 PM
Last modification on : Friday, August 5, 2022 - 2:54:52 PM
Long-term archiving on: : Saturday, July 2, 2022 - 7:13:40 PM

File

2021_MachineTranslation_Naert-...
Files produced by the author(s)

Identifiers

Citation

Lucie Naert, Caroline Larboulette, Sylvie Gibet. Motion synthesis and editing for the generation of new sign language content. Machine Translation, Springer Verlag, 2021, pp.405-430. ⟨10.1007/s10590-021-09268-y⟩. ⟨hal-03324348⟩

Share

Metrics

Record views

61

Files downloads

13