Skip to Main content Skip to Navigation
Conference papers

Kinect-Sign: Teaching Sign Language to “Listeners” through a Game

Abstract : Sign language is the hearing impaired form of communicating with other people, including listeners. Most cases, impaired people have learned sign language form childhood. The problem arises when a listener comes in contact with an impaired person. For instances, if a couple has a child which is impaired, the parents find a challenge to learn the sign language. In this article, a new playful approach to assist the listeners to learn sign language is proposed. This proposal is a serious game composed of two modes: School-mode and Competition-mode. The first offers a virtual school where the user learns to sign letters and the second offers an environment towards applying the learned letters. Behind the scenes, the proposal contains a sign language recognition system, based on three modules: 1 – the standardization of the Kinect depth camera data; 2 – a gesture library relying on the standardized data; and 3 – the real-time recognition of gestures. A prototype was developed – Kinect-Sign – and tested in a Portuguese Sign-Language school and on eNTERFACE’13 resulting in a joyful acceptance of the approach.
Complete list of metadatas

Cited literature [12 references]  Display  Hide  Download

https://hal.inria.fr/hal-01350744
Contributor : Hal Ifip <>
Submitted on : Monday, August 1, 2016 - 3:34:34 PM
Last modification on : Monday, August 1, 2016 - 3:58:19 PM
Document(s) archivé(s) le : Wednesday, November 2, 2016 - 11:47:36 AM

File

978-3-642-55143-7_6_Chapter.pd...
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution 4.0 International License

Identifiers

Citation

João Gameiro, Tiago Cardoso, Yves Rybarczyk. Kinect-Sign: Teaching Sign Language to “Listeners” through a Game. 9th International Summer Workshop on Multimodal Interfaces (eNTERFACE), Jul 2013, Lisbon, Portugal. pp.141-159, ⟨10.1007/978-3-642-55143-7_6⟩. ⟨hal-01350744⟩

Share

Metrics

Record views

140

Files downloads

413