The MICOLE Architecture: Multimodal Support for Inclusion of Visually Impaired Children

Abstract : Modern information technology allows us to seek out new ways to support the computer use and communication of disabled people. With the aid of new interaction technologies and techniques visually impaired and sighted users can collaborate, for example, in the classroom situations. The main goal of the MICOLE project was to create a software architecture that makes it easier for the developers to create multimodal multi-user applications. The framework is based on interconnected software agents. The hardware used in this study includes VTPlayer Mouse which has two built-in Braille displays, and several haptic devices such as PHANToM Omni, PHANToM Desktop and PHANToM Premium. We also used the SpaceMouse and various audio setups in the applications. In this paper we present a software architecture, a set of software agents, and an example of using the architecture. The example application shown is an electric circuit application that follows the single-user with many devices scenario. The application uses a PHANToM and a VTPlayer Mouse together with visual and audio feedback to make the electric circuits understandable through touch.
Complete list of metadatas

https://hal.inria.fr/hal-00671496
Contributor : Thomas Pietrzak <>
Submitted on : Friday, February 17, 2012 - 3:26:06 PM
Last modification on : Sunday, June 24, 2018 - 1:13:32 AM
Long-term archiving on : Thursday, June 14, 2012 - 4:38:10 PM

File

pietrzak07b.pdf
Publisher files allowed on an open archive

Identifiers

Collections

Citation

Thomas Pietrzak, Benoît Martin, Isabelle Pecci, Rami Saarinen, Roope Raisamo, et al.. The MICOLE Architecture: Multimodal Support for Inclusion of Visually Impaired Children. Proceedings of the ACM Conference on Multimodal Interaction (ICMI 2007), 2007, Nagoya, Japan. ⟨10.1145/1322192.1322227⟩. ⟨hal-00671496⟩

Share

Metrics

Record views

222

Files downloads

367