Skip to Main content Skip to Navigation
Conference papers

Interactive Body-Driven Graphics for Augmented Video Performance

Abstract : We present a system that augments live presentation videos with interactive graphics to create a powerful and expressive storytelling environment. Using our system, the presenter interacts with the graphical elements in real-time with gestures and postures, thus leveraging our innate, everyday skills to enhance our communication capabilities with the audience. However, crafting such an interactive and expressive performance typically requires programming, or highly-specialized tools tailored for experts. Our core contribution is a flexible, direct manipulation UI which enables amateurs and experts to craft such presentations beforehand by mapping a variety of body movements to a wide range of graphical manipulations. By simplifying the mapping between gestures, postures, and their corresponding output effects, our UI enables users to craft customized, rich interactions with the graphical elements. Our user study demonstrates the potential usage and unique affordance of this mixed-reality medium for storytelling and presentation across a range of application domains.
Document type :
Conference papers
Complete list of metadata

Cited literature [51 references]  Display  Hide  Download
Contributor : Li-Yi Wei Connect in order to contact the contributor
Submitted on : Monday, February 4, 2019 - 12:56:16 AM
Last modification on : Friday, October 23, 2020 - 4:48:27 PM
Long-term archiving on: : Sunday, May 5, 2019 - 1:01:33 PM


Files produced by the author(s)



Nazmus Saquib, Rubaiat Habib Kazi, Li-Yi Wei, Wilmot Li. Interactive Body-Driven Graphics for Augmented Video Performance. CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019, May 2019, Glasgow, United Kingdom. ⟨10.1145/3290605⟩. ⟨hal-02005318⟩



Les métriques sont temporairement indisponibles