Interactive Body-Driven Graphics for Augmented Video Performance

Abstract : We present a system that augments live presentation videos with interactive graphics to create a powerful and expressive storytelling environment. Using our system, the presenter interacts with the graphical elements in real-time with gestures and postures, thus leveraging our innate, everyday skills to enhance our communication capabilities with the audience. However, crafting such an interactive and expressive performance typically requires programming, or highly-specialized tools tailored for experts. Our core contribution is a flexible, direct manipulation UI which enables amateurs and experts to craft such presentations beforehand by mapping a variety of body movements to a wide range of graphical manipulations. By simplifying the mapping between gestures, postures, and their corresponding output effects, our UI enables users to craft customized, rich interactions with the graphical elements. Our user study demonstrates the potential usage and unique affordance of this mixed-reality medium for storytelling and presentation across a range of application domains.
Document type :
Conference papers
Complete list of metadatas

Cited literature [51 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02005318
Contributor : Li-Yi Wei <>
Submitted on : Monday, February 4, 2019 - 12:56:16 AM
Last modification on : Monday, March 4, 2019 - 6:07:01 PM
Long-term archiving on : Sunday, May 5, 2019 - 1:01:33 PM

File

final.pdf
Files produced by the author(s)

Identifiers

Citation

Nazmus Saquib, Rubaiat Habib Kazi, Li-Yi Wei, Wilmot Li. Interactive Body-Driven Graphics for Augmented Video Performance. CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019, May 2019, Glasgow, United Kingdom. ⟨10.1145/3290605⟩. ⟨hal-02005318⟩

Share

Metrics

Record views

509

Files downloads

4535