Interactive Body-Driven Graphics for Augmented Video Performance - Archive ouverte HAL Access content directly
Conference Papers Year :

Interactive Body-Driven Graphics for Augmented Video Performance

(1) , (2) , ,
Li-Yi Wei
  • Function : Author
  • PersonId : 1042400
Wilmot Li
  • Function : Author


We present a system that augments live presentation videos with interactive graphics to create a powerful and expressive storytelling environment. Using our system, the presenter interacts with the graphical elements in real-time with gestures and postures, thus leveraging our innate, everyday skills to enhance our communication capabilities with the audience. However, crafting such an interactive and expressive performance typically requires programming, or highly-specialized tools tailored for experts. Our core contribution is a flexible, direct manipulation UI which enables amateurs and experts to craft such presentations beforehand by mapping a variety of body movements to a wide range of graphical manipulations. By simplifying the mapping between gestures, postures, and their corresponding output effects, our UI enables users to craft customized, rich interactions with the graphical elements. Our user study demonstrates the potential usage and unique affordance of this mixed-reality medium for storytelling and presentation across a range of application domains.
Fichier principal
Vignette du fichier
final.pdf (10.29 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02005318 , version 1 (04-02-2019)



Nazmus Saquib, Rubaiat Habib Kazi, Li-Yi Wei, Wilmot Li. Interactive Body-Driven Graphics for Augmented Video Performance. CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019, May 2019, Glasgow, United Kingdom. ⟨10.1145/3290605⟩. ⟨hal-02005318⟩
602 View
3054 Download



Gmail Facebook Twitter LinkedIn More