A Virtual Director Using Hidden Markov Models

Bilal Merabti 1, 2 Marc Christie 3 Kadi Bouatouch 4
3 MIMETIC - Analysis-Synthesis Approach for Virtual Human Simulation
UR2 - Université de Rennes 2, Inria Rennes – Bretagne Atlantique , IRISA-D6 - MEDIA ET INTERACTIONS
4 FRVSense - FRVSense
IRISA-D6 - MEDIA ET INTERACTIONS
Abstract : Automatically computing a cinematographic consistent sequence of shots over a set of actions occurring in a 3D world is a complex task which requires not only the computation of appropriate shots (viewpoints) and appropriate transitions between shots (cuts), but the ability to encode and reproduce elements of cinematographic style. Models proposed in the literature, generally based on finite state machine or idiom-based representations, provide limited functionalities to build sequences of shots. These approaches are not designed in mind to easily learn elements of cinematographic style, nor do they allow to perform significant variations in style over the same sequence of actions. In this paper, we propose a model for automated cinematography that can compute significant variations in terms of cinematographic style, with the ability to control the duration of shots and the possibility to add specific constraints to the desired sequence. The model is parameterized in a way that facilitates the application of learning techniques. By using a Hidden Markov Model representation of the editing process, we demonstrate the possibility of easily reproducing elements of style extracted from real movies. Results comparing our model with state-of-the-art first order Markovian representations illustrate these features, and robustness of the learning technique is demonstrated through cross-validation.
Document type :
Journal articles
Liste complète des métadonnées

Cited literature [15 references]  Display  Hide  Download

https://hal.inria.fr/hal-01244643
Contributor : Marc Christie <>
Submitted on : Wednesday, December 16, 2015 - 9:36:21 AM
Last modification on : Thursday, February 7, 2019 - 5:14:45 PM
Document(s) archivé(s) le : Thursday, March 17, 2016 - 11:31:48 AM

File

main-file.pdf
Files produced by the author(s)

Identifiers

Citation

Bilal Merabti, Marc Christie, Kadi Bouatouch. A Virtual Director Using Hidden Markov Models. Computer Graphics Forum, Wiley, 2015, ⟨10.1111/cgf.12775⟩. ⟨hal-01244643⟩

Share

Metrics

Record views

488

Files downloads

416