Automated Camera Planner for Film Editing Using Key Shots

Christophe Lino; Mathieu Chollet; Marc Christie; Rémi Ronfard

hal-00646404, version 1

Automated Camera Planner for Film Editing Using Key Shots

Christophe Lino (, ) ¹, Mathieu Chollet ^1, 2, Marc Christie ¹, Rémi Ronfard ( Author to contact preferably )^a^, 3, 4

ACM Siggraph / Eurographics Symposium on Computer Animation (2011)

Abstract: Generating films from 3D animations requires knowledge in cinematography (camera placement, framing and lighting) and editing (cutting between cameras). In applications where the user is already engaged in other tasks, such as playing a game, directing virtual actors, or narrating a story, it appears desirable to build systems that can make decisions about cinematography and editing and automatically generate a grammatically correct movie according to film grammar. In this paper, we introduce a framework for generating a well-edited movie based on the rules of film editing. Specifically, our system computes a sequence of shots by simultaneously choosing which camera to use, when to cut in and out of the shot, and where to cut to. We cast film editing as a cost minimization problem in the space of possible shot sequences and provide an efficient search algorithm. The method is illustrated with multiple edits of the same footage in different editing rhythms and styles.

a – INRIA
1: MIMETIC (INRIA - IRISA)
INRIA – Université de Rennes 1 – Université de Rennes II - Haute Bretagne
2: IMAGINE (Inria Grenoble Rhône-Alpes / LJK Laboratoire Jean Kuntzmann)
CNRS : UMR5224 – INRIA – Laboratoire Jean Kuntzmann – Université Joseph Fourier - Grenoble I – Institut National Polytechnique de Grenoble (INPG) – Université Pierre-Mendès-France - Grenoble II
3: Laboratoire Jean Kuntzmann (LJK)
CNRS : UMR5224 – Université Joseph Fourier - Grenoble I – Université Pierre-Mendès-France - Grenoble II – Institut Polytechnique de Grenoble - Grenoble Institute of Technology
4: LEAR (INRIA Grenoble Rhône-Alpes / LJK Laboratoire Jean Kuntzmann)
CNRS : UMR5527 – INRIA – Laboratoire Jean Kuntzmann – Université Joseph Fourier - Grenoble I – Institut National Polytechnique de Grenoble (INPG)

hal-00646404, version 1
http://hal.inria.fr/hal-00646404
oai:hal.inria.fr:hal-00646404
From: Christophe Lino <>
Submitted on: Tuesday, 19 February 2013 13:37:55
Updated on: Wednesday, 20 February 2013 16:10:03

See detailed view

Associated documents

PDF :

Export

Bibtex EndNote TEI RefWorks

%% hal-00646404, version 1
%% http://hal.inria.fr/hal-00646404
@inproceedings{lino:hal-00646404,
    hal_id = {hal-00646404},
    url = {http://hal.inria.fr/hal-00646404},
    title = {{Automated Camera Planner for Film Editing Using Key Shots}},
    author = {Lino, Christophe and Chollet, Mathieu and Christie, Marc and Ronfard, R{\'e}mi},
    abstract = {{Generating films from 3D animations requires knowledge in cinematography (camera placement, framing and lighting) and editing (cutting between cameras). In applications where the user is already engaged in other tasks, such as playing a game, directing virtual actors, or narrating a story, it appears desirable to build systems that can make decisions about cinematography and editing and automatically generate a grammatically correct movie according to film grammar. In this paper, we introduce a framework for generating a well-edited movie based on the rules of film editing. Specifically, our system computes a sequence of shots by simultaneously choosing which camera to use, when to cut in and out of the shot, and where to cut to. We cast film editing as a cost minimization problem in the space of possible shot sequences and provide an efficient search algorithm. The method is illustrated with multiple edits of the same footage in different editing rhythms and styles.}},
    keywords = {Virtual Cinematography - Computer Animation - Film Editing},
    language = {English},
    affiliation = {MIMETIC - INRIA - IRISA , IMAGINE - Inria Grenoble Rh{\^o}ne-Alpes / LJK Laboratoire Jean Kuntzmann , Laboratoire Jean Kuntzmann - LJK , LEAR - INRIA Grenoble Rh{\^o}ne-Alpes / LJK Laboratoire Jean Kuntzmann},
    booktitle = {{ACM Siggraph / Eurographics Symposium on Computer Animation}},
    address = {Vancouver, Canada},
    organization = {ACM SIGGRAPH / Eurographics},
    audience = {international },
    year = {2011},
    month = Aug,
    pdf = {http://hal.inria.fr/hal-00646404/PDF/2011\_-\_Automated\_Camera\_Planner\_for\_Film\_Editing\_Using\_Key\_Shots.pdf},
}

%F hal-00646404, version 1
%0 Conference Proceedings
%U http://hal.inria.fr/hal-00646404
%2 INFO:INFO_GR;INFO:INFO_MM
%T Automated Camera Planner for Film Editing Using Key Shots
%A Lino, Christophe
%A Chollet, Mathieu
%A Christie, Marc
%A Ronfard, Rémi
%+ MIMETIC - INRIA - IRISA , IMAGINE - Inria Grenoble Rhône-Alpes / LJK Laboratoire Jean Kuntzmann , Laboratoire Jean Kuntzmann - LJK , LEAR - INRIA Grenoble Rhône-Alpes / LJK Laboratoire Jean Kuntzmann
%X Generating films from 3D animations requires knowledge in cinematography (camera placement, framing and lighting) and editing (cutting between cameras). In applications where the user is already engaged in other tasks, such as playing a game, directing virtual actors, or narrating a story, it appears desirable to build systems that can make decisions about cinematography and editing and automatically generate a grammatically correct movie according to film grammar. In this paper, we introduce a framework for generating a well-edited movie based on the rules of film editing. Specifically, our system computes a sequence of shots by simultaneously choosing which camera to use, when to cut in and out of the shot, and where to cut to. We cast film editing as a cost minimization problem in the space of possible shot sequences and provide an efficient search algorithm. The method is illustrated with multiple edits of the same footage in different editing rhythms and styles.
%2 La génération de films d'animation 3D requiert des connaissances en cinématographie (placement des caméras, cadrage, éclairage) et en montage (choix des plans). Nous proposons un système permettant de proposer automatiquement des choix de cinématographie et de montage au sein d'un logiciel d'animation 3D. Pour cela nous définissons une fonction de cout permettant de pénaliser les principales erreurs de cadrage et de montage, et une méthode d'optimisation en ligne permettant de choisir une solution de moindre cout en focntion de petit nombre de paramètres de style offert aux animateurs.
%2 I.: Computing Methodologies/I.3: COMPUTER GRAPHICS/I.3.3: Picture/Image Generation, I.: Computing Methodologies/I.3: COMPUTER GRAPHICS/I.3.7: Three-Dimensional Graphics and Realism/I.3.7.0: Animation
%G English
%8 2011-08-05
%2 international
%B ACM Siggraph / Eurographics Symposium on Computer Animation
%2 Vancouver
%2 Canada
%8 2011-08-05
%8 2011-08-07
%2 ACM SIGGRAPH / Eurographics
%K Virtual Cinematography - Computer Animation - Film Editing
%2 82860

<?xml version="1.0" encoding="UTF-8"?>
<listBibl xmlns="http://www.tei-c.org/ns/1.0" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML">
<listBibl type="inproceedings"><head>Peer-reviewed conferences/proceedings</head>
<biblStruct type="inproceedings" xml:id="hal-00646404"><analytic>
<author><persName><forename>Christophe</forename><surname>Lino</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">MIMETIC</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
<orgName type="institution">Université de Rennes II - Haute Bretagne</orgName>
</affiliation>
</author>
<author><persName><forename>Mathieu</forename><surname>Chollet</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">MIMETIC</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
<orgName type="institution">Université de Rennes II - Haute Bretagne</orgName>
</affiliation>
<affiliation>
<orgName type="laboratory">Inria Grenoble Rhône-Alpes / LJK Laboratoire Jean Kuntzmann</orgName>
<orgName type="team">IMAGINE</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5224</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Laboratoire Jean Kuntzmann</orgName>
<orgName type="institution">Université Joseph Fourier - Grenoble I</orgName>
<orgName type="institution">Institut National Polytechnique de Grenoble (INPG)</orgName>
<orgName type="institution">Université Pierre-Mendès-France - Grenoble II</orgName>
</affiliation>
</author>
<author><persName><forename>Marc</forename><surname>Christie</surname></persName>
<affiliation>
<orgName type="laboratory">INRIA - IRISA</orgName>
<orgName type="team">MIMETIC</orgName>
<country>FR</country>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Université de Rennes 1</orgName>
<orgName type="institution">Université de Rennes II - Haute Bretagne</orgName>
</affiliation>
</author>
<author><persName><forename>Rémi</forename><surname>Ronfard</surname></persName>
<affiliation>
<orgName type="laboratory">LJK</orgName>
<orgName type="team">Laboratoire Jean Kuntzmann</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5224</orgName>
<orgName type="institution">Université Joseph Fourier - Grenoble I</orgName>
<orgName type="institution">Université Pierre-Mendès-France - Grenoble II</orgName>
<orgName type="institution">Institut Polytechnique de Grenoble - Grenoble Institute of Technology</orgName>
</affiliation>
<affiliation>
<orgName type="laboratory">INRIA Grenoble Rhône-Alpes / LJK Laboratoire Jean Kuntzmann</orgName>
<orgName type="team">LEAR</orgName>
<country>FR</country>
<orgName type="institution">CNRS : UMR5527</orgName>
<orgName type="institution">INRIA</orgName>
<orgName type="institution">Laboratoire Jean Kuntzmann</orgName>
<orgName type="institution">Université Joseph Fourier - Grenoble I</orgName>
<orgName type="institution">Institut National Polytechnique de Grenoble (INPG)</orgName>
</affiliation>
</author>
<title type="main" level="a">Automated Camera Planner for Film Editing Using Key Shots</title></analytic><monogr><meeting>ACM Siggraph / Eurographics Symposium on Computer Animation</meeting><imprint><pubPlace><settlement>Vancouver</settlement><country>Canada</country></pubPlace><biblScope type="publicationDate">2011-08-05</biblScope></imprint></monogr><idno type="HALid">http://hal.inria.fr/hal-00646404</idno><idno type="HALFile">http://hal.inria.fr/hal-00646404/PDF/2011_-_Automated_Camera_Planner_for_Film_Editing_Using_Key_Shots.pdf</idno></biblStruct>
</listBibl>
</listBibl>