Camera keyframing with style and control - Archive ouverte HAL Access content directly
Journal Articles ACM Transactions on Graphics Year : 2021

Camera keyframing with style and control

(1) , (2) , (2) , (1) , (3) , (1)
1
2
3

Abstract

We present a novel technique that enables 3D artists to synthesize camera motions in virtual environments following a camera style, while enforcing user-designed camera keyframes as constraints along the sequence. To solve this constrained motion in-betweening problem, we design and train a camera motion generator from a collection of temporal cinematic features (camera and actor motions) using a conditioning on target keyframes. We further condition the generator with a style code to control how to perform the interpolation between the keyframes. Style codes are generated by training a second network that encodes different camera behaviors in a compact latent space, the camera style space. Camera behaviors are defined as temporal correlations between actor features and camera motions and can be extracted from real or synthetic film clips. We further extend the system by incorporating a fine control of camera speed and direction via a hidden state mapping technique. We evaluate our method on two aspects: i) the capacity to synthesize style-aware camera trajectories with user defined keyframes; and ii) the capacity to ensure that in-between motions still comply with the reference camera style while satisfying the keyframe constraints. As a result, our system is the first style-aware keyframe in-betweening technique for camera control that balances style-driven automation with precise and interactive control of keyframes.
Fichier principal
Vignette du fichier
SIG_ASIA_2021_camera_Keyframe___Authors_version.pdf (25.25 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03519249 , version 1 (10-01-2022)

Identifiers

Cite

Hongda Jiang, Marc Christie, Xi Wang, Libin Liu, Bin Wang, et al.. Camera keyframing with style and control. ACM Transactions on Graphics, 2021, 40, pp.1 - 13. ⟨10.1145/3478513.3480533⟩. ⟨hal-03519249⟩
44 View
46 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More