Motion Compensation-based Low-Complexity Decoder Side Depth Estimation for MPEG Immersive Video - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Motion Compensation-based Low-Complexity Decoder Side Depth Estimation for MPEG Immersive Video

Résumé

Decoder-Side Depth Estimation (DSDE) is a system firstly enabled in the novel MPEG Immersive Video (MIV) coding standard. In DSDE, only texture components are coded, while the depth is estimated at the decoder-side. This is motivated by previous work, which has shown high coding gain and pixel rate savings in DSDE. However, the computational complexity remains a concern, as high quality depth search has a high runtime and memory requirement. In this work we extend the concept of depth estimation to depth recovery. Using this mode, the decoder-side depth information is recovered through motion compensation utilizing the displacement vectors contained in the texture bitstream. This strategy enables us to replace most of the complex depth estimation processes with a simple motion compensation step, a decision that is drawn on the encoder-side and signaled per coding unit. With only minor losses in terms of synthesis PSNR and similar perceptual quality in terms of MS-SSIM, the complexity is significantly reduced. Depending on the acceptable loss, up to 80% of the moving objects depth may be motion compensated instead of estimated by a depth estimator translating into a speed-up of a factor of 104 for inter-frames compared to the reference depth estimator.
Fichier principal
Vignette du fichier
lcdsde_camReady.pdf (6.41 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03833539 , version 1 (28-10-2022)
hal-03833539 , version 2 (07-11-2022)

Identifiants

  • HAL Id : hal-03833539 , version 2

Citer

Patrick Garus, Felix Henry, Thomas Maugey, Christine Guillemot. Motion Compensation-based Low-Complexity Decoder Side Depth Estimation for MPEG Immersive Video. MMSP 2022 - IEEE 24th International Workshop on Multimedia Signal Processing, Sep 2022, Shanghai, China. pp.1-6. ⟨hal-03833539v2⟩
71 Consultations
50 Téléchargements

Partager

Gmail Facebook X LinkedIn More