Spatio-Temporal Alignments: Optimal transport through space and time - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2019

Spatio-Temporal Alignments: Optimal transport through space and time

Résumé

Comparing data defined over space and time is notoriously hard, because it involves quantifying both spatial and temporal variability, while at the same time taking into account the chronological structure of data. Dynamic Time Warping (DTW) computes an optimal alignment between time series in agreement with the chronological order, but is inherently blind to spatial shifts. In this paper, we propose Spatio-Temporal Alignments (STA), a new differentiable formulation of DTW, in which spatial differences between time samples are accounted for using regularized optimal transport (OT). Our temporal alignments are handled through a smooth variant of DTW called soft-DTW, for which we prove a new property: soft-DTW increases quadrati-cally with time shifts. The cost matrix within soft-DTW that we use are computed using unbalanced OT, to handle the case in which observations are not normalized probabilities. Experiments on handwritten letters and brain imaging data confirm our theoretical findings and illustrate the effectiveness of STA as a dissimilarity for spatio-temporal data.
Fichier principal
Vignette du fichier
arxiv___aistats20.pdf (8.8 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02309340 , version 1 (09-10-2019)
hal-02309340 , version 2 (28-10-2019)

Identifiants

  • HAL Id : hal-02309340 , version 1

Citer

Hicham Janati, Marco Cuturi, Alexandre Gramfort. Spatio-Temporal Alignments: Optimal transport through space and time. 2019. ⟨hal-02309340v1⟩
169 Consultations
98 Téléchargements

Partager

Gmail Facebook X LinkedIn More