Workflow Monitoring based on 3D Motion Features

Abstract : Activity recognition has primarily addressed the identification of either actions or well-defined interactions among objects in a scene. In this work, we extend the scope to the study of workflow monitoring. In a workflow, ordered groups of activities (phases) with different durations take place in a constrained environment and create temporal patterns across the workflow instances. We address the problem of recognizing phases, based on exemplary recordings. We propose to use Workflow-HMMs, a form of HMMs augmented with phase probability variables that model the complete workflow process. This model takes into account the full temporal context which improves on-line recognition of the phases, especially in case of partial labeling. Targeted applications are workflow monitoring in hospitals and factories, where common action recognition approaches are difficult to apply. To avoid interfering with the normal workflow, we capture the activity of a room with a multiple-camera system. Additionally, we propose to rely on real-time low-level features (3D motion flow) to maintain a generic approach. We demonstrate our methods on sequences from medical procedures performed in a mock-up operating room. The sequences follow a complex workflow, containing various alternatives.
Type de document :
Communication dans un congrès
Workshop on Video-Oriented Object and Event Classification in Conjunction with ICCV 2009, Sep 2009, Kyoto, Japan. IEEE, pp.585-592, 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops). 〈10.1109/ICCVW.2009.5457648〉
Liste complète des métadonnées

Littérature citée [20 références]  Voir  Masquer  Télécharger

https://hal.inria.fr/inria-00429355
Contributeur : Marie-Odile Berger <>
Soumis le : mercredi 31 mars 2010 - 10:23:14
Dernière modification le : jeudi 11 janvier 2018 - 06:20:14
Document(s) archivé(s) le : mardi 28 septembre 2010 - 12:05:56

Fichier

VOEC_padoy09.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Nicolas Padoy, Diana Mateus, Daniel Weinland, Marie-Odile Berger, Nassir Navab. Workflow Monitoring based on 3D Motion Features. Workshop on Video-Oriented Object and Event Classification in Conjunction with ICCV 2009, Sep 2009, Kyoto, Japan. IEEE, pp.585-592, 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops). 〈10.1109/ICCVW.2009.5457648〉. 〈inria-00429355〉

Partager

Métriques

Consultations de la notice

401

Téléchargements de fichiers

270