Skip to Main content Skip to Navigation
Conference papers

Workflow Monitoring based on 3D Motion Features

Abstract : Activity recognition has primarily addressed the identification of either actions or well-defined interactions among objects in a scene. In this work, we extend the scope to the study of workflow monitoring. In a workflow, ordered groups of activities (phases) with different durations take place in a constrained environment and create temporal patterns across the workflow instances. We address the problem of recognizing phases, based on exemplary recordings. We propose to use Workflow-HMMs, a form of HMMs augmented with phase probability variables that model the complete workflow process. This model takes into account the full temporal context which improves on-line recognition of the phases, especially in case of partial labeling. Targeted applications are workflow monitoring in hospitals and factories, where common action recognition approaches are difficult to apply. To avoid interfering with the normal workflow, we capture the activity of a room with a multiple-camera system. Additionally, we propose to rely on real-time low-level features (3D motion flow) to maintain a generic approach. We demonstrate our methods on sequences from medical procedures performed in a mock-up operating room. The sequences follow a complex workflow, containing various alternatives.
Document type :
Conference papers
Complete list of metadata

Cited literature [20 references]  Display  Hide  Download

https://hal.inria.fr/inria-00429355
Contributor : Marie-Odile Berger <>
Submitted on : Wednesday, March 31, 2010 - 10:23:14 AM
Last modification on : Friday, February 26, 2021 - 3:28:08 PM
Long-term archiving on: : Tuesday, September 28, 2010 - 12:05:56 PM

File

VOEC_padoy09.pdf
Files produced by the author(s)

Identifiers

Collections

Citation

Nicolas Padoy, Diana Mateus, Daniel Weinland, Marie-Odile Berger, Nassir Navab. Workflow Monitoring based on 3D Motion Features. Workshop on Video-Oriented Object and Event Classification in Conjunction with ICCV 2009, Sep 2009, Kyoto, Japan. pp.585-592, ⟨10.1109/ICCVW.2009.5457648⟩. ⟨inria-00429355⟩

Share

Metrics

Record views

588

Files downloads

685