Skip to Main content Skip to Navigation
Conference papers

Workflow Monitoring based on 3D Motion Features

Abstract : Activity recognition has primarily addressed the identification of either actions or well-defined interactions among objects in a scene. In this work, we extend the scope to the study of workflow monitoring. In a workflow, ordered groups of activities (phases) with different durations take place in a constrained environment and create temporal patterns across the workflow instances. We address the problem of recognizing phases, based on exemplary recordings. We propose to use Workflow-HMMs, a form of HMMs augmented with phase probability variables that model the complete workflow process. This model takes into account the full temporal context which improves on-line recognition of the phases, especially in case of partial labeling. Targeted applications are workflow monitoring in hospitals and factories, where common action recognition approaches are difficult to apply. To avoid interfering with the normal workflow, we capture the activity of a room with a multiple-camera system. Additionally, we propose to rely on real-time low-level features (3D motion flow) to maintain a generic approach. We demonstrate our methods on sequences from medical procedures performed in a mock-up operating room. The sequences follow a complex workflow, containing various alternatives.
Document type :
Conference papers
Complete list of metadata

Cited literature [20 references]  Display  Hide  Download
Contributor : Marie-Odile Berger Connect in order to contact the contributor
Submitted on : Wednesday, March 31, 2010 - 10:23:14 AM
Last modification on : Thursday, March 10, 2022 - 6:30:04 PM
Long-term archiving on: : Tuesday, September 28, 2010 - 12:05:56 PM


Files produced by the author(s)




Nicolas Padoy, Diana Mateus, Daniel Weinland, Marie-Odile Berger, Nassir Navab. Workflow Monitoring based on 3D Motion Features. Workshop on Video-Oriented Object and Event Classification in Conjunction with ICCV 2009, Sep 2009, Kyoto, Japan. pp.585-592, ⟨10.1109/ICCVW.2009.5457648⟩. ⟨inria-00429355⟩



Record views


Files downloads