From data-flow task to multitasking: applying the synchronous approach to active vision in robotics

Eric Marchand 1 E. Rutten 2 F. Chaumette 1
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
2 CTRL-A - Control techniques for Autonomic, adaptive and Reconfigurable Computing systems
Inria Grenoble - Rhône-Alpes, LIG - Laboratoire d'Informatique de Grenoble
Abstract : We apply the synchronous approach to real time active visual three dimensional (3D) reconstruction using a camera mounted on a robot end effector. It illustrates the adequateness of SIGNAL, a synchronous data flow programming language and environment, for the specification of a system dealing with various domains in central theory and computer vision. More precisely, our application consists in the 3D structure estimation of a set of geometrical primitives using an active vision paradigm. At the level of camera motion control, the visual servoing approach is specified and implemented in SIGNAL as a function from sensor inputs to control outputs. Furthermore, the 3D structure estimation method is based on the “structure from controlled motion” approach (constraining camera motion for optimal estimation). Its specification is made in parallel to visual servoing, and involves the delay mechanism of SIGNAL for the specification of filters. This reconstruction involves to be focused on each object; we thus present a perception strategy for sequencing several estimations, using task preemption and time intervals in SIGNAL. It allows us to consider in an unified framework the various aspects of the application: from dataflow task specification to multitasking and hierarchical task preemption. The integration of these techniques is validated experimentally by their implementation on a robotic cell. Merits and drawbacks of the proposed framework with respect to more typical asynchronous approaches are also discussed
Document type :
Journal articles
Complete list of metadatas

Cited literature [46 references]  Display  Hide  Download
Contributor : Eric Marchand <>
Submitted on : Wednesday, October 15, 2014 - 11:51:14 AM
Last modification on : Saturday, December 15, 2018 - 1:50:10 AM
Long-term archiving on : Friday, January 16, 2015 - 10:22:02 AM


Files produced by the author(s)



Eric Marchand, E. Rutten, F. Chaumette. From data-flow task to multitasking: applying the synchronous approach to active vision in robotics. IEEE Transactions on Control Systems Technology, Institute of Electrical and Electronics Engineers, 1997, 5 (2), pp.200-216. ⟨10.1109/87.556025⟩. ⟨hal-01074722⟩



Record views


Files downloads