Skip to Main content Skip to Navigation
Conference papers

VIMANCO: Vision manipulation of non-cooperative objects

K. Kapellos 1 François Chaumette 2 M. Vergauwen 3 A. Rusconi 4 L. Joudrier 4 
2 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
Abstract : This paper presents the work performed in the context of the VIMANCO on-going project. It has the objective of improving the autonomy, safety and robustness of robotics system using vision. Vision is certainly the most adequate exteroceptive sensor to deal with complex and varying environments and for manipulation tasks of non cooperative objects. The approach we propose is based on an up-to-date recognition and 3D tracking method that features many advantages with respect to other approaches. First of all, it allows to determine if a known object is visible on only one image. It also allows to compute its pose and to track it in real time along the image sequence acquired by the camera, even in the presence of varying lighting conditions, partial occlusions, and aspects changes. The robustness of the proposed method has been achieved by combining an efficient low level image processing step, statistical techniques to take into account potential outliers, and a formulation of the registration step as a closed loop minimization scheme. This approach is valid if only one camera observes the object, but can also be applied to a multi-cameras system. Finally, this approach provides all the necessary data for the manipulation of non cooperative objects using the general formalism of visual servoing, which is a closed loop control scheme on visual data expressed either in the image, or in 3D, or even in both spaces simultaneously. This formalism can be applied whatever the vision sensor configuration (one or several cameras) with respect to the robot arms (eye-in-hand or eye-to-hand systems).
Document type :
Conference papers
Complete list of metadata

Cited literature [9 references]  Display  Hide  Download
Contributor : Eric Marchand Connect in order to contact the contributor
Submitted on : Tuesday, January 6, 2009 - 1:58:37 PM
Last modification on : Thursday, January 20, 2022 - 4:20:30 PM
Long-term archiving on: : Tuesday, June 8, 2010 - 6:40:57 PM


Files produced by the author(s)


  • HAL Id : inria-00350294, version 1


K. Kapellos, François Chaumette, M. Vergauwen, A. Rusconi, L. Joudrier. VIMANCO: Vision manipulation of non-cooperative objects. 9th ESA Workshop on Advanced Space Technologies for Robotics and Automation, ASTRA 2006., 2006, Noordwijk, The Netherlands, France. pp.279-286. ⟨inria-00350294⟩



Record views


Files downloads