Vision based control for Humanoid robots

Claire Dune 1 Andrei Herdt 2 Eric Marchand 1 Olivier Stasse 3 Pierre-Brice Wieber 2, 4 Eiichi Yoshida 4
1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
CRISAM - Inria Sophia Antipolis - Méditerranée , Inria Rennes – Bretagne Atlantique , IRISA-D5 - SIGNAUX ET IMAGES NUMÉRIQUES, ROBOTIQUE
2 BIPOP - Modelling, Simulation, Control and Optimization of Non-Smooth Dynamical Systems
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : This paper presents a visual servoing scheme to control humanoid dynamic walk. Whereas most of the existing approaches follow a perception-decision-action scheme, we hereby introduce a method that uses the on-line information given by an on-board camera. This close looped approach allows the system to react to changes in its environment and adapt to modelling error. Our approach is based on a new reactive pattern generator which modifies footsteps, center of mass and center of pressure trajectories at the control level for the center of mass to track a reference velocity. In this workshop, we present three ways of servoing dynamical humanoid walk : a naive one that compute a reference velocity using a visual servoing control law, a second one that takes into account the sway motion induced by the walk and an on going work on vision predictive control that directly introduces the visual error in the cost function of the pattern generator. The two first approaches have been validated on the HRP-2 robot. These close loop approaches give a more accurate positioning than the one obtained when executing a planned trajectory especially when rotational motion are involved.
keyword : visual servoing
Type de document :
Communication dans un congrès
IROS Workshop on Visual Control of Mobile Robots (ViCoMoR), Sep 2011, San Francisco, USA, United States. pp.19-26, 2011
Liste complète des métadonnées
Contributeur : Eric Marchand <>
Soumis le : mercredi 9 novembre 2011 - 17:21:50
Dernière modification le : mercredi 2 août 2017 - 10:07:00
Document(s) archivé(s) le : vendredi 10 février 2012 - 02:36:59


Fichiers produits par l'(les) auteur(s)


  • HAL Id : hal-00639681, version 1


Claire Dune, Andrei Herdt, Eric Marchand, Olivier Stasse, Pierre-Brice Wieber, et al.. Vision based control for Humanoid robots. IROS Workshop on Visual Control of Mobile Robots (ViCoMoR), Sep 2011, San Francisco, USA, United States. pp.19-26, 2011. <hal-00639681>



Consultations de
la notice


Téléchargements du document