Learning to recognize parallel combinations of human motion primitives with linguistic descriptions using non-negative matrix factorization

Abstract : We present an approach, based on non-negative matrix factorization, for learning to recognize parallel combinations of initially unknown human motion primitives, associated with ambiguous sets of linguistic labels during training. In the training phase, the learner observes a human producing complex motions which are parallel combinations of initially unknown motion primitives. Each time the human shows a complex motion, he also provides high-level linguistic descriptions, consisting of a set of labels giving the name of the primitives inside the complex motion. From the observation of multi-modal combinations of high-level labels with high-dimensional continuous unsegmented values representing complex motions, the learner must later on be able to recognize, through the production of the adequate set of labels, which are the motion primitives in a novel complex motion produced by a human, even if those combinations were never observed during training. We explain how this problem, as well as natural extensions, can be addressed using non-negative matrix factorization. Then, we show in an experiment in which a learner has to recognize the primitive motions of complex human dance choreographies, that this technique allows the system to infer with good performance the combinatorial structure of parallel combinations of unknown primitives.
Document type :
Journal articles
Proceedings of 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE, 2012


https://hal.inria.fr/hal-00764353
Contributor : Olivier Mangin <>
Submitted on : Thursday, December 13, 2012 - 9:20:53 AM
Last modification on : Tuesday, January 20, 2015 - 5:13:28 PM

File

mangin.2012.iros.pdf
fileSource_public_author

Identifiers

  • HAL Id : hal-00764353, version 1

Citation

Olivier Mangin, Pierre-Yves Oudeyer. Learning to recognize parallel combinations of human motion primitives with linguistic descriptions using non-negative matrix factorization. Proceedings of 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE, 2012. <hal-00764353>

Export

Share

Metrics

Consultation de
la notice

77

Téléchargement du document

36