Localisation of humans, objects and robots interacting on load-sensing floors

Mihai Andries 1, 2 Olivier Simonin 3 François Charpillet 1
1 LARSEN - Lifelong Autonomy and interaction skills for Robots in a Sensing ENvironment
Inria Nancy - Grand Est, LORIA - AIS - Department of Complex Systems, Artificial Intelligence & Robotics
3 CHROMA - Robots coopératifs et adaptés à la présence humaine en environnements dynamiques
CITI - CITI Centre of Innovation in Telecommunications and Integration of services, Inria Grenoble - Rhône-Alpes
Abstract : Localisation, tracking and recognition of objects and humans are basic tasks that are of high value in applications of ambient intelligence. Sensing floors were introduced to address these tasks in a non-intrusive way. To recognize the humans moving on the floor, they are usually first localized, and then a set of gait features are extracted (stride length, cadence, pressure profile over a footstep). However, recognition generally fails when several people stand or walk together, preventing successful tracking. This paper presents a detection, tracking and recognition technique which uses objects' weight. It continues working even when tracking individual persons becomes impossible. Inspired by computer vision, this technique processes the floor pressure-image by segmenting the blobs containing objects, tracking them, and recognizing their contents through a mix of inference and combinatorial search. The result lists the probabilities of assignments of known objects to observed blobs. The concept was successfully evaluated in daily life activity scenarii, involving multi-object tracking and recognition on low resolution sensors, crossing of user trajectories, and weight ambiguity. This technique can be used to provide a probabilistic input for multi-modal object tracking and recognition systems.
Complete list of metadatas

Cited literature [57 references]  Display  Hide  Download

Contributor : Mihai Andries <>
Submitted on : Thursday, October 29, 2015 - 6:19:28 AM
Last modification on : Friday, June 7, 2019 - 12:47:14 PM
Long-term archiving on : Friday, April 28, 2017 - 8:21:11 AM


Files produced by the author(s)





Mihai Andries, Olivier Simonin, François Charpillet. Localisation of humans, objects and robots interacting on load-sensing floors. IEEE Sensors Journal, Institute of Electrical and Electronics Engineers, 2016, 16 (4), pp.1026-1037. ⟨http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=7302515⟩. ⟨10.1109/JSEN.2015.2493122⟩. ⟨hal-01196042v2⟩



Record views


Files downloads