Skip to Main content Skip to Navigation
New interface
Journal articles

Using Language Model to Bootstrap Human Activity Recognition Ambient Sensors Based in Smart Homes

Damien Bouchabou 1, 2, 3 Sao Mai Nguyen 1, 2 Christophe Lohr 1, 2 Benoit Leduc 3 Ioannis Kanellos 1, 2 
1 Lab-STICC_RAMBO - Equipe Robot interaction, Ambient system, Machine learning, Behaviour, Optimization
Lab-STICC - Laboratoire des sciences et techniques de l'information, de la communication et de la connaissance : UMR6285
Abstract : Long Short Term Memory (LSTM)-based structures have demonstrated their efficiency for daily living recognition activities in smart homes by capturing the order of sensor activations and their temporal dependencies. Nevertheless, they still fail in dealing with the semantics and the context of the sensors. More than isolated id and their ordered activation values, sensors also carry meaning. Indeed, their nature and type of activation can translate various activities. Their logs are correlated with each other, creating a global context. We propose to use and compare two Natural Language Processing embedding methods to enhance LSTM-based structures in activity-sequences classification tasks: Word2Vec, a static semantic embedding, and ELMo, a contextualized embedding. Results, on real smart homes datasets, indicate that this approach provides useful information, such as a sensor organization map, and makes less confusion between daily activity classes. It helps to better perform on datasets with competing activities of other residents or pets. Our tests show also that the embeddings can be pretrained on different datasets than the target one, enabling transfer learning. We thus demonstrate that taking into account the context of the sensors and their semantics increases the classification performances and enables transfer learning.
Complete list of metadata
Contributor : Sao Mai Nguyen Connect in order to contact the contributor
Submitted on : Thursday, November 18, 2021 - 7:54:55 PM
Last modification on : Friday, August 5, 2022 - 2:54:52 PM
Long-term archiving on: : Saturday, February 19, 2022 - 6:03:33 PM


Files produced by the author(s)



Damien Bouchabou, Sao Mai Nguyen, Christophe Lohr, Benoit Leduc, Ioannis Kanellos. Using Language Model to Bootstrap Human Activity Recognition Ambient Sensors Based in Smart Homes. Electronics, 2021, 10 (20), pp.2498. ⟨10.3390/electronics10202498⟩. ⟨hal-03381762⟩



Record views


Files downloads