Skip to Main content Skip to Navigation
Conference papers

Recognition of Activities of Daily Living via Hierarchical Long-Short Term Memory Networks

Maxime Devanne 1, 2 Panagiotis Papadakis 1, 2 Sao Mai Nguyen 1, 2 
Lab-STICC - Laboratoire des sciences et techniques de l'information, de la communication et de la connaissance
Abstract : In order to offer optimal and personalized assistance services to frail people, smart homes or assistive robots must be able to understand the context and activities of users. With this outlook, we propose a vision-based approach for understanding activities of daily living (ADL) through skeleton data captured using an RGB-D camera. Upon decomposition of a skeleton sequence into short temporal segments, activities are classified via a hierarchical two-layer Long-Short Term Memory Network (LSTM) allowing to analyse the sequence at different levels of temporal granularity. The proposed approach is evaluated on a very challenging daily activity dataset wherein we attain superior performance. Our main contribution is a multi-scale, temporal dependency model of activities, founded on a comparison of context features that characterize previous recognition results and a hierarchical representation with a low-level behaviour-unit recognition layer and a high-level units chaining layer.
Complete list of metadata

Cited literature [39 references]  Display  Hide  Download
Contributor : Panagiotis Papadakis Connect in order to contact the contributor
Submitted on : Friday, July 26, 2019 - 11:20:16 AM
Last modification on : Friday, August 5, 2022 - 2:54:52 PM


Files produced by the author(s)



Maxime Devanne, Panagiotis Papadakis, Sao Mai Nguyen. Recognition of Activities of Daily Living via Hierarchical Long-Short Term Memory Networks. SMC 2019 : IEEE International Conference on Systems, Man, and Cybernetics, Oct 2019, Bari, Italy. ⟨10.1109/SMC.2019.8914457⟩. ⟨hal-02194928⟩



Record views


Files downloads