Human Activity Recognition Using Tools of Convolutional Neural Networks: A State of the Art Review, Data Sets, Challenges and Future Prospects
Document Type
Article
Publication Title
Computers in Biology and Medicine
Abstract
Human Activity Recognition (HAR) plays a significant role in the everyday life of people because of its ability to learn extensive high-level information about human activity from wearable or stationary devices. A substantial amount of research has been conducted on HAR and numerous approaches based on deep learning have been exploited by the research community to classify human activities. The main goal of this review is to summarize recent works based on a wide range of deep neural networks architecture, namely convolutional neural networks (CNNs) for human activity recognition. The reviewed systems are clustered into four categories depending on the use of input devices like multimodal sensing devices, smartphones, radar, and vision devices. This review describes the performances, strengths, weaknesses, and the used hyperparameters of CNN architectures for each reviewed system with an overview of available public data sources. In addition, a discussion of the current challenges to CNN-based HAR systems is presented. Finally, this review is concluded with some potential future directions that would be of great assistance for the researchers who would like to contribute to this field. We conclude that CNN-based approaches are suitable for effective and accurate human activity recognition system applications despite challenges including availability of data regarding composite or group activities, high computational resource requirements, data privacy concerns, and edge computing limitations. For widespread adaptation, future research should be focused on more efficient edge computing techniques, datasets incorporating contextual information with activities, more explainable methodologies, and more robust systems. © 2022 Elsevier Ltd
DOI
10.1016/j.compbiomed.2022.106060
Publication Date
10-2022
Keywords
Convolutional neural network, Human activities, Human activity recognition, Multimodal sensing, Multimodal sensing device, Radar signals, Sensing devices, Smart phones, Smartphone data, Vision systems
Recommended Citation
M.M. Islam, S. Nooruddin, F. Karray, and G. Muhammad, "Human activity recognition using tools of convolutional neural networks: A state of the art review, data sets, challenges and future prospects," Computers in Biology and Medicine,, vol. 149, no. 106060, Oct 2022, doi:10.1016/j.compbiomed.2022.106060
Additional Links
Preprint available on arXiv
Comments
IR Deposit conditions:
OA version (pathway b) Accepted version
12 months
License: CC BY-NC-ND
Must link to publisher version with DOI