Skip to main content
Human Activity Recognition Using Tools of Convolutional Neural Networks: A State of the Art Review, Data Sets, Challenges and Future Prospects
Computers in Biology and Medicine
  • Md Milon Islam, University of Waterloo, Canada
  • Sheikh Nooruddin, University of Waterloo, Canada
  • Fakhri Karray, University of Waterloo, Canada & Mohamed bin Zayed University of Artificial Intelligence, UAE
  • Ghulam Muhammad, King Saud University, Riyadh, Saudi Arabia
Document Type

Human Activity Recognition (HAR) plays a significant role in the everyday life of people because of its ability to learn extensive high-level information about human activity from wearable or stationary devices. A substantial amount of research has been conducted on HAR and numerous approaches based on deep learning have been exploited by the research community to classify human activities. The main goal of this review is to summarize recent works based on a wide range of deep neural networks architecture, namely convolutional neural networks (CNNs) for human activity recognition. The reviewed systems are clustered into four categories depending on the use of input devices like multimodal sensing devices, smartphones, radar, and vision devices. This review describes the performances, strengths, weaknesses, and the used hyperparameters of CNN architectures for each reviewed system with an overview of available public data sources. In addition, a discussion of the current challenges to CNN-based HAR systems is presented. Finally, this review is concluded with some potential future directions that would be of great assistance for the researchers who would like to contribute to this field. We conclude that CNN-based approaches are suitable for effective and accurate human activity recognition system applications despite challenges including availability of data regarding composite or group activities, high computational resource requirements, data privacy concerns, and edge computing limitations. For widespread adaptation, future research should be focused on more efficient edge computing techniques, datasets incorporating contextual information with activities, more explainable methodologies, and more robust systems. © 2022 Elsevier Ltd

Publication Date
  • Convolutional neural network,
  • Human activities,
  • Human activity recognition,
  • Multimodal sensing,
  • Multimodal sensing device,
  • Radar signals,
  • Sensing devices,
  • Smart phones,
  • Smartphone data,
  • Vision systems

IR Deposit conditions:

OA version (pathway b) Accepted version

12 months

License: CC BY-NC-ND

Must link to publisher version with DOI

Citation Information
M.M. Islam, S. Nooruddin, F. Karray, and G. Muhammad, "Human activity recognition using tools of convolutional neural networks: A state of the art review, data sets, challenges and future prospects," Computers in Biology and Medicine,, vol. 149, no. 106060, Oct 2022, doi:10.1016/j.compbiomed.2022.106060