Skip to main content
Article
Worker Activity Recognition in Smart Manufacturing Using IMU and sEMG Signals with Convolutional Neural Networks
Procedia Manufacturing
  • Wenjin Tao
  • Ze-Hao Lai
  • Ming-Chuan Leu, Missouri University of Science and Technology
  • Zhaozheng Yin, Missouri University of Science and Technology
Abstract

In a smart manufacturing system involving workers, recognition of the worker's activity can be used for quantification and evaluation of the worker's performance, as well as to provide onsite instructions with augmented reality. In this paper, we propose a method for activity recognition using Inertial Measurement Unit (IMU) and surface electromyography (sEMG) signals obtained from a Myo armband. The raw 10-channel IMU signals are stacked to form a signal image. This image is transformed into an activity image by applying Discrete Fourier Transformation (DFT) and then fed into a Convolutional Neural Network (CNN) for feature extraction, resulting in a high-level feature vector. Another feature vector representing the level of muscle activation is evaluated with the raw 8-channel sEMG signals. Then these two vectors are concatenated and used for work activity classification. A worker activity dataset is established, which at present contains 6 common activities in assembly tasks, i.e., grab tool/part, hammer nail, use power-screwdriver, rest arm, turn screwdriver, and use wrench. The developed CNN model is evaluated on this dataset and achieves 98% and 87% recognition accuracy in the half-half and leave-one-out experiments, respectively.

Meeting Name
46th SME North American Manufacturing Research Conference, NAMRC 2018 (2018, Jun. 18-22, College Station, TX)
Department(s)
Mechanical and Aerospace Engineering
Second Department
Computer Science
Keywords and Phrases
  • Activity Recognition,
  • Convolutional Neural Networks (CNN),
  • Deep Learning,
  • IMU,
  • sEMG,
  • Smart Manufacturing
Document Type
Article - Conference proceedings
Document Version
Final Version
File Type
text
Language(s)
English
Rights
© 2018 The Authors, All rights reserved.
Creative Commons Licensing
Creative Commons Attribution-No Derivative Works 4.0
Publication Date
6-1-2018
Citation Information
Wenjin Tao, Ze-Hao Lai, Ming-Chuan Leu and Zhaozheng Yin. "Worker Activity Recognition in Smart Manufacturing Using IMU and sEMG Signals with Convolutional Neural Networks" Procedia Manufacturing Vol. 26 (2018) p. 1159 - 1166 ISSN: 2351-9789
Available at: http://works.bepress.com/zhaozheng-yin/62/