Deep Learning Enhanced Human Activity Recognition for Internet of Healthcare Things

Abstract

Along with the advancement of several emerging computing paradigms and technologies, such as cloud computing, mobile computing, artificial intelligence, and big data, Internet of Things (IoT) technologies have been applied in a variety of fields. In particular, the Internet of Healthcare Things (IoHT) is becoming increasingly important in Human Activity Recognition (HAR), due to the rapid development of wearable and mobile devices. In this study, we focus on the deep learning enhanced HAR in IoHT environments. A semi-supervised deep learning framework is designed and built for more accurate HAR, which efficiently use and analyze the weakly labeled sensor data to train the classifier learning model. To better solve the problem of inadequately labeled sample, an intelligent auto-labeling scheme based on Deep Q-Network (DQN) is developed with a newly designed distance-based reward rule, which can improve the learning efficiency in IoT environments. A multi-sensor based data fusion mechanism is then developed to seamlessly integrate the on-body sensor data, context sensor data, and personal profile data together, and a Long Short Term Memory (LSTM)-based classification method is proposed to identify fine-grained patterns according to the high-level features contextually extracted from sequential motion data. Finally, experiments and evaluations are conducted to demonstrate the usefulness and effectiveness of the proposed method using real world data.