a-flexible-wearable-supernumerary-robotic-limb-for-chronic-stroke

A Flexible Wearable Supernumerary Robotic Limb for Chronic Stroke Patients

In this study, we present a flexible wearable supernumerary robotic limb that helps chronic stroke patients with finger rehabilitation and grasping ...

Huazhong University of Science and Technology

Human activity recognition (HAR) based on the wearable device has attracted more attention from researchers with sensor technology development in recent years. However, personalized HAR requires high accuracy of recognition, while maintaining the model's generalization capability is a major challenge in this field. This paper designed a compact wireless wearable sensor node, which combines an air pressure sensor and inertial measurement unit (IMU) to provide multi-modal information for HAR model training. To solve personalized recognition of user activities, we propose a new transfer learning algorithm, which is a joint probability domain adaptive method with improved pseudo-labels (IPL-JPDA). This method adds the improved pseudo-label strategy to the JPDA algorithm to avoid cumulative errors due to inaccurate initial pseudo-labels. In order to verify our equipment and method, we use the newly designed sensor node to collect seven daily activities of 7 subjects. Nine different HAR models are trained by traditional machine learning and transfer learning methods. The experimental results show that the multi-modal data improve the accuracy of the HAR system. The IPL-JPDA algorithm proposed in this paper has the best performance among five HAR models, and the average recognition accuracy of different subjects is 93.2%.

Personalized Human Activity Recognition Based on Integrated Wearable Sensor and Transfer Learning.

In emotion recognition based on physiological signals, collecting enough labeled data of a single subject for training is time-consuming and expensive. The physiological signals' individual differences and the inherent noise will significantly affect emotion recognition accuracy. To overcome the difference in subject physiological signals, we propose a joint probability domain adaptation with the bi-projection matrix algorithm (JPDA-BPM). The bi-projection matrix method fully considers the source and target domain's different feature distributions. It can better project the source and target domains into the feature space, thereby increasing the algorithm's performance. We propose a substructure-based joint probability domain adaptation algorithm (SSJPDA) to overcome physiological signals' noise effect. This method can avoid the shortcomings that the domain level matching is too rough and the sample level matching is susceptible to noise. In order to verify the effectiveness of the proposed transfer learning algorithm in emotion recognition based on physiological signals, we verified it on the database for emotion analysis using physiological signals (DEAP dataset). The experimental results show that the average recognition accuracy of the proposed SSJPDA-BPM algorithm in the multimodal fusion physiological data from the DEAP dataset is 63.6 and 64.4% in valence and arousal, respectively. Compared with joint probability domain adaptation (JPDA), the performance of valence and arousal recognition accuracy increased by 17.6 and 13.4%, respectively.

Emotion recognition based on multi-modal physiological signals and transfer learning.

Recent advances in flexible wearable devices have boosted the remarkable development of devices for human-machine interfaces, which are of great value to emerging cybernetics, robotics, and Metaverse systems. However, the effectiveness of existing approaches is limited by the quality of sensor data and classification models with high computational costs. Here, a novel gesture recognition system with triboelectric smart wristbands and an adaptive accelerated learning (AAL) model is proposed. The sensor array is well deployed according to the wrist anatomy and retrieves hand motions from a distance, exhibiting highly sensitive and high-quality sensing capabilities beyond existing methods. Importantly, the anatomical design leads to the close correspondence between the actions of dominant muscle/tendon groups and gestures, and the resulting distinctive features in sensor signals are very valuable for differentiating gestures with data from 7 sensors. The AAL model realizes a 97.56% identification accuracy in training 21 classes with only one-third operands of the original neural network. The applications of the system are further exploited in real-time somatosensory teleoperations with a low latency of <1 s, revealing a new possibility for endowing cyber-human interactions with disruptive innovation and immersive experience.

Article	Year
Personalized Human Activity Recognition Based on Integrated Wearable Sensor and Transfer Learning. Sensors (Basel, Switzerland)\| PubMed ID: 33525538	2021
Emotion recognition based on multi-modal physiological signals and transfer learning. Frontiers in neuroscience\| PubMed ID: 36161186	2022
Anatomically Designed Triboelectric Wristbands with Adaptive Accelerated Learning for Human-Machine Interfaces. Advanced science (Weinheim, Baden-Wurttemberg, Germany)\| PubMed ID: 36683215	2023

Zhongzheng Fu

Biography

JoVE Journal Publications

Other Publications