Machine Learning-Enabled Environmentally Adaptable Skin-Electronic Sensor for Human Gesture Recognition

Abstract

Stretchable sensors have been widely investigated and developed for the purpose of human motion detection, touch sensors, and healthcare monitoring, typically converting mechanical/structural deformation into electrical signals. The viscoelastic strain of stretchable materials often results in nonlinear stress-strain characteristics over a broad range of strains, consequently making the stretchable sensors at the body joints less accurate in predicting and recognizing human gestures. Accurate recognition of human gestures can be further deteriorated by environmental changes such as temperature and humidity. Here, we demonstrated an environment-adaptable high stress-strain linearity (up to epsilon = 150%) and high-durability (>100,000 cycles) stretchable sensor conformally laminated onto the body joints for human gesture recognition. The serpentine configuration of our ionic liquid-based stretchable film enabled us to construct broad data sets of mechanical strain and temperature changes for machine learning-based gesture recognition. Signal recognition and training of distinct strains and environmental stimuli using a machine learning-based algorithm analysis successfully measured and predicted the joint motion in a temperature-changing environment with an accuracy of 92.86% (R-squared). Therefore, we believe that our serpentine-shaped ion gel-based stretchable sensor harmonized with machine-learning analysis will be a significant achievement toward environmentally adaptive and multianalyte sensing applications. Our proposed machine learning-enabled multisensor system may enable the development of future electronic devices such as wearable electronics, soft robotics, electronic skin, and human-machine interaction systems.