Blog

Deep-learning-assisted printed liquid metal sensory system for wearable applications and boxing training | npj Flexible Electronics

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

npj Flexible Electronics volume  7, Article number: 37 (2023 ) Cite this article Aluminum Tread Plate

Deep-learning-assisted printed liquid metal sensory system for wearable applications and boxing training | npj Flexible Electronics

Liquid metal (LM) exhibits a distinct combination of high electrical conductivity comparable to that of metals and exceptional deformability derived from its liquid state, thus it is considered a promising material for high-performance soft electronics. However, rapid patterning LM to achieve a sensory system with high sensitivity remains a challenge, mainly attributed to the poor rheological property and wettability. Here, we report a rheological modification strategy of LM and strain redistribution mechanics to simultaneously simplify the scalable manufacturing process and significantly enhance the sensitivity of LM sensors. By incorporating SiO2 particles into LM, the modulus, yield stress, and viscosity of the LM-SiO2 composite are drastically enhanced, enabling 3D printability on soft materials for stretchable electronics. The sensors based on printed LM-SiO2 composite show excellent mechanical flexibility, robustness, strain, and pressure sensing performances. Such sensors are integrated onto different locations of the human body for wearable applications. Furthermore, by integrating onto a tactile glove, the synergistic effect of strain and pressure sensing can decode the clenching posture and hitting strength in boxing training. When assisted by a deep-learning algorithm, this tactile glove can achieve recognition of the technical execution of boxing punches, such as jab, swing, uppercut, and combination punches, with 90.5% accuracy. This integrated multifunctional sensory system can find wide applications in smart sport-training, intelligent soft robotics, and human-machine interfaces.

Advances in high-performance electronics with flexibility and stretchability have enabled novel applications in bio-integrated health-monitoring devices1,2,3,4,5,6,7,8, curvilinear electronics9,10, and human-machine interfaces11,12, etc. Liquid metals (LMs) are highly desired in skin-mounted, deformable electronics due to their distinct combination of excellent electrical conductivity comparable to that of metals and exceptional deformability derived from their liquid state13,14,15,16,17,18,19,20. Stretchable LM-based flexible electronics enable precise perception of complex strain and pressure stimuli and thus hold great promise in health monitoring, advanced wearable electronics, and human-machine interfaces21,22,23,24,25,26,27. However, achieving sophisticated applications with LMs remains a daunting challenge, which requires overcoming the high surface tension of LMs and improving the sensitivity of sensors28,29,30,31,32,33.

Recent advances in LM modification paved the way for creating better flexible electronics with improved processes34,35,36,37,38,39,40,41,42,43,44,45,46,47,48. By modifying the wetting characteristics and viscosity of LMs, the fabrication processes that originally involved lithography and reduction procedures can be simplified49. Some efforts have been invested to incorporate metal particles into LMs50,51. To ensure homogeneous dispersion, both LMs and metal particles were acid treated to eliminate oxidation52,53, which allowed the particles to be wetted and suspended in the LMs to improve adhesion for directly writing on various substrates. Ultrasonic treatment has also been adopted to improve device manufacturing54,55,56,57. In this approach, the accelerated oxides were distributed inside LMs during sonication to increase the viscosity of LMs. However, due to the limited viscosity improvement effect, it remains a challenge to pattern the LMs with rapid prototyping capability.

In addition to the necessity to develop an efficient preparation process, the LM-based sensors still suffer from relatively low sensitivities. Most LM-based strain sensors are based on piezoresistive effect due to the change in electrical resistance upon deformation58,59. The gauge factor of a piezoresistive strain sensor attributes to two effects, the geometry change due to deformation and the resistivity change. Prior results reported that the resistivity of LMs remained unchanged due to their excellent conductivities60,61,62, thus resistance change of LMs only depends on their geometry changes during deformation. The reported gauge factors of LM-based strain sensors are usually in the range of 2–663,64,65, thereby limiting their application in areas high sensitivity is required, such as skin prosthetics, humanoid robotics, and wearable health monitoring. Therefore, it is highly desirable to develop sensory systems based on LMs with high sensitivity.

Here, we demonstrate a modification method to modify the rheological properties of LMs, and to enhance the sensitivity and robustness of LM-based strain and pressure sensors (Fig. 1a). By mixing SiO2 micro-particles into LM, we have effectively increased the viscosity, modulus, and yield stress, enabling the manufacturing of LM sensors through 3D printing technology. The strain redistribution mechanics tuned by SiO2 micro-particles allows the printed sensor to achieve very high sensitivity (gauge factor is 5.72 for strain range within 100%, 11.36 for 100–200% and 23.91 for 200–300%) and good robustness. The sensory arrays are further integrated into a tactile glove to exploit the capability of monitoring clenching postures and punching strength in real time. Combined with a trained convolutional neural network algorithm, the multifunctional tactile glove can classify the various boxing motions, such as jab, swing, uppercut, and combination punches, with an accuracy of up to 90.5% (Fig. 1b), demonstrating its capability of recognizing personal activities in boxing training.

a Schematic illustrations of the structure of the printable LM sensors integrated on boxing gloves. The strain redistribution mechanics and enhanced pressure resistance due to SiO2 particles in LM render the flexible sensors high sensitivity and robustness, thus perceiving strain and pressure stimuli during the bending and punching process in the boxing sport. b The multisensory feedback enables the tactile glove to achieve boxing recognition, assisted with a deep-learning algorithm.

The gallium-indium alloys (Ga: In 75:25 wt%) are used as the conductive LM, and nonconductive SiO2 particles are mixed into the LM to modify the mechanical and electrical properties (Supplementary Fig. 1). Two different sizes of SiO2 particles, 40 and 6 μm, are used for the LM composites. The rheological tests (Supplementary Figs. 2–5) indicate that as the weight fraction of SiO2 increases, the average elasticity, oscillation yield stress, shear yield stress, and viscosity at 1 s−1 all increase for both LM composites (Fig. 2a–d). At the same weight ratios, the effect of rheological property modification caused by 40 μm particles is better than 6 μm particles. This is probably because the highly viscous medium (liquid gallium-indium alloy) creates a kinetic barrier to interactions among particles (Supplementary Figs. 6 and 7), and larger particles can overcome the barrier more easily when the ink is flowing. The increased elastic modulus, shear stress, and viscosity enable the composites to remain in shape after extrusion, rendering it 3D printable. The rheologically modified composites with 1 wt.% 6 μm SiO2 particles were used to print complicated 3D structures (Supplementary Fig. 8), such as one-layer (Fig. 2e) and four-layer stars (Fig. 2f), via dispensing the composites layer by layer (Supplementary Videos 1 and 2). The printed conformations remain stable due to the structural support provided by the composites, opening up opportunities to manufacture better multifunctional stretchable electronics in an efficient way.

a The average elastic modulus and b yield stress are derived from the oscillation amplitude sweep. c The yield stress is derived from the stress growth test. d The viscosity at a shear rate of 10 s−1 is derived from the flow sweep test. Photographs of 3D-printed liquid metal structures: e one-layer star and f four-layer star.

To further quantitatively evaluate the electrical and mechanical properties of the LM-SiO2 microparticle composites, patterned composite wires are connected to copper tapes and then encapsulated by Ecoflex to assemble sensing devices (Supplementary Figs. 3a and 9). The strain sensor can be twisted, curled, and stretched (Fig. 3b) without causing any damage to the device, demonstrating good mechanical flexibility and stretchability. The gauge factor of a piezoresistive strain sensor is defined as, \({GF}=\varDelta R/({R}_{0}\varepsilon )=(1+2\nu )+\varDelta \rho /(\rho \varepsilon )\) 66,67,68, where ∆R is the resistance change, R0 is the original resistance, ν is the Poisson ratio, ε is the applied tensile strain, ∆p is the resistivity change, and ρ is the original resistivity, respectively. The theoretical relationship between the resistance change and strain indicates that increasing the strain applied to pure LM wires leads to increase in electrical resistance, which is further confirmed by the experimental measurement under uniaxial tensile strain (Supplementary Fig. 10). Figure 3c shows the relative resistance change of the strain sensor versus the applied tensile strain for strain sensors based on pure LM and LM-SiO2 composites. For strain sensors based on pure LM, the relative resistance change shows linear increase with strain, with constant GF of 2.41. When 1 wt.% and 3.5 wt.% of 40 μm SiO2 particles are mixed with the LM, the GF increases to 3.01 and 4.72, respectively. When the weight ratio of 40 μm SiO2 particles increases to 6%, the curve exhibits a highly nonlinear phenomenon at a high strain level, leading to an effective GF of 14.65 over the strain range between 200% and 300%, which is more than six times higher than pure LM strain sensor.

a Schematic illustration of the structure of the LM strain sensor. b Optical images of the sensor under different deformation modes: (i) initial state, (ii) twisted, (iii) rolled, and (iv) stretched. c Relative change of electrical resistance versus strain of the LM sensors with different SiO2 filler loadings. d Mechanical simulation results of strain distributions within the LM sensors based on pure LM (top) and LM-SiO2 composite (bottom) under 100% tensile strain. e Reversible loading-unloading behavior of the LM sensors with different SiO2 filler loadings. f Relative resistance change during cyclic stretching-releasing test.

To elucidate the underlying mechanism of enhanced sensitivity due to the incorporation of SiO2 particles, finite element analysis (FEA) is used to compare the mechanical deformation of the LM sensors. It’s assumed that SiO2 particles are uniformly distributed in LM wires based on experimental observation (Supplementary Fig. 11). Figure 3d shows that the strain in the sensor based on pure LM is uniform throughout the sensor when deformed. But for the LM sensor based on LM-SiO2 composite, strain redistribution occurs along the LM wires, causing localized narrowing of LM channels. Such LM channel narrowing induced a rapid increase in electrical resistance and thus the enhancement in sensitivity. Inspired by the simulation results, we further explore the sensitivity enhancement of the strain sensor by increasing the SiO2 particle size to 0.6 mm, which is close to the width of the LM wires (0.9 mm). At large strains, significant stress concentration could be induced around the particles, and because of the blockage of the conductive path around the particles, a rapid increase in effective resistance and thus gauge factor could be achieved. As shown in Fig. 3c, the GF of the LM strain sensor using 0.6 mm SiO2 particles increases from 5.72 between 0 and 100% strain to 11.63 between 100% and 200% strain, and further to 23.91 between 200% and 300% strain, which is almost 10 times enhancement from pure LM. The minimum detectable strain and response time of the strain sensor are 0.05% and 158 ms, respectively (Supplementary Fig. 12). The sensing performance of our sensor based on modified LM and strain redistribution mechanics is compared with the previously reported LM strain sensors (Supplementary Table 1), which shows much better sensitivity, comparable strain range, and response time.

Besides the high sensitivity, stability and durability are of great importance for practical applications of strain sensors69,70. Cyclic loading and unloading testing of our strain sensors at 100% strain were conducted, and the results are shown in Fig. 3e, f. As shown in Fig. 3e, strain sensors with different filler loadings show reversibility and repeatability, with negligible hysteresis, due to the great elasticity of Ecoflex and flowability of LM-SiO2 composites. Experimental measurements show that the sensor has a very low degree of hysteresis value of 1.4% when 300% tensile strain is applied (Supplementary Fig. 13), which is attributed to intermolecular forces between the liquid-state conductor and elastomeric substrate and incomplete recovery of the original contact positions. Moreover, the electrical response of the strain sensors exhibits stability during 100 stretching-releasing cyclic test under 100% strain (Fig. 3f). Due to the mechanical flexibility, high sensitivity at both small and large strains, and the extremely wide sensing range, the LM strain sensors can be used as a wearable device on human to monitor subtle and large motions at different locations in real time. The LM strain sensors are attached to the eye, neck, fingers, and knees of the human body to detect various human motions (Fig. 4a–d). Not only the subtle muscle movements induced by micro-expression can be decoded from the analysis of the measured piezoresistive signals, but also the vigorous bending and releasing of the knee joint could be precisely recorded. Such demonstrated capabilities enable the LM sensor to be integrated with various objects to create application opportunities in intelligent soft robotic systems, interactive wearable electronics, and future human-machine interfaces.

Applications of the strain sensor as a human joint motion decoder in real time: a eye, b finger, c neck, and d knee. e Relative change of electrical resistance versus pressure of the LM pressure sensors with different SiO2 filler loadings. f Reversible loading-unloading behavior of the sensors under 100, 200, and 300 kPa pressures. g Relative resistance change under cyclic compressing-releasing tests. h Application of the pressure sensor as a human plantar pressure decoder. Y.Q. consents to the use of her picture in connection with the photographs.

In addition to strain sensing, the application of the LM sensor in pressure detection is also explored. Figure 4e exhibits the relative resistance change versus the pressure applied to the LM sensor. When the pressure exceeds a certain threshold, the LM sensor fails due to the collapse of conductive LM wires. The results indicate that the maximum pressure the sensor can withstand enhances from 696.3 to 981.5 kPa as the SiO2 weight fraction increases from 0 to 6% (inset of Fig. 4e). The incorporation of SiO2 particles can provide more resistance to counter the compressive force, resulting in improvement in the detectable pressure range. Figure 4f shows reversible loading-unloading behavior of the sensor with 6% SiO2 particles for the applied pressure ranging from 100 to 300 kPa. The relative resistance changes of the sensor under cyclic compressing-releasing tests of 100 kPa pressure for 100 cycles, as exhibited in Fig. 4g, demonstrate durability and repeatability. To illustrate the application in wearable electronics, the LM pressure sensor is attached to the bottom of a foot. Figure 4h shows that the LM sensor can detect and distinguish different motions of the foot, such as shaking leg, walking, running, and tiptoeing. The recognition mechanism is that signals of various peak values can indicate the intensity of motions, which can be used to classify different motions of the foot and therefore could be used for gait identification.

Precisely capturing the real-time strain and pressure information creates unique application opportunities for the LM sensor in boxing training, which can be utilized to provide sensory feedback for athletes to optimize the punching technique. Note that in boxing, the first step is to clench the fist and keep the bending degree of the fingers unchanged, then hit the sandbag. This sequential action can separate the strain signal from the pressure signal well without causing detection interference. Moreover, representative strategies in recent studies on multimodal sensors to decouple sensing signals include (1) minimizing the effect from one (e.g., strain or pressure), (2) allowing the sensor to exhibit different structural changes upon pressure and strain, (3) exploiting multiple sensors with anisotropic conductive networks. As a proof of concept, the sensing arrays are printed and assembled onto every finger of a flexible tactile glove to decode fist-clenching postures and impacting strengths (Fig. 5a and Supplementary Video. 3). The bending angles of all five fingers can be obtained from the measured piezoresistive signals (Fig. 5b), which could be used to distinguish between correct and incorrect fist-clenching postures in real time. Compared with the relative resistance changes of the professional fist-clenching method, incorrect fist gestures such as the valgus thumb, empty fist and invaginated little finger can be identified and distinguished using the real-time electrical signals (Fig. 5c). In addition to the clenching posture, the strength of punching is also crucial to training and competition. The increase in the punching force leads to the enhanced sensing response (Fig. 5d), providing real-time visual feedback to trainees and coaches. Figure 5e shows that the sensory glove demonstrates reversibility and reliability during punch-release cycles without noticeable degradation in sensing signals.

a Photograph of a flexible tactile glove integrated with 3D-printed sensors. Relative resistance change of the sensors in response to the b correct and c wrong clenching postures. d The electrical signals of the sensor at increased pressures. e Relative resistance change of the sensor in response to various punching strength.

Since the tactile glove is capable of decoding clenching postures and punching strength, it paves the way for the development of an intelligent boxing recognition system, in which various types of punching techniques71,72 (e.g., jab, swing, uppercut, and combination punches, Fig. 6a) can be distinguished in real time. For a unique demonstration toward the future application in sports training, the smart tactile glove is worn by a boxer to evaluate its recognition capability aided by the deep-learning algorithm. A convolutional neural network (CNN) architecture of the intelligent boxing system (Fig. 6b) is proposed to achieve precise identification of boxing punches. All algorithms in this work are implemented in PyTorch. The whole data (containing 150 sets, 30 sets for each punch) are divided into a training set (90%) and a testing set (10%) to train the CNN model. Given the complexity of the sensing signals acquired from five different fingers in different punches (Fig. 6c), only the real-time resistance change of the middle finger is used (Fig. 6d) to simplify the analysis. The confusion map of the classified result indicates that the boxing recognition accuracy of the five punches can reach 90.5% (Fig. 6e, f). This work clearly demonstrates the potential of printable LM sensors in smart sport-training, human-machine interface, and humanoid robotics. Further exploration of the integration of sensor arrays with signal processing circuit and wireless transmission module will be carried out to wirelessly monitor the freely moving human subjects. Based on this proof of concept, the remaining challenges in the motion recognition of multidimensional strain and pressure from different directions will be addressed through further understanding and optimizing the structural design of sensing arrays.

a Schematics of three boxing punches and corresponding sensing signals. b The CNN architecture constructed for identifying boxing postures from tactile information input. c The excerpts of output resistance of five fingers corresponding to the jab, uppercut, and swing punches. d The process for training and real-time identification. e Photographs of combination punches used in the dataset. f Classification test confusion matrix of boxing recognition derived from the tactile glove.

In summary, we have demonstrated a printable LM sensor with high sensitivity and good mechanical properties via effective rheological modification of LM and strain redistribution mechanics tuned by SiO2 particles. The incorporation of SiO2 micro-particles increases the elastic modulus, viscous modulus, yield stress, and viscosity of LM, which enables rapidly customizable and scalable fabrication of soft electronics based on modified LMs through 3D printing. The inclusion of SiO2 particles in LM leads to enhanced sensitivity at large tensile strains (the GF is 5.72 for strain range between 0 and 100%, 11.36 for 100–200% and 23.91 for 200–300%) due to strain redistribution mechanics within the conductive LM wires, and superior mechanical robustness to endure extreme pressure (i.e., 0.9 MPa). As a proof-of-concept demonstration, the multifunctional sensor is integrated onto a tactile glove to decode the clenching posture and hitting strength in boxing training. This tactile glove is shown to be able to identify different boxing punches (ab, swing, uppercut, and combination punches) with a recognition accuracy of 90.5%, assisted by a deep-learning algorithm. The combination of mechanical and electrical properties and demonstration in wearable systems promise great potential of the LM sensors in a wide variety of applications, such as smart sport-training, robotic operation, and human-machine interface.

The eutectic metal alloy was synthesized by mixing gallium (75%) and indium (25%) (eGaIn, Sigma-Aldrich). It maintains liquid state at room temperature (15.7 °C melting point). SiO2 micro-particles (40 μm diameter, and 6 μm diameter, Sigma-Aldrich) composing 0, 1, 3.5, 6, and 20 wt% were mixed into the eGaIn. The mixtures were stirred in the air at room temperature at 500 rpm for 2 min and 2000 rpm (vigorously stirred) for 8 min. After stirring, the mixtures containing eGaIn and uniformly distributed SiO2 particles were obtained.

The rheological characterization was performed using an Anton Paar Physica MCR 301 setup. The rheometer was equipped with a Peltier plate and parallel plate geometry of 25 mm diameter. All the tests were carried out at 25 °C.

(1) Preshear for 120 s at 1 s−1 to eliminate loading history.

(2) A frequency sweep at 0.5% strain from 0.1 to 500 rad s−1 was used to determine elastic (G′) and viscous modulus (G″) of the composites.

(3) An amplitude sweep at 1 rad s−1 from 0.05 to 1000% strain was used to determine the linear viscoelastic region of the composites as well as two versions of oscillation yield stress (σy).

(4) A flow sweep from 0.01 to 10 s−1 was used to determine the shear rate-dependent viscosity (η) of the material.

To investigate the mechanical deformation of the LM sensors, finite element analysis (FEA) was performed using ABAQUS. The Ecoflex and LM were modeled as Yeoh and Neo-Hookean hyperelastic materials using three-dimensional (3D) hybrid stress elements (C3D8H)73. The uniformly distributed SiO2 particles were assembled into the LM wires by embedding constraints. SiO2 particles were modeled using elastic isotropic material with 3D stress elements (C3D8R), with a Young’s modulus of 76 GPa and a Poisson’s ratio of 0.3. The coefficients C10, C20, and C30 were 0.0104 MPa, 0.0072 MPa, and 0.012 MPa for Ecoflex by fitting experimental data from uniaxial tensile test (Supplementary Fig. 14). The coefficient of LM is set as C10 = 0.5 kPa based on the shear modulus of 1 kPa.

The composites with 1 wt.% 6 μm SiO2 particles were used to print complicated 3D structures utilizing a commercial modular 3D printer (Hydra 640 from Hyrel 3D, Supplementary Fig. 15). The syringe extrusion head on the printer was from a regular 10 ml syringe and the syringe plunger was precisely controlled by a linear motor. Nozzles with diameters 15 and 22 Ga were used to print star and sensor shapes, respectively. The one-layer star and four-layer star were printed by dispensing the composites layer by layer at a printing speed of 10 mm s−1 through a 15 Ga nozzle. The height of each layer was 0.7 mm. Besides, we directly printed strain sensors on a tactile glove over the first knuckle regions of each finger. Each sensor was 0.6 mm wide and 20 mm long, which was printed using a 22 Ga nozzle and a printing speed of 10 mm/s.

The Ecoflex (a 1:1 mixture of Ecoflex part A and part B, Ecoflex Supersoft 0030, smooth-on, Inc.) substrate was coated on the glass by spin coating (1500 rpm for 30 s) and curing at 80 °C for 30 min. The LM-SiO2 composite wires were fabricated by printing onto the substrate. After the copper wires were attached to the printed LM wires, another Ecoflex encapsulation layer was coated on the top and cured at 80 °C for 30 min. The sample was cut into strips (40 × 20 × 1 mm) and carefully peeled off of the glass to obtain the sensors. To characterize the electrical response, the sensing signals from the sensors were obtained using a semiconductor parameter analyzer (4200-SCS, Keithley).

The tension and compression tests were carried out using an Instron mechanical testing system (Instron LEGEND2345). The speed of the tensile test and tensile cyclic test were both 240 mm/min. Tensile cycling tests were performed 100 times under 100% strain. The speed of the compression test and compression cyclic test were both 2 mm/min. Compression cycling tests were carried out 100 times under 100 kPa pressure.

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Yang, L. et al. Wearable pressure sensors based on Xene/Tissue papers for wireless human health monitoring. ACS Appl. Mater. Interfaces 13, 60531–60543 (2021).

Chen, G. Z. et al. Superelastic EGaIn composite fibers sustaining 500% tensile strain with superior electrical conductivity for wearable electronics. ACS Appl. Mater. Interfaces 12, 6112–6118 (2020).

Hu, ST et al.Programmable pneumatic super-repellent surfaces.Droplet 1, 48–55 (2022).

He, J. F. et al. Recent development in liquid metal materials. ChemistryOpen 10, 360–372 (2021).

Chen, X. et al. Porous graphene foam composite-based dual-mode sensors for underwater temperature and subtle motion detection. Chem. Eng. J. 444, 136631 (2022).

Shu, J. et al. MXene/tissue paper composites for wearable pressure sensors and thermotherapy electronics. Thin Solid Films 743, 139054 (2022).

Yang, L. et al. Fully stretchable, porous MXene-graphene foam nanocomposites for energy harvesting and self-powered sensing. Nano Energy 103, 107807 (2022).

Yi, N. et al. Fabricating functional circuits on 3D freeform surfaces via intense pulsed light-induced zinc mass transfer. Mater. Today 50, 24–34 (2021).

Byun, S.-H. et al. Mechanically transformative electronics, sensors, and implantable devices. Sci. Adv. 5, eaay0418 (2019).

Yang, L. et al. Self-healing, reconfigurable, thermal-switching, transformative electronics for health monitoring. Adv. Mater. 35, e2207742 (2023).

Zhang, N. et al. A droplet-based electricity generator with ultrahigh instantaneous output and short charging time. Droplet 1, 56–64 (2022).

Zhang, C. et al. 3D printed, solid-state conductive Ionoelastomer as a generic building block for tactile applications. Adv. Mater. 34, e2105996 (2022).

Lee, S. et al. Beyond human touch perception: an adaptive robotic skin based on gallium microgranules for pressure sensory augmentation. Adv. Mater. 34, 202204805 (2022).

Lee, G.-H. et al. Rapid meniscus-guided printing of stable semi-solid-state liquid metal microgranular-particle for soft electronics. Nat. Commun. 13, 2643 (2022).

Zhao, R. Q., Guo, R., Xu, X. L. & Liu, J. A fast and cost-effective transfer printing of liquid metal inks for three-dimensional wiring in flexible electronics. ACS Appl. Mater. Interfaces 12, 36723–36730 (2020).

Zhou, L.-Y. et al. Three-dimensional printed wearable sensors with liquid metals for detecting the pose of snakelike soft robots. ACS Appl. Mater. Interfaces 10, 23208–23217 (2018).

Yuan, B., Zhao, C. J., Sun, X. Y. & Liu, J. Lightweight liquid metal entity. Adv. Funct. Mater. 30, 1910709 (2020).

Qiu, Y. et al. A biomimetic Drosera capensis with adaptive decision-predation behavior based on multifunctional sensing and fast actuating capability. Adv. Funct. Mater. 32, 2110296 (2022).

Liu, Z. Y. et al. Surface strain redistribution on structured microfibers to enhance sensitivity of fiber-shaped stretchable strain sensors. Adv. Mater. 30, 1704229 (2018).

Yamamoto, Y. et al. Printed multifunctional flexible device with an integrated motion sensor for health care monitoring. Sci. Adv. 2, e1601473 (2016).

Han, S.-T. et al. An overview of the development of flexible sensors. Adv. Mater. 29, 1700375 (2017).

Shi, C. Q. et al. Heterogeneous integration of rigid, soft, and liquid materials for self-healable, recyclable, and reconfigurable wearable electronics. Sci. Adv. 6, eabd0202 (2020).

Chen, G. N. et al. AgNWs/Ti3C2Tx MXene-based multi-responsive actuators for programmable smart devices. Sens. Actuators B Chem. 383, 133576 (2023).

Dickey, M. D. Stretchable and soft electronics using liquid metals. Adv. Mater. 29, 1606425 (2017).

Shan, W. L., Lu, T. & Majidi, C. Soft-matter composites with electrically tunable elastic rigidity. Smart Mater. Struct. 22, 085005 (2013).

Cheng, S., Rydberg, A., Hjort, K. & Wu, Z. G. Liquid metal stretchable unbalanced loop antenna. Appl. Phys. Lett. 94, 144103 (2009).

Chen, J. et al. Superelastic, sensitive, and low hysteresis flexible strain sensor based on wave-patterned liquid metal for human activity monitoring. ACS Appl. Mater. Interfaces 12, 22200–22211 (2020).

Wu, H. P. et al. Stretchable, sensitive, flexible strain sensor incorporated with patterned liquid metal on hydrogel for human motion monitoring and human-machine interaction. J. Mater. Chem. C 10, 8206–8217 (2022).

Wang, Q., Yu, Y. & Liu, J. Preparations, characteristics and applications of the functional liquid metal materials. Adv. Eng. Mater. 20, 1700781 (2018).

Xu, Q. et al. Effect of oxidation on the mechanical properties of liquid gallium and eutectic gallium-indium. Phys. Fluids 24, 063101 (2012).

Ladd, C., So, J.-H., Muth, J. & Dickey, M. D. 3D printing of free-standing liquid metal microstructures. Adv. Mater. 25, 5081–5085 (2013).

Harada, S., Arie, T., Akita, S. & Takei, K. Highly stable liquid-solid metal contact toward multilayered detachable flexible devices. Adv. Electron. Mater. 1, 1500080 (2015).

Chen, X. Q. et al. A double-layered liquid metal-based electrochemical sensing system on fabric as a wearable detector for glucose in sweat. Microsyst. Nanoeng. 8, 48 (2022).

Zhang, Y. C. et al. Climbing-inspired twining electrodes using shape memory for peripheral nerve stimulation and recording. Sci. Adv. 5, eaaw1066 (2019).

Boutry, C. M. et al. A hierarchically patterned, bioinspired e-skin able to detect the direction of applied pressure for robotics. Sci. Robot. 3, eaau6914 (2018).

Ren, W. et al. High-performance wearable thermoelectric generator with self-healing, recycling and lego-like reconfiguring capabilities. Sci. Adv. 7, eabe0586 (2021).

Zhu, P. C. et al. Recyclable, healable and stretchable high-power thermoelectric generator. Adv. Energy. Mater. 11, 2100920 (2021).

Zhang, J. H. et al. Finger-inspired rigid-soft hybrid tactile sensor with superior sensitivity at high frequency. Nat. Commun. 13, 5076 (2022).

Won, S. M. et al. Multimodal sensing with a three-dimensional piezoresistive structure. ACS Nano 13, 10972–10979 (2019).

Shi, C. Q. et al. Highly stretchable and rehealable wearable strain sensor based on dynamic covalent thermoset and liquid metal. Smart Mater. Struct. 30, 105001 (2021).

Byun, S.-H. et al. Self-cooling gallium-based transformative electronics with a radiative cooler for reliable stiffness tuning in outdoor use. Sci. Adv. 9, 2022549 (2022).

He, K. et al. An artificial somatic reflex arc. Adv. Mater. 32, 1905399 (2019).

Chen, G. N. et al. Electrothermal actuators with ultrafast response speed and large deformation. Adv. Intell. Syst. 2, 2000036 (2020).

Zhou, H. L. et al. Stretchable piezoelectric energy harvesters and self-powered sensors for wearable and implantable devices. Biosens. Bioelectron. 168, 112569 (2020).

Qiu, Y. et al. Bioinspired, multifunctional dual-mode pressure sensors as electronic skin for decoding complex loading processes and human motions. Nano Energy 78, 105337 (2020).

Wang, C. J. et al. Programmable and scalable transfer printing with high reliability and efficiency for flexible inorganic electronics. Sci. Adv. 6, eabb2393 (2020).

Qiu, Y. et al. Nondestructive identification of softness via bioinspired multisensory electronic skins integrated on a robotic hand. NPJ Flex. Electron. 6, 45 (2022).

Cui, Z. Q. et al. Haptically quantifying Young’s modulus of soft materials using a self-locked stretchable strain sensor. Adv. Mater. 34, 2104078 (2022).

Jeong, Y. R. et al. A skin-attachable, stretchable integrated system based on liquid GaInSn for wireless human motion monitoring with multi-site sensing capabilities. NPG Asia Mater. 9, e443 (2017).

Tang, J. B. et al. Gallium-based liquid metal amalgams: transitional-state metallic mixtures (transm²ixes) with enhanced and tunable electrical, thermal, and mechanical properties. ACS Appl. Mater. Interfaces 9, 35977–35987 (2017).

Xiong, M. F., Gao, Y. X. & Liu, J. Fabrication of magnetic nano liquid metal fluid through loading of Ni nanoparticles into gallium or its alloy. J. Magn. Magn. Mater. 354, 279–283 (2014).

Tang, J. B. et al. Liquid metal phagocytosis: intermetallic wetting induced particle internalization. Adv. Sci. 4, 1700024 (2017).

Carle, F. et al. Development of magnetic liquid metal suspensions for magnetohydrodynamics. Phys. Rev. Fluids. 2, 013301 (2017).

Daalkhaijav, U., Yirmibesoglu, O. D., Walker, S. & Menguc, Y. Rheological modification of liquid metal for additive manufacturing of stretchable electronics. Adv. Mater. Technol. 3, 1700351 (2018).

Syed, N. et al. Sonication-assisted synthesis of gallium oxide suspensions featuring trap state absorption: test of photochemistry. Adv. Funct. Mater. 27, 1702295 (2017).

Boley, J. W., White, E. L. & Kramer, R. K. Mechanically sintered gallium-indium nanoparticles. Adv. Mater. 27, 2355–2360 (2015).

Lu, Y. et al.Transformable liquid-metal nanomedicine.Nat.Common.6, 10066 (2015).

Amjadi, M., Kyung, K. U., Park, I. & Sitti, M. Stretchable, skin-mountable, and wearable strain sensors and their potential applications: a review. Adv. Funct. Mater. 26, 1678–1698 (2016).

Qiu, A. D. et al. A path beyond metal and silicon:polymer/nanomaterial composites for stretchable strain sensors. Adv. Funct. Mater. 29, 1806306 (2019).

Boley, J. W., White, E. L., Chiu, G. T.-C. & Kramer, R. K. Direct writing of gallium-indium alloy for stretchable electronics. Adv. Funct. Mater. 24, 3501–3507 (2014).

Dickey, M. D. et al. Eutectic gallium-indium (EGain): a liquid metal alloy for the formation of stable structures in microchannels at room temperature. Adv. Funct. Mater. 18, 1097–1104 (2008).

Wang, Q., Yu, Y., Yang, J. & Liu, J. Fast fabrication of flexible functional circuits based on liquid metal dual-trans printing. Adv. Mater. 27, 7109–7116 (2015).

Chossat, J. B., Park, Y.-L., Wood, R. J. & Duchaine, V. A soft strain sensor based on ionic and metal liquids. IEEE Sens. J. 13, 3405–3414 (2013).

Choi, J. et al. Customizable, conformal, and stretchable 3D electronics via predistorted pattern generation and thermoforming. Sci. Adv. 7, eabj0694 (2021).

Muth, J. T. et al. Embedded 3D printing of strain sensors within highly stretchable elastomers. Adv. Mater. 26, 6307–6312 (2014).

Song, Z. Q. et al. Breathable and skin-mountable strain sensor with tunable stretchability, sensitivity, and linearity via surface strain delocalization for versatile skin activities’ recognition. ACS Appl. Mater. Interfaces 10, 42826–42836 (2018).

Kim, I. et al. Photonic sintering derived ag flake/nanoparticle-based highly sensitive stretchable strain sensor for human motion monitoring. Nanoscale 10, 7890–7897 (2018).

Shi, X. L. et al. Lowering internal friction of 0D-1D-2D ternary nanocomposite-based strain sensor by fullerene to boost the sensing performance. Adv. Funct. Mater. 28, 1800850 (2018).

Shi, C. Q. et al. Stretchable, rehealable, recyclable, and reconfigurable integrated strain sensor for joint motion and respiration monitoring. Research 2021, 9846036 (2021).

Liao, X. Q. et al. Ultrasensitive and stretchable resistive strain sensors designed for wearable electronics. Mater. Horiz. 4, 502–510 (2017).

Menzel, T. & Potthast, W. Validation of a novel boxing monitoring system to detect and analyse the centre of pressure movement on the boxer’s fist. Sensors 2, 8394 (2021).

Ma, Z. H. et al. A triboelectric-piezoresistive hybrid sensor for precisely distinguishing transient processes in mechanical stimuli. Nano Energy 78, 105216 (2020).

Dal, H., Açıkgöz, K. & Badienia, Y. On the performance of isotropic hyperelastic constitutive models for rubber-like materials: a state of the art review. Appl. Mech. Rev. 73, 020802 (2021).

J.X. acknowledges financial support from the NSF, USA (CMMI-1762324) and Facebook. Y.Q. and H.W. acknowledge financial support from the National Natural Science Foundation of China (Grant no. 12202388, 11672269, 11972323); China Postdoctoral Science Foundation (Grant no. 2022M710129, 2023T160581); Zhejiang Provincial Natural Science Foundation of China (Grant no. LQ22A020009, LR20A020002); the “Pioneer” and “Leading Goose” R&D Program of Zhejiang (Grant no. 2023C01051).

College of Mechanical Engineering, Zhejiang University of Technology, 310023, Hangzhou, China

Ye Qiu, Zhihui Zou, Jiutian Lu, Bingqing Zhong & Huaping Wu

Department of Mechanical Engineering, University of Colorado Boulder, 80309, Boulder, Colorado, USA

Ye Qiu, Zhanan Zou, Nikolas Kurnia Setiawan, Karan Vivek Dikshit, Gregory Whiting & Jianliang Xiao

College of Information Engineering, Zhejiang University of Technology, 310023, Hangzhou, China

Fan Yang & Wenan Zhang

You can also search for this author in PubMed  Google Scholar

You can also search for this author in PubMed  Google Scholar

You can also search for this author in PubMed  Google Scholar

You can also search for this author in PubMed  Google Scholar

You can also search for this author in PubMed  Google Scholar

You can also search for this author in PubMed  Google Scholar

You can also search for this author in PubMed  Google Scholar

You can also search for this author in PubMed  Google Scholar

You can also search for this author in PubMed  Google Scholar

You can also search for this author in PubMed  Google Scholar

You can also search for this author in PubMed  Google Scholar

You can also search for this author in PubMed  Google Scholar

Y.Q., Z.Z. and J.X. conceived and designed the experiments. N.S. and K.D. constructed the devices and studied their characterizations. Z.Z. and B.Z. carried out the FEA and simulation. Z.Z. and J.L. fabricated the integrated array sensor and studied its performance. F.Y. and W.Z. wrote the algorithms for demonstration. Y.Q. wrote the paper, J.X. and G.W. polished the manuscript language. H.W. and J.X. commented and supervised the paper. All authors contributed to the analysis and discussions of the results.

Correspondence to Huaping Wu or Jianliang Xiao.

The authors declare no competing interests.

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

Qiu, Y., Zou, Z., Zou, Z. et al. Deep-learning-assisted printed liquid metal sensory system for wearable applications and boxing training. npj Flex Electron 7, 37 (2023). https://doi.org/10.1038/s41528-023-00272-1

DOI: https://doi.org/10.1038/s41528-023-00272-1

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

npj Flexible Electronics (npj Flex Electron) ISSN 2397-4621 (online)

Deep-learning-assisted printed liquid metal sensory system for wearable applications and boxing training | npj Flexible Electronics

Aluminum Cutting Disc Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.