Robust triboelectric information‐mat enhanced by multi‐modality deep learning for smart home

Yanqin Yang,Qiongfeng Shi,Zixuan Zhang,Xuechuan Shan,Budiman Salam,Chengkuo Lee

DOI: https://doi.org/10.1002/inf2.12360

2022-08-30

InfoMat

Abstract:A digital‐twin smart home is realized by a scalable, robust, and all‐triboelectric nanogenerator (TENG) information‐mat (InfoMat), where not only the varying interdigital electrode designs for the mat pixels enable stable output from the mat and show high tolerance to environment changes, but also the multi‐modality deep learning effectively enhances the classification accuracy for identifications. In metaverse, a digital‐twin smart home is a vital platform for immersive communication between the physical and virtual world. Triboelectric nanogenerators (TENGs) sensors contribute substantially to providing smart‐home monitoring. However, TENG deployment is hindered by its unstable output under environment changes. Herein, we develop a digital‐twin smart home using a robust all‐TENG based information mat (InfoMat), which consists of an in‐home mat array and an entry mat. The interdigital electrodes design allows environment‐insensitive ratiometric readout from the mat array to cancel the commonly experienced environmental variations. Arbitrary position sensing is also achieved because of the interval arrangement of the mat pixels. Concurrently, the two‐channel entry mat generates multi‐modality information to aid the 10‐user identification accuracy to increase from 93% to 99% compared to the one‐channel case. Furthermore, a digital‐twin smart home is visualized by real‐time projecting the information in smart home to virtual reality, including access authorization, position, walking trajectory, dynamic activities/sports, and so on.

materials science, multidisciplinary