Abstract:Soft interfaces with self-sensing capabilities play an essential role in environment awareness and reaction. The growing overlap between materials and sensory systems has created a myriad of challenges for sensor integration, including the design of a multimodal sensory, simplified system design capable of high spatiotemporal sensing resolution and efficient processing methods. Here we report a bioinspired soft sensor array (BOSSA) that integrates pressure and material sensing capabilities based on the triboelectric effect. Cascaded row + column electrodes embedded in low-modulus porous silicone rubber allow rich information to be captured from the environment and further analyzed by data-driven algorithms (multilayer perceptrons) to extract higher level features. BOSSA demonstrates the ability to identify 10 users (98.9%) and identify the placement or extraction of 10 objects (98.6%). Moreover, its scalable fabrication facilitates large-area sensor arrays with high spatiotemporal resolution and multimodal sensing abilities yet with a less complex system architecture. These features may be promising in the development of immersive sensing networks for intelligent monitoring and stimuli response in smart home/industry applications.The Supporting Information is available free of charge at https://pubs.acs.org/doi/10.1021/acsnano.2c01548.Schematic illustrations of the fabrication process and detailed size of the porous silicone rubber and soft sensor array. Schematic illustration showing the working mechanism of the sensing unit during a contact–separation cycle. Stress and strain relation of porous silicone rubber with a different mass ratios of NaCl to silicone. PCB system design and its connection to the BOSSA. COMSOL Multiphysics finite element simulation models of the potential distribution of the electrodes in Figure 3c. Voltage patterns of nine different users. Comparison of the output peak voltage of each channel (row/column) when generating the password "Y-A-N-G-L-U". Recognition patterns of each channel. Accuracy and loss variation concerning the training epoch. MLP optimization (PDF)Video S1. Single-pixel tactile mapping with higher electrode resolution (MP4)Video S2. Machine learning-assisted individual recognition with single-pixel touch (MP4)Video S3. Multi-pixel mapping of different objects (MP4)Video S4. Deep-learning-assisted object recognition with multi-pixel contact (MP4)Video S5. Applications in environment awareness (MP4)This article has not yet been cited by other publications.

Dual-stream deep learning integrated multimodal sensors for complex stimulus detection in intelligent sensory systems

Crosstalk-free Hybrid Integrated Multimodal Sensor for Human Temperature, Humidity, and Pressure Monitoring

Decoupled Temperature–Pressure Sensing System for Deep Learning Assisted Human–Machine Interaction

Fingerprint-inspired Dual-mode Pressure Sensor for Robotic Static and Dynamic Perception

Bimodal Tactile Sensor without Signal Fusion for User-Interactive Applications

Flexible Optoelectronic Multimodal Proximity/Pressure/Temperature Sensors with Low Signal Interference

Multifunctional Self-Powered Sensors Integrated on a Robot Hand for Detecting Temperature-Pressure Stimuli and Recognizing Objects

Flexible integrated sensor with asymmetric structure for simultaneously 3D tactile and thermal sensing

Augmented Tactile Perception of Robotic Fingers Enabled by AI‐Enhanced Triboelectric Multimodal Sensors

Design a Multifunctional Soft Tactile Sensor Enhanced by Machine Learning Approaches

Dual‐Function Tactile Sensor with Linear Pressure and Temperature Perception at Low Degree of Coupling

A Dual-Mode Pressure and Temperature Sensor

A Multifunctional Tactile Sensory System for Robotic Intelligent Identification and Manipulation Perception

Bioinspired, multifunctional dual-mode pressure sensors as electronic skin for decoding complex loading processes and human motions

Multimodal Surface Sensing Based on Hybrid Flexible Triboelectric and Piezoresistive Sensor.

Fully inkjet-printed dual-mode sensor for simultaneous pressure and temperature sensing with high decoupling

A Dielectric Elastomer-Based Multimodal Capacitive Sensor

Bioinspired Co‐Design of Tactile Sensor and Deep Learning Algorithm for Human–Robot Interaction

Machine-Learning-Assisted Recognition on Bioinspired Soft Sensor Arrays

Bioinspired Integrated Multidimensional Sensor for Adaptive Grasping by Robotic Hands and Physical Movement Guidance

Magnetically Induced Grid Structure for Enhancing the Performance of a Dual-Mode Flexible Sensor with Tactile/Touchless Perception