Abstract:A smart sensor architecture combining an array of sensing elements with an overlapping array of computing and memory elements thus emulates an innervated peripheral sensing system (IPSS) capable of local and autonomous neuromorphic in‐sensor data pre‐processing is presented. Compatibility of the proposed architecture with functionally distinct elements for sensing, memory, and computing removes the restrictive demand for a single element simultaneously capable of all, thus making this architecture more generally applicable to a wider range of sensors and usage scenarios. An array of sensors generating a collection of correlated signals can benefit from integration with a "smart" system for autonomous inferencing. Mimicking their biological counterparts, smart sensor systems shall possess the capabilities of sensing, memory, and neuromorphic computation. However, state‐of‐the‐art biomimetic systems either do not employ a full set of devices to cover the complete range of capabilities or incorporate devices that are capable of all but appropriate only for a limited range of sensing applications. Presently proposed is a smart sensor architecture that combines an array of sensing elements with an overlapping array of computing and memory elements, thus emulating an innervated peripheral sensing system (IPSS) capable of local and autonomous neuromorphic in‐sensor data pre‐processing. Compatibility of the proposed architecture with functionally distinct elements for sensing, memory, and computing removes the restrictive demand for a single element simultaneously capable of all, thus making this architecture more generally applicable to a wider range of sensors and usage scenarios. An artificial synapse as a computing element is implemented using dual‐gate (DG) thin‐film transistors (TFTs) and the low‐leakage current of transistors based on metal‐oxide semiconductors allows the deployment of capacitors as memory elements. The outputs of the IPSS are passed on to an adjacent artificial neural network (ANN) for near‐sensor inferencing. Monolithic integration of the IPSS and the ANN is made possible by the deployment of the same memory and computing elements in their construction. A smart tactile sensing system based on the proposed architecture is constructed and characterized. The functionality of the system is demonstrated by its application to the classification of a set of tactile images of 3‐dimensionally printed alphabet stamps.

Bio‐Inspired In‐Sensor Compression and Computing Based on Phototransistors

Bio‐Inspired In‐Sensor Compression and Computing Based on Phototransistors (Small 23/2022)

Multimodal In-Sensor Computing Implemented by Easily-Fabricated Oxide-Heterojunction Optoelectronic Synapses

1-Phototransistor-1-Threshold Switching Optoelectronic Neuron for In-Sensor Compression via Spiking Neuron Network

Ultra-low power IGZO optoelectronic synaptic transistors for neuromorphic computing

Photogated Synaptic Transistors Based on the Heterostructure of 4H-Sic and Organic Semiconductors for Neuromorphic Ultraviolet Vision

High-performance IGZO/In2O3 NW/IGZO Phototransistor with Heterojunctions Architecture for Image Processing and Neuromorphic Computing

Ultralow Light‐Power Consuming Photonic Synapses Based on Ultrasensitive Perovskite/Indium‐Gallium‐Zinc‐Oxide Heterojunction Phototransistors

IGZO/InHfO$_{\textit{x}}$ Nanowires/IGZO Phototransistor with Persistent Photoconductivity Effect for Intelligent Visual Perception Application

Photonic Synapses for Image Recognition and High Density Integration of Simplified Artificial Neural Networks

In-Sensor Computing Realization Using Fully CMOS-Compatible TiN/HfO<sub> <i>x</i> </sub>-Based Neuristor Array

Photonic Synapses with Ultralow Energy Consumption for Artificial Visual Perception and Brain Storage

In‐Sensor Computing‐Based Smart Sensing Architecture Implemented Using a Dual‐Gate Metal‐Oxide Thin‐Film Transistor Technology

In-Sensor Computing Realization Using Fully CMOS-Compatible TiN/HfO<sub><i>x</i></sub>-Based Neuristor Array

Progress in Bioinspired Photodetectors Design for Visual Information Processing

Coupled Ferroelectric‐Photonic Memory in a Retinomorphic Hardware for In‐Sensor Computing

IGZO/InHfO<inline-formula> <tex-math notation="LaTeX">$_{\textit{x}}$</tex-math> </inline-formula> Nanowires/IGZO Phototransistor With Persistent Photoconductivity Effect for Intelligent Visual Perception Application

Synaptic a-Si:H/a-Ga2O3 phototransistor inspired by the phototaxis behavior of organisms with all-optical and all-electrical stimulation modes

Comprehensively Modulated Sub-Attojoule Operated Optoelectronic Synapses for Image Encryption and Inpainting

Broadband Optoelectronic Synapse Enables Compact Monolithic Neuromorphic Machine Vision for Information Processing

Neuromorphic sensory computing