Abstract:A smart sensor architecture combining an array of sensing elements with an overlapping array of computing and memory elements thus emulates an innervated peripheral sensing system (IPSS) capable of local and autonomous neuromorphic in‐sensor data pre‐processing is presented. Compatibility of the proposed architecture with functionally distinct elements for sensing, memory, and computing removes the restrictive demand for a single element simultaneously capable of all, thus making this architecture more generally applicable to a wider range of sensors and usage scenarios. An array of sensors generating a collection of correlated signals can benefit from integration with a "smart" system for autonomous inferencing. Mimicking their biological counterparts, smart sensor systems shall possess the capabilities of sensing, memory, and neuromorphic computation. However, state‐of‐the‐art biomimetic systems either do not employ a full set of devices to cover the complete range of capabilities or incorporate devices that are capable of all but appropriate only for a limited range of sensing applications. Presently proposed is a smart sensor architecture that combines an array of sensing elements with an overlapping array of computing and memory elements, thus emulating an innervated peripheral sensing system (IPSS) capable of local and autonomous neuromorphic in‐sensor data pre‐processing. Compatibility of the proposed architecture with functionally distinct elements for sensing, memory, and computing removes the restrictive demand for a single element simultaneously capable of all, thus making this architecture more generally applicable to a wider range of sensors and usage scenarios. An artificial synapse as a computing element is implemented using dual‐gate (DG) thin‐film transistors (TFTs) and the low‐leakage current of transistors based on metal‐oxide semiconductors allows the deployment of capacitors as memory elements. The outputs of the IPSS are passed on to an adjacent artificial neural network (ANN) for near‐sensor inferencing. Monolithic integration of the IPSS and the ANN is made possible by the deployment of the same memory and computing elements in their construction. A smart tactile sensing system based on the proposed architecture is constructed and characterized. The functionality of the system is demonstrated by its application to the classification of a set of tactile images of 3‐dimensionally printed alphabet stamps.

In-sensor nonlinear convolutional processing based on hybrid MTJ/CMOS arrays

A Reconfigurable Convolution-in-Pixel CMOS Image Sensor Architecture

Multimodal In-Sensor Computing Implemented by Easily-Fabricated Oxide-Heterojunction Optoelectronic Synapses

Hybrid Dual-Complementary Metal-Oxide-semiconductor/memristor Synapse-Based Neural Network with Its Applications in Image Super-Resolution

Toward High Performance, Programmable Extreme-Edge Intelligence for Neuromorphic Vision Sensors utilizing Magnetic Domain Wall Motion-based MTJ

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

A Three-Dimensional Neuromorphic Photosensor Array for Nonvolatile In-Sensor Computing

Processing Near Sensor Architecture in Mixed-Signal Domain with CMOS Image Sensor of Convolutional-Kernel-Readout Method

An Analog-Memoryless Near Sensor Computing Architecture for Always-On Intelligent Perception Applications

Ultra-low Power In-Sensor Neuronal Computing with Oscillatory Retinal Neurons for Frequency-Multiplexed, Parallel Machine Vision

Ultralow Power In-Sensor Neuronal Computing with Oscillatory Retinal Neurons for Frequency-Multiplexed, Parallel Machine Vision

In‐Sensor Computing‐Based Smart Sensing Architecture Implemented Using a Dual‐Gate Metal‐Oxide Thin‐Film Transistor Technology

Advances in Neuromorphic Computing: Expanding Horizons for AI Development through Novel Artificial Neurons and In-Sensor Computing

Computing Resistance-Style Image Sensors for Artificial Neural Networks

Neuroscience-inspired Information-Integration System Based on Stochastic Magnetic Tunnel Junctions

Magnetic Tunnel Junction Based Long-Term Short-Term Stochastic Synapse for a Spiking Neural Network with On-Chip STDP Learning

Neuromorphic Hebbian learning with magnetic tunnel junction synapses

In-Sensor Computing Realization Using Fully CMOS-Compatible TiN/HfO x -Based Neuristor Array

Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction

Physical Reservoir Computing and Deep Neural Networks Using Artificial and Natural Noncollinear Spin Textures

6.9 A 0.35V 0.367TOPS/W Image Sensor with 3-Layer Optical-Electronic Hybrid Convolutional Neural Network