A Future Perspective on In-Sensor Computing

Wen Pan,Jiyuan Zheng,Lai Wang,Yi Luo

DOI: https://doi.org/10.1016/j.eng.2022.01.009

IF: 12.834

2022-01-01

Engineering

Abstract:The use of artificial intelligence (AI) is escalating rapidly in most applications nowadays, thanks to breakthroughs in biology and mathematics. Novel hardware systems are greatly needed to meet the requirements of AI, which include computing capacity and energy efficiency.

What problem does this paper attempt to address?

Breaking the Energy-Efficiency Barriers for Smart Sensing Applications with “sensing with Computing” Architectures

Xinghua Yang,Zheyu Liu,Kechao Tang,Xunzhao Yin,Cheng Zhuo,Qi Wei,Fei Qiao

DOI: https://doi.org/10.1007/s11432-023-3760-8

2023-01-01

Science China Information Sciences

Abstract:With the developing technologies of artificial intelligence and the Internet of Things, intelligent IoT (iIoT) is prevailing currently. Design and implementation of integrated IoT nodes with continuous perception capability are indispensable to realize various smart terminal devices, which would also be vital to reduce the power consumption, improve the real-time performance, and enhance the security/privacy of the IoT system. In this paper, we present the architecture of “Sensing with Computing” and its chip design for smart sensing applications, which would support multi-modal perception signal processing with multi-dimension extension ability. Specially, we explore the analog/mixed-signal circuit designs and algorithm-hardware co-design methodologies for perception signal processing, and we also study the multi-modal integration of novel sensors and their interface technologies. Additionally, some multi-modal smart sensing systems with “Sensing + Computing in Memory” mixed-signal chips would be fabricated, which would support typical always-on smart sensing tasks.
Efficient Intelligence with Applications in Embedded Sensing

Xingxing Zuo,Yong Liu

DOI: https://doi.org/10.3390/s23104816

2023-01-01

Abstract:Despite the fact that computational technology continues to rapidly develop, edge devices and embedded systems are still limited in terms of their computation resources due to such factors as power consumption, physical size constraints, and manufacturing cost [...].
Senputing: An Ultra-Low-Power Always-On Vision Perception Chip Featuring the Deep Fusion of Sensing and Computing

Han Xu,Ningchao Lin,Li Luo,Qi Wei,Runsheng Wang,Cheng Zhuo,Xunzhao Yin,Fei Qiao,Huazhong Yang

DOI: https://doi.org/10.1109/TCSI.2021.3090668

2022-01-01

Abstract:Always-on intelligent visual perception applications are widely deployed in edges in the AIoT era. In order to eliminate power costs of data conversion and transmission, this paper proposes Senputing, an ultra-low-power processing-in-sensor chip that completely fuses sensing and computing together for a BNN-based hierarchical processing system. This chip could operate in two modes. In computation ...
Recent Advances in Artificial Intelligence Sensors

Zixuan Zhang,Luwei Wang,Chengkuo Lee

DOI: https://doi.org/10.1002/adsr.202200072

2023-04-09

Advanced Sensor Research

Abstract:Significant growth in the development of artificial intelligence (AI) is being witnessed. Advanced AI sensors can detect multidimensional information and human‐brain‐like computation device for data processing. This review introduces the trend of advanced AI sensors for both edge computing and cloud computing, which will show great potential in the applications of smart buildings, individual healthcare, the Internet of things, etc. Significant growth in the development and deployment of artificial intelligence (AI) is being witnessed. Driven by the great versatility of emerging computer science and material science, various AI sensors provide cost‐effective approaches for a wide range of monitoring applications toward the realization of smart homes and personal healthcare. Advanced AI sensors have multiple sensors capable of detecting multidimensional information and human‐brain‐like computation device for data processing. Herein, this review outlines the recent advances in the development of AI sensors. This review first introduces the materials, fabrication methods, and algorithms of current AI sensors and their applications, i.e., complementary metal oxide semiconductor image sensors for computer vision, microelectromechanical systems, microphone sensors for voice recognition, and wearable sensors for gesture recognition. Then, the recent advances in AI wearables sensors and self‐powered sensor systems are highlighted. Next, the current developments of neuromorphic computing systems, multimodality, and digital twins are reviewed. Last, a perspective on future directions for further research development is also provided. In summary, the trend of advanced AI sensors is the complementary between edge computing and cloud computing, which will show great potential in the applications of smart buildings, individual healthcare, the Internet of things, etc.

English Else
Artificial intelligence-based spatio-temporal vision sensors: applications and prospects

Zhixue Li,Hongwei Sun

DOI: https://doi.org/10.3389/fmats.2023.1269992

2023-12-07

Frontiers in Materials

Abstract:Introduction: Advances in machine vision and mobile electronics will be accelerated by the creation of sophisticated optoelectronic vision sensors that allow for sophisticated picture recognition of visual information and data pre-processing. Several new types of vision sensors have been devised in the last decade to solve these drawbacks, one of which is neuromorphic vision sensors, which have exciting qualities such as high temporal resolution, broad dynamic range, and low energy consumption. Neuromorphic sensors are inspired by the working principles of biological sensory neurons and would be useful in telemedicine, health surveillance, security monitoring, automatic driving, intelligent robots, and other applications of the Internet of Things. Methods: This paper provides a comprehensive review of various state-of-the-art AI vision sensors and frameworks. Results: The fundamental signal processing techniques deployed and the associated challenges were discussed. Discussion: Finally, the role of vision sensors in computer vision is also discussed.

materials science, multidisciplinary
Near-sensor and in-sensor computing

Feichi Zhou,Yang Chai

DOI: https://doi.org/10.1038/s41928-020-00501-9

IF: 33.255

2020-11-01

Nature Electronics

Abstract:Nature Electronics, Published online: 17 November 2020; <a href="https://www.nature.com/articles/s41928-020-00501-9">doi:10.1038/s41928-020-00501-9</a>This Perspective examines the concept of near-senor and in-sensor computing in which computation tasks are moved partly to the sensory terminals, exploring the challenges facing the field and providing possible solutions for the hardware implementation of integrated sensing and processing units using advanced manufacturing technologies.

engineering, electrical & electronic
In-sensor computing for machine vision

Yang Chai

DOI: https://doi.org/10.1038/d41586-020-00592-6

IF: 64.8

2020-03-04

Nature

Abstract:Sight is one of our most vital senses. Biologically inspired machine vision has developed rapidly in the past decade, to the point that artificial systems can 'see' in the sense of gaining valuable information from images and videos<a href="#ref-CR1">1</a>,<a href="#ref-CR2">2</a>, although human vision remains much more efficient. <a href="https://www.nature.com/articles/s41586-020-2038-x">Writing in Nature</a>, Mennel et al.<a href="#ref-CR3">3</a> report a design for a visual system that, rather like the brain, can be trained to classify simple images in nanoseconds.

multidisciplinary sciences
Towards Energy-Efficient Systems for Artificial Intelligence in the Future

Yu Wang

DOI: https://doi.org/10.1109/iccicc50026.2020.9450224

2020-01-01

Abstract:Cognitive Robotics & Machine Learning powered by Artificial Intelligence (AI) are now playing significant roles in various domains. The rapid development of AI is propelled by three crucial components: large-scale data, AI algorithms, and computation circuits and systems. The circuits and systems provide fundamental computation capability for analyzing data and executing algorithms. Specific and heterogeneous circuits and systems are propping up current AI computation capability. However, with the volume of data becoming larger and larger, and the slowing down of Moore's Law, currently circuits and systems for AI is now facing great challenges in the future. From the data perspective, large-scale data are organized using sparse structures including graphs, networks, time series, and spiking signals. However, nowadays circuits and systems are highly structured, which are far away from analyzing and handling large-scale sparse data efficiently. From the algorithm perspective, collaborative intelligence becomes a promising way to surpassing the computation capability limitation of a single node, while currently the performance of collaborative intelligence algorithms is constrained by limited communication resources, complex data dependency, and lacking automation tools.To overcome these problems and provide energy-efficient circuits and systems to propel future AI, the structured sparse design and collaborative perception/decision methods will be introduced. The hardware-software co-design idea is introduced in the structured sparse design to map and process unstructured sparse data on current structured circuits and systems efficiently. While the variable center framework is adopted in the collaborative intelligence systems to realize collaborative perception/decision by multiple agents. All these designs will propel the development of AI in various domains in the future, including autonomous driving, recommendation systems, and etc.
Recent Progress in Wearable Near-Sensor and In-Sensor Intelligent Perception Systems

Jialin Liu,Yitao Wang,Yiwei Liu,Yuanzhao Wu,Baoru Bian,Jie Shang,Runwei Li

DOI: https://doi.org/10.3390/s24072180

2024-03-28

Abstract:As the Internet of Things (IoT) becomes more widespread, wearable smart systems will begin to be used in a variety of applications in people's daily lives, not only requiring the devices to have excellent flexibility and biocompatibility, but also taking into account redundant data and communication delays due to the use of a large number of sensors. Fortunately, the emerging paradigms of near-sensor and in-sensor computing, together with the proposal of flexible neuromorphic devices, provides a viable solution for the application of intelligent low-power wearable devices. Therefore, wearable smart systems based on new computing paradigms are of great research value. This review discusses the research status of a flexible five-sense sensing system based on near-sensor and in-sensor architectures, considering material design, structural design and circuit design. Furthermore, we summarize challenging problems that need to be solved and provide an outlook on the potential applications of intelligent wearable devices.
Advances in Neuromorphic Computing: Expanding Horizons for AI Development through Novel Artificial Neurons and In-Sensor Computing

Yubo Yang,Jizhe Zhao,Yinjie Liu,Xiayang Hua,Tianrui Wang,Jiyuan Zheng,Zhibiao Hao,Bing Xiong,Changzheng Sun,Yanjun Han,Jian Wang,Hongtao Li,Lai Wang,Yi Luo

DOI: https://doi.org/10.1088/1674-1056/ad1c58

2024-01-10

Chinese Physics B

Abstract:AI development has brought great success to upgrading the information age. At the same time, the large-scale Artificial Neural Network for building AI systems is thirsty for computing power, which is barely satisfied by the conventional computing hardware. In the post-Moore era, the increase in computing power brought about by the size reduction of CMOS in very large-scale integrated circuits (VLSIC) is challenging to meet the growing demand for AI computing power. To address the issue, technical approaches like neuromorphic computing attract great attention because of their feature of breaking Von-Neumann architecture, and dealing with AI algorithms much more parallelly and energy efficiently. Inspired by the human neural network architecture, neuromorphic computing hardware is brought to life based on novel artificial neurons constructed by new materials or devices. Although it is relatively difficult to deploy a training process in the neuromorphic architecture like spiking neural network (SNN), the development in this field has incubated promising technologies like in-sensor computing, which brings new opportunities for multidisciplinary research, including the field of optoelectronic materials and devices, artificial neural networks, and microelectronics integration technology. The vision chips based on the architectures could reduce unnecessary data transfer and realize fast and energy-efficient visual cognitive processing. This paper reviews firstly the architectures and algorithms of SNN, and artificial neuron devices supporting neuromorphic computing, then the recent progress of in-sensor computing vision chips, which all will promote the development of AI.

physics, multidisciplinary
Artificial intelligence biosensors: Challenges and prospects

Xiaofeng Jin,Conghui Liu,Tailin Xu,Lei Su,Xueji Zhang

DOI: https://doi.org/10.1016/j.bios.2020.112412

IF: 12.545

2020-10-01

Biosensors and Bioelectronics

Abstract:Artificial intelligence (AI) and wearable sensors are two essential fields to realize the goal of tailoring the best precision medicine treatment for individual patients. Integration of these two fields enables better acquisition of patient data and improved design of wearable sensors for monitoring the wearers' health, fitness and their surroundings. Currently, as the Internet of Things (IoT), big data and big health move from concept to implementation, AI-biosensors with appropriate technical characteristics are facing new opportunities and challenges. In this paper, the most advanced progress made in the key phases for future wearable and implantable technology from biosensing, wearable biosensing to AI-biosensing is summarized. Without a doubt, material innovation, biorecognition element, signal acquisition and transportation, data processing and intelligence decision system are the most important parts, which are the main focus of the discussion. The challenges and opportunities of AI-biosensors moving forward toward future medicine devices are also discussed.

biotechnology & applied microbiology,biophysics,chemistry, analytical,electrochemistry,nanoscience & nanotechnology
Artificial Intelligence Meets Flexible Sensors: Emerging Smart Flexible Sensing Systems Driven by Machine Learning and Artificial Synapses

Tianming Sun,Bin Feng,Jinpeng Huo,Yu Xiao,Wengan Wang,Jin Peng,Zehua Li,Chengjie Du,Wenxian Wang,Guisheng Zou,Lei Liu

DOI: https://doi.org/10.1007/s40820-023-01235-x

IF: 26.6

2023-11-13

Nano-Micro Letters

Abstract:Abstract The recent wave of the artificial intelligence (AI) revolution has aroused unprecedented interest in the intelligentialize of human society. As an essential component that bridges the physical world and digital signals, flexible sensors are evolving from a single sensing element to a smarter system, which is capable of highly efficient acquisition, analysis, and even perception of vast, multifaceted data. While challenging from a manual perspective, the development of intelligent flexible sensing has been remarkably facilitated owing to the rapid advances of brain-inspired AI innovations from both the algorithm (machine learning) and the framework (artificial synapses) level. This review presents the recent progress of the emerging AI-driven, intelligent flexible sensing systems. The basic concept of machine learning and artificial synapses are introduced. The new enabling features induced by the fusion of AI and flexible sensing are comprehensively reviewed, which significantly advances the applications such as flexible sensory systems, soft/humanoid robotics, and human activity monitoring. As two of the most profound innovations in the twenty-first century, the deep incorporation of flexible sensing and AI technology holds tremendous potential for creating a smarter world for human beings.

materials science, multidisciplinary,physics, applied,nanoscience & nanotechnology
Progress in self-powered sensors—Moving toward artificial intelligent and neuromorphic system

Feng Wen,Chan Wang,Chengkuo Lee

DOI: https://doi.org/10.1007/s12274-023-5879-4

IF: 9.9

2023-07-29

Nano Research

Abstract:Wearable and flexible electronics are shaping our life with their unique advantages of light weight, good compliance, and desirable comfortability. With marching into the era of Internet of Things (IoT), numerous sensor nodes are distributed throughout networks to capture, process, and transmit diverse sensory information, which gives rise to the demand on self-powered sensors to reduce the power consumption. Meanwhile, the rapid development of artificial intelligence (AI) and fifth-generation (5G) technologies provides an opportunity to enable smart-decision making and instantaneous data transmission in IoT systems. Due to continuously increased sensor and dataset number, conventional computing based on von Neumann architecture cannot meet the needs of brain-like high-efficient sensing and computing applications anymore. Neuromorphic electronics, drawing inspiration from the human brain, provide an alternative approach for efficient and low-power-consumption information processing. Hence, this review presents the general technology roadmap of self-powered sensors with detail discussion on their diversified applications in healthcare, human machine interactions, smart homes, etc. Via leveraging AI and virtual reality/augmented reality (VR/AR) techniques, the development of single sensors to intelligent integrated systems is reviewed in terms of step-by-step system integration and algorithm improvement. In order to realize efficient sensing and computing, brain-inspired neuromorphic electronics are next briefly discussed. Last, it concludes and highlights both challenges and opportunities from the aspects of materials, minimization, integration, multimodal information fusion, and artificial sensory system.

materials science, multidisciplinary,chemistry, physical,physics, applied,nanoscience & nanotechnology
Artificial Intelligence-Based Sensors for Next Generation IoT Applications: A Review

Subhas Chandra Mukhopadhyay,Sumarga Kumar Sah Tyagi,Nagender Kumar Suryadevara,Vincenzo Piuri,Fabio Scotti,Sherali Zeadally

DOI: https://doi.org/10.1109/jsen.2021.3055618

IF: 4.3

2021-11-15

IEEE Sensors Journal

Abstract:Sensors play a vital role in our daily lives and are an essential component for Internet of Things (IoT) based systems as they enable the IoT to collect data to take smart and intelligent decisions. Recent advances in IoT systems, applications, and technologies, including industrial Cyber-Physical Systems (CPSs), are being supported by a wide range of different types of sensors based on artificial intelligence (AI). These smart AI-based sensors are typically characterized by onboard intelligence and have the ability to communicate collaboratively or through the Internet. To achieve the high level of automation required in today's smart IoT applications, sensors incorporated into nodes must be efficient, intelligent, context-aware, reliable, accurate, and connected. Such sensors must also be robust, safety- and privacy-aware for users interacting with them. Sensors leveraging advanced AI technologies, new capabilities have recently emerged which have the potential to detect, identify, and avoid performance degradation and discover new patterns. Along with knowledge from complex sensor datasets, they can promote product innovation, improve operation level, and open up novel business models. We review sensors, smart data processing, communication protocol, and artificial intelligence which will enable the deployment of AI-based sensors for next-generation IoT applications.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
(Keynote) Artificial Intelligence Biosensors: Challenges and Prospects

Tailin Xu,Xueji Zhang

DOI: https://doi.org/10.1149/ma2021-01551385mtgabs

2021-05-30

ECS Meeting Abstracts

Abstract:Artificial intelligence (AI) and wearable sensors are two fields that are instrumental in realizing the goal of precision medicine—tailoring the best treatment for individual patients. Recent development between these two fields is enabling better patient data acquisition and improved design of wearable sensors for monitoring the wearers’ health, fitness, and their surroundings. The growing field of wearable sensors aims to tackle the limitations of centralized, reactive healthcare by giving individuals insight into the metrics of their own physiology. However, assessing the effectiveness of a therapeutic platforms on disease is extremely complex, due to the massive quantities of data generated by biomedical devices. Integration of AI approaches can bridge this gap, using pattern analysis and classification algorithms for improvement of diagnostic and therapeutic accuracy. The future AI-biosensors (AI wearable sweat biosensor, AI- eatable biosensor, AI-glass biosensor, AI-implantable biosensor et al.) mainly have the function of AI-diagnosis (Diagnostic algorithms in the microprocessor can verify the output of the sensor and present the diagnostic information), Big data processing (Use of self-contained space for historical data and various necessary parameters of data storage to greatly improve the performance of the controller.) and Self-learning/adaptive (Embedded microprocessor with advanced programming function. In the working process, the AI-biosensor can reconstruct the structure and parameters according to certain behavioral criteria, and has adaptive functions)
Reducing the Energy Cost of Inference via In-sensor Information Processing

Sai Zhang,Mingu Kang,Charbel Sakr,Naresh Shanbhag

DOI: https://doi.org/10.48550/arXiv.1607.00667

2016-07-04

Abstract:There is much interest in incorporating inference capabilities into sensor-rich embedded platforms such as autonomous vehicles, wearables, and others. A central problem in the design of such systems is the need to extract information locally from sensed data on a severely limited energy budget. This necessitates the design of energy-efficient sensory embedded system. A typical sensory embedded system enforces a physical separation between sensing and computational subsystems - a separation mandated by the differing requirements of the sensing and computational functions. As a consequence, the energy consumption in such systems tends to be dominated by the energy consumed in transferring data over the sensor-processor interface (communication energy) and the energy consumed in processing the data in digital processor (computational energy). In this article, we propose an in-sensor computing architecture which (mostly) eliminates the sensor-processor interface by embedding inference computations in the noisy sensor fabric in analog and retraining the hyperparameters in order to compensate for non-ideal computations. The resulting architecture referred to as the Compute Sensor - a sensor that computes in addition to sensing - represents a radical departure from the conventional. We show that a Compute Sensor for image data can be designed by embedding both feature extraction and classification functions in the analog domain in close proximity to the CMOS active pixel sensor (APS) array. Significant gains in energy-efficiency are demonstrated using behavioral and energy models in a commercial semiconductor process technology. In the process, the Compute Sensor creates a unique opportunity to develop machine learning algorithms for information extraction from data on a noisy underlying computational fabric.

Hardware Architecture,Emerging Technologies
Artificial intelligence enhanced sensors - enabling technologies to next-generation healthcare and biomedical platform

Chan Wang,Tianyiyi He,Hong Zhou,Zixuan Zhang,Chengkuo Lee

DOI: https://doi.org/10.1186/s42234-023-00118-1

2023-08-03

Bioelectronic Medicine

Abstract:The fourth industrial revolution has led to the development and application of health monitoring sensors that are characterized by digitalization and intelligence. These sensors have extensive applications in medical care, personal health management, elderly care, sports, and other fields, providing people with more convenient and real-time health services. However, these sensors face limitations such as noise and drift, difficulty in extracting useful information from large amounts of data, and lack of feedback or control signals. The development of artificial intelligence has provided powerful tools and algorithms for data processing and analysis, enabling intelligent health monitoring, and achieving high-precision predictions and decisions. By integrating the Internet of Things, artificial intelligence, and health monitoring sensors, it becomes possible to realize a closed-loop system with the functions of real-time monitoring, data collection, online analysis, diagnosis, and treatment recommendations. This review focuses on the development of healthcare artificial sensors enhanced by intelligent technologies from the aspects of materials, device structure, system integration, and application scenarios. Specifically, this review first introduces the great advances in wearable sensors for monitoring respiration rate, heart rate, pulse, sweat, and tears; implantable sensors for cardiovascular care, nerve signal acquisition, and neurotransmitter monitoring; soft wearable electronics for precise therapy. Then, the recent advances in volatile organic compound detection are highlighted. Next, the current developments of human-machine interfaces, AI-enhanced multimode sensors, and AI-enhanced self-sustainable systems are reviewed. Last, a perspective on future directions for further research development is also provided. In summary, the fusion of artificial intelligence and artificial sensors will provide more intelligent, convenient, and secure services for next-generation healthcare and biomedical applications.

English Else
Artificial intelligence-powered electrochemical sensor: Recent advances, challenges, and prospects

Siti Nur Ashakirin Binti Mohd Nashruddin,Faridah Hani Mohamed Salleh,Rozan Mohamad Yunus,Halimah Badioze Zaman

DOI: https://doi.org/10.1016/j.heliyon.2024.e37964

IF: 3.776

2024-09-14

Heliyon

Abstract:Integrating artificial intelligence (AI) with electrochemical biosensors is revolutionizing medical treatments by enhancing patient data collection and enabling the development of advanced wearable sensors for health, fitness, and environmental monitoring. Electrochemical biosensors, which detect biomarkers through electrochemical processes, are significantly more effective. The integration of artificial intelligence is adept at identifying, categorizing, characterizing, and projecting intricate data patterns. As the Internet of Things (IoT), big data, and big health technologies move from theory to practice, AI-powered biosensors offer significant opportunities for real-time disease detection and personalized healthcare. Still, they also pose challenges such as data privacy, sensor stability, and algorithmic bias. This paper highlights the critical advances in material innovation, biorecognition elements, signal transduction, data processing, and intelligent decision systems necessary for developing next-generation wearable and implantable devices. Despite existing limitations, the integration of AI into biosensor systems shows immense promise for creating future medical devices that can provide early detection and improved patient outcomes, marking a transformative step forward in healthcare technology.
Optoelectronic Devices for In-Sensor Computing

Qinqi Ren,Chaoyi Zhu,Sijie Ma,Zhaoqing Wang,Jianmin Yan,Tianqing Wan,Weicheng Yan,Yang Chai

DOI: https://doi.org/10.1002/adma.202407476

2024-07-14

Abstract:The demand for accurate perception of the physical world leads to a dramatic increase in sensory nodes. However, the transmission of massive and unstructured sensory data from sensors to computing units poses great challenges in terms of power-efficiency, transmission bandwidth, data storage, time latency, and security. To efficiently process massive sensory data, it is crucial to achieve data compression and structuring at the sensory terminals. In-sensor computing integrates perception, memory, and processing functions within sensors, enabling sensory terminals to perform data compression and data structuring. Here, vision sensors are adopted as an example and discuss the functions of electronic, optical, and optoelectronic hardware for visual processing. Particularly, hardware implementations of optoelectronic devices for in-sensor visual processing that can compress and structure multidimensional vision information are examined. The underlying resistive switching mechanisms of volatile/nonvolatile optoelectronic devices and their processing operations are explored. Finally, a perspective on the future development of optoelectronic devices for in-sensor computing is provided.
Recent advances in in-sensor computational vision sensors: from mechanisms to applications

Hang Xu,Leixin Meng,Yiyu Guo,Wenhao Tang,Liangliang Huang,Tiantian Dai,Xu Liu,Qing Yang

DOI: https://doi.org/10.1088/1361-6463/ad32ec

2024-03-13

Journal of Physics D Applied Physics

Abstract:The number of vision sensors continues to increase with the rapid development of intelligent systems. The effective transmitting and processing of the sensing data become difficult due to the sensing, computing and memory units being physically separated. In-sensor computing architecture inspired by biological visual systems with efficient information processing has attracted increasing attention for overcoming these performance limitations. Bipolar cells in the retina can generate ON/OFF information processing channels to amplify marginal information. The synaptic structure is plastic and can enhance the output information that is repeated many times. In recent years, numerous new material and device strategies to implement in-sensor computing by mimicking the functions of bipolar cells and synapses have been reported: ON/OFF optical responses have been realized on two-dimensional materials by gate voltage regulation; synaptic responses, such as short-term plasticity and long-term plasticity, have been realized by ionic state transition and carrier regulating. In this review, we will summarize the biological vision processes, analyse the physical mechanisms behind the in-sensor computational vision sensors (ICVSs), and then overview the emerging physical artificial neural networks implemented with ICVSs. After that, we will discuss ICVS design based on biological mechanisms beyond ionic state transition and carrier regulating.

physics, applied

A Future Perspective on In-Sensor Computing

Breaking the Energy-Efficiency Barriers for Smart Sensing Applications with “sensing with Computing” Architectures

Efficient Intelligence with Applications in Embedded Sensing

Senputing: An Ultra-Low-Power Always-On Vision Perception Chip Featuring the Deep Fusion of Sensing and Computing

Recent Advances in Artificial Intelligence Sensors

Artificial intelligence-based spatio-temporal vision sensors: applications and prospects

Near-sensor and in-sensor computing

In-sensor computing for machine vision

Towards Energy-Efficient Systems for Artificial Intelligence in the Future

Recent Progress in Wearable Near-Sensor and In-Sensor Intelligent Perception Systems

Advances in Neuromorphic Computing: Expanding Horizons for AI Development through Novel Artificial Neurons and In-Sensor Computing

Artificial intelligence biosensors: Challenges and prospects

Artificial Intelligence Meets Flexible Sensors: Emerging Smart Flexible Sensing Systems Driven by Machine Learning and Artificial Synapses

Progress in self-powered sensors—Moving toward artificial intelligent and neuromorphic system

Artificial Intelligence-Based Sensors for Next Generation IoT Applications: A Review

(Keynote) Artificial Intelligence Biosensors: Challenges and Prospects

Reducing the Energy Cost of Inference via In-sensor Information Processing

Artificial intelligence enhanced sensors - enabling technologies to next-generation healthcare and biomedical platform

Artificial intelligence-powered electrochemical sensor: Recent advances, challenges, and prospects

Optoelectronic Devices for In-Sensor Computing

Recent advances in in-sensor computational vision sensors: from mechanisms to applications