General Optoelectronic Computing Based On Scalable Photonic Neuromorphic System

Rui Wang,Quansheng Ren,Jianye Zhao

DOI: https://doi.org/10.1364/CLEO_AT.2016.JTu5A.73

2016-01-01

Abstract:We propose a general optoelectronic computing architecture based on scalable photonic neuromorphic system. It employs the fundamentals of the Neural Engineering Framework (NEF) principles to implement numerical operations in optical spiking networks.

What problem does this paper attempt to address?

Optoelectronic Neuromorphic System Using the Neural Engineering Framework

Rui Wang,Cheng Qian,Quansheng Ren,Jianye Zhao

DOI: https://doi.org/10.1364/ao.56.001517

IF: 1.9

2017-01-01

Applied Optics

Abstract:There has been a recent explosion of interest in neuromorphic computing capable of processing sophisticated and large-scale information based on spike coding, which has advantages in the implementation on electronic or optical neuromorphic systems. The neural engineering framework (NEF), a formal method for mapping attractor networks and control-theoretic algorithms to spiking neural networks, provides us a way to implement neuromorphic or numerical computing. In this paper, we implement the NEF on an optoelectronic architecture based on a photonic neuromorphic system. We discuss how electronic signals can be encoded to patterns of optical pulses, processed in the dynamic neural activity of recurrent network, and finally decoded back to the desired signals. These methods take advantage of the mechanism of spiking laser neurons and the wavelength division multiplexing protocol and explore the rapidity of optical pulses. Our work is mainly simulation with qualitative analysis. Simulation studies demonstrate three NEF principles on the proposed architecture with signals on nanosecond time scale, which run about six orders of magnitude faster than electronic counterparts on the NEF implementation. The present architecture can be also used in a broad domain of applications where more complex neuromorphic or numerical computing is necessary.
Research Progress on Photonic Neuromorphic Computing

Wang Rui,Ren Quansheng,Zhao Jianye

DOI: https://doi.org/10.3788/lop53.120004

2016-01-01

Abstract:Photonic neuromorphic system can simulate the neuromorphic algorithms with a speed of millions or billions multiples faster than the biological counterpart,which is better than electronics neuromorphic hardware system.It can be also capable of processing computing tasks more sophisticated than traditional optical computations.The photonic neuromorphic computing,exploring the adaptability,robustness and rapidity of ultrafast optical pulses,can overcome the scaling of digital optical computation and the noise accumulation of analog optical computation.The research progress on photonic neuromorphic computing is reported.Some essential theories and technologies,including photonic neuron,learning algorithms based on optical spiking pulses and the integrated photonic neuromorphic network framework,are introduced respectively.The necessity of research on photonic neuromorphic computing and its problems are discussed to present its potential applications in future.
Massively scalable wavelength diverse integrated photonic linear neuron

Matthew van Niekerk,Anthony Rizzo,Hector Rubio,Gerald Leake,Daniel Coleman,Christopher Tison,Michael L Fanto,K Bergman,Stefan Preble

DOI: https://doi.org/10.1088/2634-4386/ac8ecc

2022-09-03

Neuromorphic Computing and Engineering

Abstract:As computing resource demands continue to escalate in the face of big data, cloud-connectivity and the internet of things, it has become imperative to develop new low-power, scalable architectures. Neuromorphic photonics, or photonic neural networks, have become a feasible solution for the physical implementation of efficient algorithms directly on-chip. This application is primarily due to the linear nature of light and the scalability of silicon photonics, specifically leveraging the wide-scale complementary metal-oxide-semiconductor (CMOS) manufacturing infrastructure used to fabricate microelectronics chips. Current neuromorphic photonic implementations stem from two paradigms: wavelength coherent and incoherent. Here, we introduce a novel architecture that supports coherent and incoherent operation to increase the capability and capacity of photonic neural networks with a dramatic reduction in footprint compared to previous demonstrations. As a proof-of-principle, we experimentally demonstrate simple addition and subtraction operations on a foundry-fabricated silicon photonic chip. Additionally, we experimentally validate an on-chip network to predict the logical 2-bit gates AND, OR, and XOR to accuracies of 96.8%,99%, and 98.5%, respectively. This architecture is compatible with highly wavelength parallel sources, enabling massively scalable photonic neural networks.
Semiconductor Lasers for Photonic Neuromorphic Computing and Photonic Spiking Neural Networks: A Perspective

Shuiying Xiang,Yanan Han,Shuang Gao,Ziwei Song,Yahui Zhang,Dianzhuang Zheng,Chengyang Yu,Xingxing Guo,Xintao Zeng,Zhiquan Huang,Yue Hao

DOI: https://doi.org/10.1063/5.0217968

IF: 5.6

2024-01-01

APL Photonics

Abstract:Photonic neuromorphic computing has emerged as a promising avenue toward building a high-speed, low-latency, and energy-efficient non-von-Neumann computing system. Photonic spiking neural network (PSNN) exploits brain-like spatiotemporal processing to realize high-performance neuromorphic computing. Linear weighting and nonlinear spiking activation are two fundamental functions of a SNN. However, the nonlinear computation of PSNN remains a significant challenge. Therefore, this perspective focuses on the nonlinear computation of photonic spiking neurons, including numerical simulation, device fabrication, and experimental demonstration. Different photonic spiking neurons are considered, such as vertical-cavity surface-emitting lasers, distributed feedback (DFB) lasers, Fabry–Pérot (FP) lasers, or semiconductor lasers embedded with saturable absorbers (SAs) (e.g., FP-SA and DFB-SA). PSNN architectures, including fully connected and convolutional structures, are developed, and supervised and unsupervised learning algorithms that take into account optical constraints are introduced to accomplish specific applications. This work covers devices, architectures, learning algorithms, and applications for photonic and optoelectronic neuromorphic computing and provides our perspective on the challenges and prospects of photonic neuromorphic computing based on semiconductor lasers.
Photonics for Neuromorphic Computing: Fundamentals, Devices, and Opportunities

Renjie Li,Yuanhao Gong,Hai Huang,Yuze Zhou,Sixuan Mao,Zhijian Wei,Zhaoyu Zhang

DOI: https://doi.org/10.1002/adma.202312825

2024-07-02

Abstract:In the dynamic landscape of Artificial Intelligence (AI), two notable phenomena are becoming predominant: the exponential growth of large AI model sizes and the explosion of massive amount of data. Meanwhile, scientific research such as quantum computing and protein synthesis increasingly demand higher computing capacities. Neuromorphic computing, inspired by the mechanism and functionality of human brains, uses physical artificial neurons to do computations and is drawing widespread attention. Conventional electronic computing has experienced certain difficulties, particularly concerning the latency, crosstalk, and energy consumption of digital processors. As the Moore's law approaches its terminus, there is a urgent need for alternative computing architectures that can satisfy this growing computing demand and break through the von Neumann model. Recently, the expansion of optoelectronic devices on photonic integration platforms has led to significant growth in photonic computing, where photonic integrated circuits (PICs) have enabled ultrafast artificial neural networks (ANN) with sub-nanosecond latencies, low heat dissipation, and high parallelism. Such non-von Neumann photonic computing systems hold the promise to cater to the escalating requirements of AI and scientific computing. In this review, we study recent advancements in integrated photonic neuromorphic systems, and from the perspective of materials and device engineering, we lay out the scientific and technological breakthroughs necessary to advance the state-of-the-art. In particular, we examine various technologies and devices employed in neuromorphic photonic AI accelerators, spanning from traditional optics to PICs. We evaluate the performances of different designs by energy efficiency in operations per joule (OP/J) and compute density in operations per squared millimeter per ...

Optics,Emerging Technologies
Neuromorphic Photonic Networks

P. Prucnal,S. Bilodeau,L. Chrostowski,Bicky A. Marquez,B. Shastri,S. Shekhar,A. Tait,Chaoran Huang,T. F. D. Lima

DOI: https://doi.org/10.1364/OFC.2021.TH5A.2

2021-06-01

Abstract:Neuromorphic photonics exploit optical device physics for neuron models, and optical interconnects for distributed, parallel, and analog processing for high-bandwidth, low-latency and low switching energy applications in artificial intelligence and neuromorphic computing.

Computer Science,Engineering,Physics
All-optical spiking neurosynaptic networks with self-learning capabilities

J. Feldmann,N. Youngblood,C. D. Wright,H. Bhaskaran,W. H. P. Pernice

DOI: https://doi.org/10.1038/s41586-019-1157-8

IF: 64.8

2019-05-01

Nature

Abstract:Software implementations of brain-inspired computing underlie many important computational tasks, from image processing to speech recognition, artificial intelligence and deep learning applications. Yet, unlike real neural tissue, traditional computing architectures physically separate the core computing functions of memory and processing, making fast, efficient and low-energy computing difficult to achieve. To overcome such limitations, an attractive alternative is to design hardware that mimics neurons and synapses. Such hardware, when connected in networks or neuromorphic systems, processes information in a way more analogous to brains. Here we present an all-optical version of such a neurosynaptic system, capable of supervised and unsupervised learning. We exploit wavelength division multiplexing techniques to implement a scalable circuit architecture for photonic neural networks, successfully demonstrating pattern recognition directly in the optical domain. Such photonic neurosynaptic networks promise access to the high speed and high bandwidth inherent to optical systems, thus enabling the direct processing of optical telecommunication and visual data.

multidisciplinary sciences
Photonic Integrated Neuro-Synaptic Core for Convolutional Spiking Neural Network

Shuiying Xiang,Yuechun Shi,Yahui Zhang,Xingxing Guo,Ling Zheng,Yanan Han,Yuna Zhang,Ziwei Song,Dianzhuang Zheng,Tao Zhang,Hailing Wang,Xiaojun Zhu,Xiangfei Chen,Min Qiu,Yichen Shen,Wanhua Zheng,Yue Hao

2023-06-05

Abstract:Neuromorphic photonic computing has emerged as a competitive computing paradigm to overcome the bottlenecks of the von-Neumann architecture. Linear weighting and nonlinear spiking activation are two fundamental functions of a photonic spiking neural network (PSNN). However, they are separately implemented with different photonic materials and devices, hindering the large-scale integration of PSNN. Here, we propose, fabricate and experimentally demonstrate a photonic neuro-synaptic chip enabling the simultaneous implementation of linear weighting and nonlinear spiking activation based on a distributed feedback (DFB) laser with a saturable absorber (DFB-SA). A prototypical system is experimentally constructed to demonstrate the parallel weighted function and nonlinear spike activation. Furthermore, a four-channel DFB-SA array is fabricated for realizing matrix convolution of a spiking convolutional neural network, achieving a recognition accuracy of 87% for the MNIST dataset. The fabricated neuro-synaptic chip offers a fundamental building block to construct the large-scale integrated PSNN chip.

Optics
On-chip Spiking Neural Networks Based on Add-Drop Ring Microresonators and Electrically Reconfigurable Phase-Change Material Photonic Switches

Qiang Zhang,Ning Jiang,Yiqun Zhang,Anran Li,Huanhuan Xiong,Gang Hu,Yongsheng Cao,Kun Qiu

DOI: https://doi.org/10.1364/prj.507178

IF: 7.6

2024-01-01

Photonics Research

Abstract:We propose and numerically demonstrate a photonic computing primitive designed for integrated spiking neural networks (SNNs) based on add-drop ring microresonators (ADRMRs) and electrically reconfigurable phase-change material (PCM) photonic switches. In this neuromorphic system, the passive silicon-based ADRMR, equipped with a power-tunable auxiliary light, effectively demonstrates nonlinearity-induced dual neural dynamics encompassing spiking response and synaptic plasticity that can generate single-wavelength optical neural spikes with synaptic weight. By cascading these ADRMRs with different resonant wavelengths, weighted multiple-wavelength spikes can be feasibly output from the ADRMR-based hardware arrays when external wavelength-addressable optical pulses are injected; subsequently, the cumulative power of these weighted output spikes is utilized to ascertain the activation status of the reconfigurable PCM photonic switches. Moreover, the reconfigurable mechanism driving the interconversion of the PCMs between the resonant-bonded crystalline states and the covalent-bonded amorphous states is achieved through precise thermal modulation. Drawing from the thermal properties, an innovative thermodynamic leaky integrate-and-firing (TLIF) neuron system is proposed. With the TLIF neuron system as the fundamental unit, a fully connected SNN is constructed to complete a classic deep learning task: the recognition of handwritten digit patterns. The simulation results reveal that the exemplary SNN can effectively recognize 10 numbers directly in the optical domain by employing the surrogate gradient algorithm. The theoretical verification of our architecture paves a whole new path for integrated photonic SNNs, with the potential to advance the field of neuromorphic photonic systems and enable more efficient spiking information processing.
Large-scale photonic computing with nonlinear disordered media

Hao Wang,Jianqi Hu,Andrea Morandi,Alfonso Nardi,Fei Xia,Xuanchen Li,Romolo Savo,Qiang Liu,Rachel Grange,Sylvain Gigan

2023-10-12

Abstract:Neural networks find widespread use in scientific and technological applications, yet their implementations in conventional computers have encountered bottlenecks due to ever-expanding computational needs. Photonic neuromorphic hardware, which manipulates information and represents data continuously in the optical domain, is one of the promising platforms with potential advantages of massive parallelism, ultralow latency, and reduced energy consumption. While linear photonic neural networks are within reach, photonic computing with large-scale optical nonlinear nodes remains largely unexplored. Here, we demonstrate a large-scale, high-performance nonlinear photonic neural system based on a disordered polycrystalline slab composed of lithium niobate nanocrystals. Mediated by random quasi-phase-matching and multiple scattering, linear and nonlinear optical speckle features are generated as the interplay between the simultaneous linear random scattering and the second-harmonic generation, defining a complex neural network in which the second-order nonlinearity acts as internal nonlinear activation functions. Benchmarked against linear random projection, such nonlinear mapping embedded with rich physical computational operations shows improved performance across a large collection of machine learning tasks in image classification, regression, and graph classification with varying complexity. Demonstrating up to 27,648 input and 3,500 nonlinear output nodes, the combination of optical nonlinearity and random scattering serves as a scalable computing engine for diverse applications.

Optics,Emerging Technologies
Considerations for neuromorphic supercomputing in semiconducting and superconducting optoelectronic hardware

Bryce A. Primavera,Jeffrey M. Shainline

DOI: https://doi.org/10.48550/arXiv.2106.14803

2021-06-28

Abstract:Any large-scale spiking neuromorphic system striving for complexity at the level of the human brain and beyond will need to be co-optimized for communication and computation. Such reasoning leads to the proposal for optoelectronic neuromorphic platforms that leverage the complementary properties of optics and electronics. Starting from the conjecture that future large-scale neuromorphic systems will utilize integrated photonics and fiber optics for communication in conjunction with analog electronics for computation, we consider two possible paths towards achieving this vision. The first is a semiconductor platform based on analog CMOS circuits and waveguide-integrated photodiodes. The second is a superconducting approach that utilizes Josephson junctions and waveguide-integrated superconducting single-photon detectors. We discuss available devices, assess scaling potential, and provide a list of key metrics and demonstrations for each platform. Both platforms hold potential, but their development will diverge in important respects. Semiconductor systems benefit from a robust fabrication ecosystem and can build on extensive progress made in purely electronic neuromorphic computing but will require III-V light source integration with electronics at an unprecedented scale, further advances in ultra-low capacitance photodiodes, and success from emerging memory technologies. Superconducting systems place near theoretically minimum burdens on light sources (a tremendous boon to one of the most speculative aspects of either platform) and provide new opportunities for integrated, high-endurance synaptic memory. However, superconducting optoelectronic systems will also contend with interfacing low-voltage electronic circuits to semiconductor light sources, the serial biasing of superconducting devices on an unprecedented scale, a less mature fabrication ecosystem, and cryogenic infrastructure.

Emerging Technologies,Optics
Progress and Prospects of Photonic Neuromorphic Computing(Invited)

Xiang Shuiying,Song Ziwei,Gao Shuang,Han Yanan,Zhang Yahui,Guo Xingaing,Hao Yue

DOI: https://doi.org/10.3788/gzxb20215010.1020001

IF: 0.6

2021-01-01

ACTA PHOTONICA SINICA

Abstract:Brain science and brain-like research have become the strategic frontier of international competition. The rapid development of artifical intelligence and deep learning has put forward an urgent demand for the computing capacities. In the traditional von Neumann architecture, the physical separation between memory and computing units results in power consumption wall and memory wall problems. Besides, Moore's law is gradually slowing down. Photonic neuromorphic computing, which fully combines the characteristics of high-speed optical communication, optical interconnection, optical integration, silicon-based optoelectronics and neuromorphic computing, has the advantages of ultra-high speed, large bandwidth and multi-dimension. It has wide application prospects in the fields of high-performance computing and artificial intelligence. Furthermore, it is a highly competitive solution that breaks through the limits of traditional microelectronics computing in the post-Moore era. This article reviews the work of the main research teams at home and abroad on the theory, algorithms, and devices of photonic neurons, synapses, and neural networks, and puts forward a prospect.
End-to-End Optimization for a Compact Optical Neural Network Based on Nanostructured 2 x 2 Optical Processors

Caiyue Zhao,Jiguang Wang,Simei Mao,Xuanyi Liu,Wai Kin Victor Chan,H. Y. Fu

DOI: https://doi.org/10.1109/JPHOT.2023.3309835

IF: 2.4

2023-01-01

IEEE Photonics Journal

Abstract:Recent research in silicon photonic chips has made huge progress in optical computing owing to their high speed, small footprint, and low energy consumption. Here, we employ nanostructured 2 x 2 optical processors in an optical neural network for implementing a binary classification task efficiently. The proposed optical neural network is composed of five linear layers including ten optical processors in each layer, and nonlinear activation functions. 2 x 2 optical processors are designed based on digitized meta-structures which have an extremely compact footprint of 1.6 x 4 mu m(2). A brand-new end-to-end design strategy based on Deep Q-Network is proposed to optimize the optical neural network for classifying a generated ring data set with better generalization, robustness, and operability. A high-efficient transfer matrix multiplication method is applied to simplify the calculation process in traditional optical software. Our numerical results illustrate that the maximum and mean accuracy on the testing data set can reach 90.5% and 87.8%, respectively. The demonstrated optical processors with a significantly compact area, and the efficient optimization method exhibit high potential for large-scale integration of whole-passive optical neural network on a photonic chip.
Hardware-algorithm collaborative computing with photonic spiking neuron chip based on an integrated Fabry-Perot laser with a saturable absorber

Shuiying Xiang,Yuechun Shi,Xingxing Guo,Yahui Zhang,Hongji Wang,Dianzhuang Zheng,Ziwei Song,Yanan Han,Shuang Gao,Shihao Zhao,Biling Gu,Hailing Wang,Xiaojun Zhu,Lianping Hou,Xiangfei Chen,Wanhua Zheng,Xiaohua Ma,Yue Hao

DOI: https://doi.org/10.1364/OPTICA.468347

IF: 10.4

2023-01-01

Optica

Abstract:Photonic neuromorphic computing has emerged as a promising approach to building a low-latency and energy-efficient non-von Neuman computing system. A photonic spiking neural network (PSNN) exploits brain-like spatiotemporal processing to realize high-performance neuromorphic computing. However, the nonlinear computation of a PSNN remains a significant challenge. Here, we propose and fabricate a photonic spiking neuron chip based on an integrated Fabry-Perot laser with a saturable absorber (FP-SA). The nonlinear neuron-like dynamics including temporal integration, threshold and spike generation, a refractory period, inhibitory behavior and cascadability are experimentally demonstrated, which offers an indispensable fundamental building block to construct the PSNN hardware. Furthermore, we propose time-multiplexed temporal spike encoding to realize a functional PSNN far beyond the hardware integration scale limit. PSNNs with single/cascaded photonic spiking neurons are experimentally demonstrated to realize hardware-algorithm collaborative computing, showing the capability to perform classification tasks with a supervised learning algorithm, which paves the way for a multilayer PSNN that can handle complex tasks. (c) 2023 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
Intelligent neuromorphic computing based on nanophotonics and metamaterials

Qian Ma,Xinxin Gao,Ze Gu,Che Liu,Lianlin Li,Jian Wei You,Tie Jun Cui

DOI: https://doi.org/10.1557/s43579-024-00520-z

2024-02-09

MRS Communications

Abstract:With the rapid development of artificial intelligence and computing chips approaching the bottleneck of power consumption and computing power, the research on intelligent computing hardware with high speed and high energy efficiency is an important trend. Recently, neuromorphic computing represented by photonic circuit neural networks and all-optical diffraction neural networks has attracted widespread attention due to their ultra-fast and ultra-efficient computing architectures. In this perspective, we first review some representative works and introduce them through two main lines of planar photonic circuit neural networks and three-dimensional diffraction neural networks to compare their characteristics and performance. We further discuss programmable designs for neuromorphic computing hardware, which bring it closer to general-purpose computing devices. Besides intelligent neural networks in the optical band, we also review the development and application of the diffractive neural networks in the microwave band, showing their programmable capabilities. Finally, we present the future directions and development trends of intelligent neuromorphic computing and its potential applications in wireless communications, information processing, and sensing.

materials science, multidisciplinary
Optical and Optoelectronic Neuromorphic Devices Based on Emerging Memory Technologies

Jiabin Shen,Zengguang Cheng,Peng Zhou

DOI: https://doi.org/10.1088/1361-6528/ac723f

IF: 3.5

2022-01-01

Nanotechnology

Abstract:As artificial intelligence continues its rapid development, inevitable challenges arise for the mainstream computing hardware to process voluminous data (Big data). The conventional computer system based on von Neumann architecture with separated processor unit and memory is approaching the limit of computational speed and energy efficiency. Thus, novel computing architectures such as in-memory computing and neuromorphic computing based on emerging memory technologies have been proposed. In recent years, light is incorporated into computational devices, beyond the data transmission in traditional optical communications, due to its innate superiority in speed, bandwidth, energy efficiency, etc. Thereinto, photo-assisted and photoelectrical synapses are developed for neuromorphic computing. Additionally, both the storage and readout processes can be implemented in optical domain in some emerging photonic devices to leverage unique properties of photonics. In this review, we introduce typical photonic neuromorphic devices rooted from emerging memory technologies together with corresponding operational mechanisms. In the end, the advantages and limitations of these devices originated from different modulation means are listed and discussed.
Artificial Visual Synaptic Architecture with High-Linearity Light-Modulated Weight for Optoelectronic Neuromorphic Computing

Ying Liu,Biao Wang,Lei Wu,Lulu Huang,Lu Lin,Li Xiang,Dongqing Liu,Shiguo Zhang,Chenguang Zhu,Yijie Tao,Dong Li,Anlian Pan

DOI: https://doi.org/10.1021/acsami.3c11495

2023-10-27

Abstract:A brain-like neuromorphic computing system, as compared with traditional Von Neumann architecture, has broad application prospects in the fields of emerging artificial intelligence (AI) due to its high fault tolerance, excellent plasticity, and parallel computing capability. A neuromorphic visuosensory and memory system, an important branch of neuromorphic computing, is the basis for AI to perceive, process, and memorize optical information, now still suffering from nonlinearity of synaptic weight, crosstalk issues, and integration incompatibility, hindering the high-level training and inference accuracy. In this work, we propose a new optoelectronic neuromorphic architecture by integrating an electrochromic device and a perovskite photodetector. Ascribing to the superior memory characteristics of the electrochromic device and sensitive light response of the perovskite photodetector, the neuromorphic device shows typical visual synaptic functionalities such as light triggering, neural facilitation, long-term potentiation, and depression (LTP and LTD). Furthermore, by adjusting the intensity and wavelength of external light signals, the visual synaptic function of the device can be modulated, enabling the device to exhibit high weight linearity in all current output ranges and improve information processing capability and image recognition accuracy. Moreover, both the electrochromic and perovskite layers possess the advantage of large area fabrication and integration, which enables the fabrication of large device arrays with high integration compatibility and scalability. In this study, 10 × 10 device arrays are demonstrated and each device shows uniform light responses, memory behaviors, and synaptic performances. MNIST and CIFAR-10 algorithms are used to simulate the image recognition properties of the synaptic architecture, and the calculated recognition accuracy is 97.94 and 91.04%, respectively, with an error less than 2.5%. The proposed artificial visual neuromorphic architecture will provide a potential device prototype for efficient visual neuromorphic systems.
Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit

Tiankuang Zhou,Xing Lin,Jiamin Wu,Yitong Chen,Hao Xie,Yipeng Li,Jingtao Fan,Huaqiang Wu,Lu Fang,Qionghai Dai

DOI: https://doi.org/10.1038/s41566-021-00796-w

IF: 35

2021-04-12

Nature Photonics

Abstract:There is an ever-growing demand for artificial intelligence. Optical processors, which compute with photons instead of electrons, can fundamentally accelerate the development of artificial intelligence by offering substantially improved computing performance. There has been long-term interest in optically constructing the most widely used artificial-intelligence architecture, that is, artificial neural networks, to achieve brain-inspired information processing at the speed of light. However, owing to restrictions in design flexibility and the accumulation of system errors, existing processor architectures are not reconfigurable and have limited model complexity and experimental performance. Here, we propose the reconfigurable diffractive processing unit, an optoelectronic fused computing architecture based on the diffraction of light, which can support different neural networks and achieve a high model complexity with millions of neurons. Along with the developed adaptive training approach to circumvent system errors, we achieved excellent experimental accuracies for high-speed image and video recognition over benchmark datasets and a computing performance superior to that of cutting-edge electronic computing platforms.

optics,physics, applied
Neuromorphic Photonics: 2D or Not 2D?

R. Stabile,G. Dabos,C. Vagionas,B. Shi,N. Calabretta,N. Pleros

DOI: https://doi.org/10.1063/5.0047946

IF: 2.877

2021-01-01

Journal of Applied Physics

Abstract:The computing industry is rapidly moving from a programming to a learning area, with the reign of the von Neumann architecture starting to fade, after many years of dominance. The new computing paradigms of non-von Neumann architectures have started leading to the development of emerging artificial neural network (ANN)-based analog electronic artificial intelligence (AI) chipsets with remarkable energy efficiency. However, the size and energy advantages of electronic processing elements are naturally counteracted by the speed and power limits of the electronic interconnects inside the circuits due to resistor-capacitor (RC) parasitic effects. Neuromorphic photonics has come forward as a new research field, which aims to transfer the well-known high-bandwidth and low-energy interconnect credentials of photonic circuitry in the area of neuromorphic platforms. The high potential of neuromorphic photonics and their well-established promise for fJ/Multiply-ACcumulate energy efficiencies at orders of magnitudes higher neuron densities require a number of breakthroughs along the entire technology stack, being confronted with a major advancement in the selection of the best-in-class photonic material platforms for weighting and activation functions and their transformation into co-integrated photonic computational engines. With this paper, we analyze the current status in neuromorphic computing and in available photonic integrated technologies and propose a novel three-dimensional computational unit which, with its compactness, ultrahigh efficiency, and lossless interconnectivity, is foreseen to allow scalable computation AI chipsets that outperform electronics in computational speed and energy efficiency to shape the future of neuromorphic computing.

General Optoelectronic Computing Based On Scalable Photonic Neuromorphic System

Optoelectronic Neuromorphic System Using the Neural Engineering Framework

Research Progress on Photonic Neuromorphic Computing

Massively scalable wavelength diverse integrated photonic linear neuron

Semiconductor Lasers for Photonic Neuromorphic Computing and Photonic Spiking Neural Networks: A Perspective

Photonics for Neuromorphic Computing: Fundamentals, Devices, and Opportunities

Neuromorphic Photonic Networks

All-optical spiking neurosynaptic networks with self-learning capabilities

Photonic Integrated Neuro-Synaptic Core for Convolutional Spiking Neural Network

On-chip Spiking Neural Networks Based on Add-Drop Ring Microresonators and Electrically Reconfigurable Phase-Change Material Photonic Switches

Large-scale photonic computing with nonlinear disordered media

Considerations for neuromorphic supercomputing in semiconducting and superconducting optoelectronic hardware

Progress and Prospects of Photonic Neuromorphic Computing(Invited)

End-to-End Optimization for a Compact Optical Neural Network Based on Nanostructured 2 x 2 Optical Processors

Hardware-algorithm collaborative computing with photonic spiking neuron chip based on an integrated Fabry-Perot laser with a saturable absorber

Intelligent neuromorphic computing based on nanophotonics and metamaterials

Optical and Optoelectronic Neuromorphic Devices Based on Emerging Memory Technologies

Artificial Visual Synaptic Architecture with High-Linearity Light-Modulated Weight for Optoelectronic Neuromorphic Computing

Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit

Neuromorphic Photonics: 2D or Not 2D?