Hybrid training of optical neural networks

James Spall,Xianxin Guo,A. I. Lvovsky

DOI: https://doi.org/10.1364/OPTICA.456108

IF: 10.4

2022-07-14

Optica

Abstract:James Spall, Xianxin Guo, A. I. Lvovsky Optical neural networks are emerging as a promising type of machine learning hardware capable of energy-efficient, parallel computation. ... [Optica 9, 803-811 (2022)]

optics

What problem does this paper attempt to address?

Countering Variations and Thermal Effects for Accurate Optical Neural Networks.

Ying Zhu,Grace Li Zhang,Bing Li,Xunzhao Yin,Cheng Zhuo,Huaxi Gu,Tsung-Yi Ho,Ulf Schlichtmann

DOI: https://doi.org/10.1145/3400302.3415682

2020-01-01

Abstract:Optical neural networks (ONNs) have emerged as a promising high-performance computing platform to accelerate deep neural networks. In ONNs, phases of light are modulated through Mach-Zehnder Interferometers (MZIs), and MZIs are connected in a grid-like layout to implement multiply-accumulate operations. However, ONNs are very sensitive to process variations and thermal effects. This sensitivity leads to a significant degradation of inference accuracy of ONNs and thus renders them unusable in practice. In this paper, we propose a framework to calibrate process variations and counter thermal effects by power compensation. Experimental results demonstrate that the proposed framework can recover the inference accuracy under variations and thermal effects, e.g., from as low as 11.05% back to 74.11% for LeNet-5 on Cifar10, so that ONNs can achieve an inference accuracy similar to the accuracy after software training while providing their high bandwidth in neuromorphic computing.
Training neural networks with end-to-end optical backpropagation

James Spall,Xianxin Guo,A. I. Lvovsky

2023-08-10

Abstract:Optics is an exciting route for the next generation of computing hardware for machine learning, promising several orders of magnitude enhancement in both computational speed and energy efficiency. However, to reach the full capacity of an optical neural network it is necessary that the computing not only for the inference, but also for the training be implemented optically. The primary algorithm for training a neural network is backpropagation, in which the calculation is performed in the order opposite to the information flow for inference. While straightforward in a digital computer, optical implementation of backpropagation has so far remained elusive, particularly because of the conflicting requirements for the optical element that implements the nonlinear activation function. In this work, we address this challenge for the first time with a surprisingly simple and generic scheme. Saturable absorbers are employed for the role of the activation units, and the required properties are achieved through a pump-probe process, in which the forward propagating signal acts as the pump and backward as the probe. Our approach is adaptable to various analog platforms, materials, and network structures, and it demonstrates the possibility of constructing neural networks entirely reliant on analog optical processes for both training and inference tasks.

Optics,Machine Learning
Strategies for Training Optical Neural Networks

Qipeng Yang,Bowen Bai,Weiwei Hu,Xingjun Wang

DOI: https://doi.org/10.1360/nso/20220041

2022-01-01

National Science Open

Abstract:Deep learning has flourished in different areas in recent years,such as computer vision and natural language processing.However,with the end of Moore's law,these applications that rely heavily on computing power are facing bottlenecks.Optical neural networks(ONNs)[1]use light to perform calculations[2,3]featuring high speed and low energy consumption,and they are widely regarded as the next-generation application-specific integrated circuit(ASIC)[4,5]for artificial intelligence.
Spatially Varying Nanophotonic Neural Networks

Kaixuan Wei,Xiao Li,Johannes Froech,Praneeth Chakravarthula,James Whitehead,Ethan Tseng,Arka Majumdar,Felix Heide

2023-12-31

Abstract:The explosive growth of computation and energy cost of artificial intelligence has spurred strong interests in new computing modalities as potential alternatives to conventional electronic processors. Photonic processors that execute operations using photons instead of electrons, have promised to enable optical neural networks with ultra-low latency and power consumption. However, existing optical neural networks, limited by the underlying network designs, have achieved image recognition accuracy far below that of state-of-the-art electronic neural networks. In this work, we close this gap by embedding massively parallelized optical computation into flat camera optics that perform neural network computation during the capture, before recording an image on the sensor. Specifically, we harness large kernels and propose a large-kernel spatially-varying convolutional neural network learned via low-dimensional reparameterization techniques. We experimentally instantiate the network with a flat meta-optical system that encompasses an array of nanophotonic structures designed to induce angle-dependent responses. Combined with an extremely lightweight electronic backend with approximately 2K parameters we demonstrate a reconfigurable nanophotonic neural network reaches 72.76\% blind test classification accuracy on CIFAR-10 dataset, and, as such, the first time, an optical neural network outperforms the first modern digital neural network -- AlexNet (72.64\%) with 57M parameters, bringing optical neural network into modern deep learning era.

Computer Vision and Pattern Recognition
Fully forward mode training for optical neural networks

Zhiwei Xue,Tiankuang Zhou,Zhihao Xu,Shaoliang Yu,Qionghai Dai,Lu Fang

DOI: https://doi.org/10.1038/s41586-024-07687-4

IF: 64.8

2024-08-08

Nature

Abstract:Optical computing promises to improve the speed and energy efficiency of machine learning applications 1,2,3,4,5,6 . However, current approaches to efficiently train these models are limited by in silico emulation on digital computers. Here we develop a method called fully forward mode (FFM) learning, which implements the compute-intensive training process on the physical system. The majority of the machine learning operations are thus efficiently conducted in parallel on site, alleviating numerical modelling constraints. In free-space and integrated photonics, we experimentally demonstrate optical systems with state-of-the-art performances for a given network size. FFM learning shows training the deepest optical neural networks with millions of parameters achieves accuracy equivalent to the ideal model. It supports all-optical focusing through scattering media with a resolution of the diffraction limit; it can also image in parallel the objects hidden outside the direct line of sight at over a kilohertz frame rate and can conduct all-optical processing with light intensity as weak as subphoton per pixel (5.40 × 10 18 - operations-per-second-per-watt energy efficiency) at room temperature. Furthermore, we prove that FFM learning can automatically search non-Hermitian exceptional points without an analytical model. FFM learning not only facilitates orders-of-magnitude-faster learning processes, but can also advance applied and theoretical fields such as deep neural networks, ultrasensitive perception and topological photonics.

multidisciplinary sciences
Optical training of large-scale Transformers and deep neural networks with direct feedback alignment

Ziao Wang,Kilian Müller,Matthew Filipovich,Julien Launay,Ruben Ohana,Gustave Pariente,Safa Mokaadi,Charles Brossollet,Fabien Moreau,Alessandro Cappelli,Iacopo Poli,Igor Carron,Laurent Daudet,Florent Krzakala,Sylvain Gigan

2024-09-01

Abstract:Modern machine learning relies nearly exclusively on dedicated electronic hardware accelerators. Photonic approaches, with low consumption and high operation speed, are increasingly considered for inference but, to date, remain mostly limited to relatively basic tasks. Simultaneously, the problem of training deep and complex neural networks, overwhelmingly performed through backpropagation, remains a significant limitation to the size and, consequently, the performance of current architectures and a major compute and energy bottleneck. Here, we experimentally implement a versatile and scalable training algorithm, called direct feedback alignment, on a hybrid electronic-photonic platform. An optical processing unit performs large-scale random matrix multiplications, which is the central operation of this algorithm, at speeds up to 1500 TeraOps. We perform optical training of one of the most recent deep learning architectures, including Transformers, with more than 1B parameters, and obtain good performances on both language and vision tasks. We study the compute scaling of our hybrid optical approach, and demonstrate a potential advantage for ultra-deep and wide neural networks, thus opening a promising route to sustain the exponential growth of modern artificial intelligence beyond traditional von Neumann approaches.

Emerging Technologies,Disordered Systems and Neural Networks,Machine Learning,Applied Physics,Optics
Optical backpropagation training method and its applications

Tiankuang Zhou,Lu Fang,Tao Yan,Jiamin Wu,Yipeng Li,Jingtao Fan,Huaqiang Wu,Xing Lin,Qionghai Dai

DOI: https://doi.org/10.1117/12.2575111

2020-01-01

Abstract:Training an artificial neural network with backpropagation algorithms requires an extensive computational process. Our recent work proposes to implement the backpropagation algorithm optically for in-situ training of both the linear and nonlinear diffractive optical neural networks which enables the acceleration of training speed and improvement on the energy efficiency on core computing modules. We numerically validated that the proposed in-situ optical learning architecture achieves comparable accuracy to the in-silico training with an electronic computer on the task of object classification and matrix-vector multiplication, which further allows adaptation to the system imperfections. Besides, the self-adaptive property of our approach facilitates the novel application of the network for all-optical imaging through scattering media. The proposed approach paves the way for the robust implementation of large-scale diffractive neural networks to perform distinctive tasks all-optically.
Hybrid optical convolutional neural network with convolution kernels trained in the spatial domain

Jinhwa Gene,Suntak Park,Hyung Cheol Shin,Jong Moo Sohn

DOI: https://doi.org/10.1016/j.neucom.2024.127251

IF: 6

2024-01-11

Neurocomputing

Abstract:Although many hybrid convolutional neural networks using optical convolution processors have been demonstrated for high energy efficiency and fast image processing speed, the need for accurate modeling of the optical convolution hardware and large Fourier kernel sizes result in a long and energy-intensive training process. Here, we demonstrate a hybrid convolutional neural network based on an optimized optical convolution processor—the system uses kernels trained in the spatial domain and compensates the optical path mismatch that arises from the reflection of digital micromirror devices for convolution computation. The spatial-domain convolution kernels are Fourier transformed and then binarized before being programmed into a digital micromirror device in the optical convolution processor. This method minimizes overhead from the optical convolution process in the training of the hybrid convolutional neural network, and it can improve the energy efficiency and reduce the training time of the hybrid optical convolutional neural network. For convolution computation using digital micromirror devices with grayscale images, bit-plane-wise convolution is also presented. We tested the hybrid neural network on MNIST, Fashion-MNIST, and CIFAR-10 color datasets and obtained classification accuracies of 98.7%, 85.8%, and 57.8%, respectively.

computer science, artificial intelligence
Advances and Challenges of Optical Neural Networks

Chen Hongwei,Yu Zhenming,Zhang Tian,Zang Yubin,Dan Yihang,Xu Kun

DOI: https://doi.org/10.3788/cjl202047.0500004

2020-01-01

Chinese Journal of Lasers

Abstract:Neural networks, as one of the most representative techniques in artificial intelligence, have been in rapid development towards high computational speed and low power cost. Due to intrinsic limitations brought by electronic devices, it can be hard for electronic implemented neural networks to further improve these two performances. Optical neural networks can combine both optoelectronic technique and neural network model to provide ways to break the bottleneck. In order to have a brighter view on the history, frontiers and future of optical neural networks, optical neural networks of feed -forward, recurrent and spiking models arc illustrated in this paper. Challenges and future trends of optical neural networks on in situ training, nonlinear computing, expanding scale and applications will thus be revealed.
<i>In situ</i> optical backpropagation training of diffractive optical neural networks

Tiankuang Zhou,Lu Fang,Tao Yan,Jiamin Wu,Yipeng Li,Jingtao Fan,Huaqiang Wu,Xing Lin,Qionghai Dai

DOI: https://doi.org/10.1364/PRJ.389553

IF: 7.6

2020-01-01

Photonics Research

Abstract:Training an artificial neural network with backpropagation algorithms to perform advanced machine learning tasks requires an extensive computational process. This paper proposes to implement the backpropagation algorithm optically for in situ training of both linear and nonlinear diffractive optical neural networks, which enables the acceleration of training speed and improvement in energy efficiency on core computing modules. We demonstrate that the gradient of a loss function with respect to the weights of diffractive layers can be accurately calculated by measuring the forward and backward propagated optical fields based on light reciprocity and phase conjunction principles. The diffractive modulation weights are updated by programming a high-speed spatial light modulator to minimize the error between prediction and target output and perform inference tasks at the speed of light. We numerically validate the effectiveness of our approach on simulated networks for various applications. The proposed in situ optical learning architecture achieves accuracy comparable to in silico training with an electronic computer on the tasks of object classification and matrix-vector multiplication, which further allows the diffractive optical neural network to adapt to system imperfections. Also, the self-adaptive property of our approach facilitates the novel application of the network for all-optical imaging through scattering media. The proposed approach paves the way for robust implementation of large-scale diffractive neural networks to perform distinctive tasks all-optically. (C) 2020 Chinese Laser Press
In Situ Optical Backpropagation Training of Diffractive Optical Neural Networks

Tiankuang Zhou,Lu Fang,Tao Yan,Jiamin Wu,Yipeng Li,Jingtao Fan,Huaqiang Wu,Xing Lin,Qionghai Dai

DOI: https://doi.org/10.1364/prj.389553

IF: 7.6

2020-01-01

Photonics Research

Abstract:Training an artificial neural network with backpropagation algorithms to perform advanced machine learning tasks requires an extensive computational process. This paper proposes to implement the backpropagation algorithm optically for in situ training of both linear and nonlinear diffractive optical neural networks, which enables the acceleration of training speed and improvement in energy efficiency on core computing modules. We demonstrate that the gradient of a loss function with respect to the weights of diffractive layers can be accurately calculated by measuring the forward and backward propagated optical fields based on light reciprocity and phase conjunction principles. The diffractive modulation weights are updated by programming a high-speed spatial light modulator to minimize the error between prediction and target output and perform inference tasks at the speed of light. We numerically validate the effectiveness of our approach on simulated networks for various applications. The proposed in situ optical learning architecture achieves accuracy comparable to in silico training with an electronic computer on the tasks of object classification and matrix-vector multiplication, which further allows the diffractive optical neural network to adapt to system imperfections. Also, the self-adaptive property of our approach facilitates the novel application of the network for all-optical imaging through scattering media. The proposed approach paves the way for robust implementation of large-scale diffractive neural networks to perform distinctive tasks all-optically. (C) 2020 Chinese Laser Press
Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

Qiang Li,Zhi Wang,Yansi Le,Chonghui Sun,Xiaojia Song,Chongqing Wu

DOI: https://doi.org/10.1117/12.2245976

2016-01-01

Abstract:Neuromorphic engineering has a wide range of applications in the fields of machine learning, pattern recognition, adaptive control, etc. Photonics, characterized by its high speed, wide bandwidth, low power consumption and massive parallelism, is an ideal way to realize ultrafast spiking neural networks (SNNs). Synaptic plasticity is believed to be critical for learning, memory and development in neural circuits. Experimental results have shown that changes of synapse are highly dependent on the relative timing of pre- and postsynaptic spikes. Synaptic plasticity in which presynaptic spikes preceding postsynaptic spikes results in strengthening, while the opposite timing results in weakening is called antisymmetric spike-timing-dependent plasticity (STDP) learning rule. And synaptic plasticity has the opposite effect under the same conditions is called antisymmetric anti-STDP learning rule. We proposed and experimentally demonstrated an optical implementation of neural learning algorithms, which can achieve both of antisymmetric STDP and anti-STDP learning rule, based on the cross-gain modulation (XGM) within a single semiconductor optical amplifier (SOA). The weight and height of the potentitation and depression window can be controlled by adjusting the injection current of the SOA, to mimic the biological antisymmetric STDP and anti-STDP learning rule more realistically. As the injection current increases, the width of depression and potentitation window decreases and height increases, due to the decreasing of recovery time and increasing of gain under a stronger injection current. Based on the demonstrated optical STDP circuit, ultrafast learning in optical SNNs can be realized.
Backpropagation through nonlinear units for all-optical training of neural networks

Xianxin Guo,Thomas D. Barrett,Zhiming M. Wang,A. I. Lvovsky

DOI: https://doi.org/10.48550/arXiv.1912.12256

2019-12-23

Emerging Technologies

Abstract:Backpropagation through nonlinear neurons is an outstanding challenge to the field of optical neural networks and the major conceptual barrier to all-optical training schemes. Each neuron is required to exhibit a directionally dependent response to propagating optical signals, with the backwards response conditioned on the forward signal, which is highly non-trivial to implement optically. We propose a practical and surprisingly simple solution that uses saturable absorption to provide the network nonlinearity. We find that the backward propagating gradients required to train the network can be approximated in a pump-probe scheme that requires only passive optical elements. Simulations show that, with readily obtainable optical depths, our approach can achieve equivalent performance to state-of-the-art computational networks on image classification benchmarks, even in deep networks with multiple sequential gradient approximations. This scheme is compatible with leading optical neural network proposals and therefore provides a feasible path towards end-to-end optical training.
Forward-Forward Training of an Optical Neural Network

Ilker Oguz,Junjie Ke,Qifei Wang,Feng Yang,Mustafa Yildirim,Niyazi Ulas Dinc,Jih-Liang Hsieh,Christophe Moser,Demetri Psaltis

2023-08-10

Abstract:Neural networks (NN) have demonstrated remarkable capabilities in various tasks, but their computation-intensive nature demands faster and more energy-efficient hardware implementations. Optics-based platforms, using technologies such as silicon photonics and spatial light modulators, offer promising avenues for achieving this goal. However, training multiple trainable layers in tandem with these physical systems poses challenges, as they are difficult to fully characterize and describe with differentiable functions, hindering the use of error backpropagation algorithm. The recently introduced Forward-Forward Algorithm (FFA) eliminates the need for perfect characterization of the learning system and shows promise for efficient training with large numbers of programmable parameters. The FFA does not require backpropagating an error signal to update the weights, rather the weights are updated by only sending information in one direction. The local loss function for each set of trainable weights enables low-power analog hardware implementations without resorting to metaheuristic algorithms or reinforcement learning. In this paper, we present an experiment utilizing multimode nonlinear wave propagation in an optical fiber demonstrating the feasibility of the FFA approach using an optical system. The results show that incorporating optical transforms in multilayer NN architectures trained with the FFA, can lead to performance improvements, even with a relatively small number of trainable weights. The proposed method offers a new path to the challenge of training optical NNs and provides insights into leveraging physical transformations for enhancing NN performance.

Machine Learning,Optics
Efficient On-Chip Learning for Optical Neural Networks Through Power-Aware Sparse Zeroth-Order Optimization

Jiaqi Gu,Chenghao Feng,Zheng Zhao,Zhoufeng Ying,Ray T. Chen,David Z. Pan

DOI: https://doi.org/10.48550/arXiv.2012.11148

2021-09-06

Abstract:Optical neural networks (ONNs) have demonstrated record-breaking potential in high-performance neuromorphic computing due to their ultra-high execution speed and low energy consumption. However, current learning protocols fail to provide scalable and efficient solutions to photonic circuit optimization in practical applications. In this work, we propose a novel on-chip learning framework to release the full potential of ONNs for power-efficient in situ training. Instead of deploying implementation-costly back-propagation, we directly optimize the device configurations with computation budgets and power constraints. We are the first to model the ONN on-chip learning as a resource-constrained stochastic noisy zeroth-order optimization problem, and propose a novel mixed-training strategy with two-level sparsity and power-aware dynamic pruning to offer a scalable on-chip training solution in practical ONN deployment. Compared with previous methods, we are the first to optimize over 2,500 optical components on chip. We can achieve much better optimization stability, 3.7x-7.6x higher efficiency, and save >90% power under practical device variations and thermal crosstalk.

Emerging Technologies,Machine Learning,Optics
Multilayer Optoelectronic Hybrid Convolutional Neural Network with an Optical 4F-System Recurrent Structure

Jie Chen,Huarong Gu,Hongwei Zhang,Jie Zhong,Yi Xiong

DOI: https://doi.org/10.1117/12.2686844

2023-01-01

Abstract:After decades of development, artificial neural network has become one of the most important research directions of artificial intelligence, and has a wide range of applications and important value in computer vision, natural language processing and other fields. Today, most of the applied artificial neural networks are based on von Neumann electronic hardware. As the semiconductor process approaches the physical limit, the performance growth encounters bottlenecks, and the power consumption problem is difficult to solve, limiting the application and further development of deep learning. Optical neural network provides a way to break through the bottleneck due to its high speed, high parallelism and low power consumption. At present, most optical neural networks are difficult to expand the depth of the network and have limited performance. In this paper, a multilayer optoelectronic hybrid convolutional neural network with an optical 4f-system recurrent structure is proposed. The electronic convolutional layer is replaced by an optical convolutional layer based on the 4f system, and the depth of the neural network is extended by the recurrent structure of the 4f system to improve its performance. Experiments show that the recognition accuracy of CIFAR-10 dataset of the proposed hybrid neural network is close to that of a corresponding electronic neural network. This work provides a possible way to build a deeper optoelectronic hybrid convolutional neural network when dealing with complicated problems.
Genetically programmable optical random neural networks

Bora Çarpınlıoğlu,Bahrem Serhat Daniş,Uğur Teğin

2024-03-19

Abstract:Today, machine learning tools, particularly artificial neural networks, have become crucial for diverse applications. However, current digital computing tools to train and deploy artificial neural networks often struggle with massive data sizes and high power consumptions. Optical computing provides inherent parallelism and perform fundamental operations with passive optical components. However, most of the optical computing platforms suffer from relatively low accuracies for machine learning tasks due to fixed connections while avoiding complex and sensitive techniques. Here, we demonstrate a genetically programmable yet simple optical neural network to achieve high performances with optical random projection. By genetically programming the orientation of the scattering medium which acts as a random projection kernel and only using 1% of the search space, our novel technique finds an optimum kernel and improves its initial test accuracies 7-22% for various machine learning tasks. Our optical computing method presents a promising approach to achieve high performance in optical neural networks with a simple and scalable design.

Emerging Technologies,Neural and Evolutionary Computing,Optics
Optoelectronic implementations of neural networks

D. Psaltis,A.A. Yamamura,K. Hsu,S. Lin,X.-G. Gu,D. Brady

DOI: https://doi.org/10.1109/35.41399

IF: 9.03

1989-11-01

IEEE Communications Magazine

Abstract:The ability of optical systems to provide the massive interconnections between processors required in most neural network models, which constitutes their chief advantage for such applications, is discussed, focusing on holography. Because of the essential nonlinearity of the holographic connections, nonlinear processing elements are needed to perform complex computations. The use of GaAs hybrid optoelectronic processing elements is examined. GaAs is an excellent material for this purpose, since it can be used to fabricate both fast electronic circuits and optical sources and detectors. It is shown how a complete hybrid neural computer can be implemented using available technology developed for conventional computing. An experimentally demonstrated network in which optics plays an even larger role is described.<>

telecommunications,engineering, electrical & electronic
Efficient On-Chip Training of Optical Neural Networks Using Genetic Algorithm

Hui Zhang,Jayne Thompson,Mile Gu,Xu Dong Jiang,Hong Cai,Patricia Yang Liu,Yuzhi Shi,Yi Zhang,Muhammad Faeyz Karim,Guo Qiang Lo,Xianshu Luo,Bin Dong,Leong Chuan Kwek,Ai Qun Liu

DOI: https://doi.org/10.1021/acsphotonics.1c00035

IF: 7

2021-04-16

ACS Photonics

Abstract:Recent advances in silicon photonic chips have made huge progress in optical computing owing to their flexibility in the reconfiguration of various tasks. Its deployment of neural networks serves as an alternative for mitigating the rapidly increased demand for computing resources in electronic platforms. However, it remains a formidable challenge to train the online programmable optical neural networks efficiently, being restricted by the difficulty in obtaining gradient information on a physical device when executing a gradient descent algorithm. Here, we experimentally demonstrate an efficient, physics-agnostic, and closed-loop protocol for training optical neural networks on chip. A gradient-free algorithm, that is, the genetic algorithm, is adopted. The protocol is on-chip implementable, physical agnostic (no need to rely on characterization and offline modeling), and gradient-free. The protocol works for various types of chip structures and is especially helpful to those that cannot be analytically decomposed and characterized. We confirm its viability using several practical tasks, including the crossbar switch and the <i>Iris</i> classification. Finally, by comparing our physics-agonistic and gradient-free method to the off-chip and gradient-based training methods, we demonstrate the robustness of our system to perturbations such as imperfect phase implementation and photodetection noise. Optical processors with gradient-free genetic algorithms have broad application potentials in pattern recognition, reinforcement learning, quantum computing, and realistic applications (such as facial recognition, natural language processing, and autonomous vehicles).The Supporting Information is available free of charge at <a class="ext-link" href="/doi/10.1021/acsphotonics.1c00035?goto=supporting-info">https://pubs.acs.org/doi/10.1021/acsphotonics.1c00035</a>.The statistical information of individuals in the final optimal generation; The results of realizing the crossbar switch on a four-mode optical processor following balanced design; The results of realizing a crossbar switch on an eight-mode optical processor following fast design; Programming a six-mode chip to realize a random T-matrix; Demonstrating the crossbar switch with multiple inputs; Blind classification with a GA-based method and numerical gradient-based method; GA-based training for handwriting digit classification; GA-based training for data set CIFAR-10 (<a class="ext-link" href="/doi/suppl/10.1021/acsphotonics.1c00035/suppl_file/ph1c00035_si_001.pdf">PDF</a>)This article has not yet been cited by other publications.

physics, condensed matter,optics, applied,materials science, multidisciplinary,nanoscience & nanotechnology
Lensless Opto-Electronic Neural Network with Quantum Dot Nonlinear Activation

Wanxin Shi,Xi Jiang,Zheng Huang,Xue Li,Yuyang Han,Sigang Yang,Haizheng Zhong,Hongwei Chen

DOI: https://doi.org/10.1364/prj.515349

IF: 7.6

2024-01-01

Photonics Research

Abstract:With the swift advancement of neural networks and their expanding applications in many fields, optical neural networks have gradually become a feasible alternative to electrical neural networks due to their parallelism, high speed, low latency, and power consumption. Nonetheless, optical nonlinearity is hard to realize in free-space optics, which restricts the potential of the architecture. To harness the benefits of optical parallelism while ensuring compatibility with natural light scenes, it becomes essential to implement two-dimensional spatial nonlinearity within an incoherent light environment. Here, we demonstrate a lensless opto-electrical neural network that incorporates optical nonlinearity, capable of performing convolution calculations and achieving nonlinear activation via a quantum dot film, all without an external power supply. Through simulation and experiments, the proposed nonlinear system can enhance the accuracy of image classification tasks, yielding a maximum improvement of 5.88% over linear models. The scheme shows a facile implementation of passive incoherent two-dimensional nonlinearities, paving the way for the applications of multilayer incoherent optical neural networks in the future.

Hybrid training of optical neural networks

Countering Variations and Thermal Effects for Accurate Optical Neural Networks.

Training neural networks with end-to-end optical backpropagation

Strategies for Training Optical Neural Networks

Spatially Varying Nanophotonic Neural Networks

Fully forward mode training for optical neural networks

Optical training of large-scale Transformers and deep neural networks with direct feedback alignment

Optical backpropagation training method and its applications

Hybrid optical convolutional neural network with convolution kernels trained in the spatial domain

Advances and Challenges of Optical Neural Networks

<i>In situ</i> optical backpropagation training of diffractive optical neural networks

In Situ Optical Backpropagation Training of Diffractive Optical Neural Networks

Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

Backpropagation through nonlinear units for all-optical training of neural networks

Forward-Forward Training of an Optical Neural Network

Efficient On-Chip Learning for Optical Neural Networks Through Power-Aware Sparse Zeroth-Order Optimization

Multilayer Optoelectronic Hybrid Convolutional Neural Network with an Optical 4F-System Recurrent Structure

Genetically programmable optical random neural networks

Optoelectronic implementations of neural networks

Efficient On-Chip Training of Optical Neural Networks Using Genetic Algorithm

Lensless Opto-Electronic Neural Network with Quantum Dot Nonlinear Activation