Abstract:With the proliferation of ultrahigh-speed mobile networks and internet-connected devices, along with the rise of artificial intelligence (AI)<a href="/articles/s41586-020-03070-1#ref-CR1">1</a>, the world is generating exponentially increasing amounts of data that need to be processed in a fast and efficient way. Highly parallelized, fast and scalable hardware is therefore becoming progressively more important<a href="/articles/s41586-020-03070-1#ref-CR2">2</a>. Here we demonstrate a computationally specific integrated photonic hardware accelerator (tensor core) that is capable of operating at speeds of trillions of multiply-accumulate operations per second (1012 MAC operations per second or tera-MACs per second). The tensor core can be considered as the optical analogue of an application-specific integrated circuit (ASIC). It achieves parallelized photonic in-memory computing using phase-change-material memory arrays and photonic chip-based optical frequency combs (soliton microcombs<a href="/articles/s41586-020-03070-1#ref-CR3">3</a>). The computation is reduced to measuring the optical transmission of reconfigurable and non-resonant passive components and can operate at a bandwidth exceeding 14 gigahertz, limited only by the speed of the modulators and photodetectors. Given recent advances in hybrid integration of soliton microcombs at microwave line rates<a href="#ref-CR3">3</a>,<a href="#ref-CR4">4</a>,<a href="/articles/s41586-020-03070-1#ref-CR5">5</a>, ultralow-loss silicon nitride waveguides<a href="/articles/s41586-020-03070-1#ref-CR6">6</a>,<a href="/articles/s41586-020-03070-1#ref-CR7">7</a>, and high-speed on-chip detectors and modulators, our approach provides a path towards full complementary metal–oxide–semiconductor (CMOS) wafer-scale integration of the photonic tensor core. Although we focus on convolutional processing, more generally our results indicate the potential of integrated photonics for parallel, fast, and efficient computational hardware in data-heavy AI applications such as autonomous driving, live video processing, and next-generation cloud computing services.

On-chip photonic artificial intelligence accelerator

Artificial intelligence accelerator using photonic computing

Parallel Photonic Acceleration Processor for Matrix-Matrix Multiplication

PIXEL: Photonic Neural Network Accelerator

Monolithic Silicon-Photonics Linear-Algebra Accelerators Enabling Next-Gen Massive MIMO

Symmetric silicon microring resonator optical crossbar array for accelerated inference and training in deep learning

Weight Bank Addition Photonic Accelerator for Artificial Intelligence

Photonic Neuromorphic Accelerator for Convolutional Neural Networks based on an Integrated Reconfigurable Mesh

On-chip photoelectric hybrid convolutional accelerator based on Bragg grating array

All-Optical Nonlinear Activators Using Silicon-Based Waveguides and Microring Resonators for Photonic Neural Networks

Analysis and codesign of electronic–photonic integrated circuit hardware accelerator for machine learning application

Emerging Devices and Packaging Strategies for Electronic-Photonic AI Accelerators

Photonic Computing and Communication for Neural Network Accelerators.

Single chip photonic deep neural network with accelerated training

A Winograd-based Integrated Photonics Accelerator for Convolutional Neural Networks

An ITO Graphene hybrid integrated absorption modulator on Si-photonics for neuromorphic nonlinear activation

Photonic Neuromorphic Processing with On-Chip Electrically-Driven Microring Spiking Neuron

Photonic convolution accelerator based on a hybrid integrated multi-wavelength laser array by photonic wire bonding for real-time image classification

Parallel convolutional processing using an integrated photonic tensor core

Silicon Photonic Architecture for Training Deep Neural Networks with Direct Feedback Alignment

Microcomb-based integrated photonic processing unit