Abstract:With the proliferation of ultrahigh-speed mobile networks and internet-connected devices, along with the rise of artificial intelligence (AI)<a href="/articles/s41586-020-03070-1#ref-CR1">1</a>, the world is generating exponentially increasing amounts of data that need to be processed in a fast and efficient way. Highly parallelized, fast and scalable hardware is therefore becoming progressively more important<a href="/articles/s41586-020-03070-1#ref-CR2">2</a>. Here we demonstrate a computationally specific integrated photonic hardware accelerator (tensor core) that is capable of operating at speeds of trillions of multiply-accumulate operations per second (1012 MAC operations per second or tera-MACs per second). The tensor core can be considered as the optical analogue of an application-specific integrated circuit (ASIC). It achieves parallelized photonic in-memory computing using phase-change-material memory arrays and photonic chip-based optical frequency combs (soliton microcombs<a href="/articles/s41586-020-03070-1#ref-CR3">3</a>). The computation is reduced to measuring the optical transmission of reconfigurable and non-resonant passive components and can operate at a bandwidth exceeding 14 gigahertz, limited only by the speed of the modulators and photodetectors. Given recent advances in hybrid integration of soliton microcombs at microwave line rates<a href="#ref-CR3">3</a>,<a href="#ref-CR4">4</a>,<a href="/articles/s41586-020-03070-1#ref-CR5">5</a>, ultralow-loss silicon nitride waveguides<a href="/articles/s41586-020-03070-1#ref-CR6">6</a>,<a href="/articles/s41586-020-03070-1#ref-CR7">7</a>, and high-speed on-chip detectors and modulators, our approach provides a path towards full complementary metal–oxide–semiconductor (CMOS) wafer-scale integration of the photonic tensor core. Although we focus on convolutional processing, more generally our results indicate the potential of integrated photonics for parallel, fast, and efficient computational hardware in data-heavy AI applications such as autonomous driving, live video processing, and next-generation cloud computing services.

Photonic Micro -Ring Tensor Core for Parallel and Shared Batch Processing

Towards a high-density photonic tensor core enabled by intensity-modulated microrings and photonic wire bonding

Photonic tensor cores for machine learning

Inverse-designed Photonic Computing Core for Parallel Matrix-vector Multiplication

Fully-integrated photonic tensor core for image convolutions

Parallel convolutional processing using an integrated photonic tensor core

Parallel Photonic Acceleration Processor for Matrix-Matrix Multiplication

Photonic tensor processing unit with single dataflow and programmable high-precision weighting control

Higher-dimensional processing using a photonic tensor core with continuous-time data

120 GOPS Photonic Tensor Core in Thin-film Lithium Niobate for Inference and in-situ Training

Parallel edge extraction operators on chip speed up photonic convolutional neural networks

Easily Scalable Photonic Tensor Core Based on Tunable Units with Single Internal Phase Shifters

Photonic Convolution Neural Network Based on Interleaved Time-Wavelength Modulation

Compact, efficient, and scalable nanobeam core for photonic matrix-vector multiplication

Partial coherence enhances parallelized photonic computing

A mode-multiplexed photonic integrated vector dot-product core from inverse design

Multi-task Photonic Reservoir Computing: Wavelength Division Multiplexing for Parallel Computing with a Silicon Microring Resonator

A Reconfigurable Photonic Computing Chip with Easily Scalable Topology

Microcomb-based integrated photonic processing unit

Microcomb-driven Photonic Convolutional Engine

Diffraction‐Driven Parallel Convolution Processing with Integrated Photonics