Abstract:With the proliferation of ultrahigh-speed mobile networks and internet-connected devices, along with the rise of artificial intelligence (AI)<a href="/articles/s41586-020-03070-1#ref-CR1">1</a>, the world is generating exponentially increasing amounts of data that need to be processed in a fast and efficient way. Highly parallelized, fast and scalable hardware is therefore becoming progressively more important<a href="/articles/s41586-020-03070-1#ref-CR2">2</a>. Here we demonstrate a computationally specific integrated photonic hardware accelerator (tensor core) that is capable of operating at speeds of trillions of multiply-accumulate operations per second (1012 MAC operations per second or tera-MACs per second). The tensor core can be considered as the optical analogue of an application-specific integrated circuit (ASIC). It achieves parallelized photonic in-memory computing using phase-change-material memory arrays and photonic chip-based optical frequency combs (soliton microcombs<a href="/articles/s41586-020-03070-1#ref-CR3">3</a>). The computation is reduced to measuring the optical transmission of reconfigurable and non-resonant passive components and can operate at a bandwidth exceeding 14 gigahertz, limited only by the speed of the modulators and photodetectors. Given recent advances in hybrid integration of soliton microcombs at microwave line rates<a href="#ref-CR3">3</a>,<a href="#ref-CR4">4</a>,<a href="/articles/s41586-020-03070-1#ref-CR5">5</a>, ultralow-loss silicon nitride waveguides<a href="/articles/s41586-020-03070-1#ref-CR6">6</a>,<a href="/articles/s41586-020-03070-1#ref-CR7">7</a>, and high-speed on-chip detectors and modulators, our approach provides a path towards full complementary metal–oxide–semiconductor (CMOS) wafer-scale integration of the photonic tensor core. Although we focus on convolutional processing, more generally our results indicate the potential of integrated photonics for parallel, fast, and efficient computational hardware in data-heavy AI applications such as autonomous driving, live video processing, and next-generation cloud computing services.

Cross-Layer Design for AI Acceleration with Non-Coherent Optical Computing

Optical Computing for Deep Neural Network Acceleration: Foundations, Recent Developments, and Emerging Directions

Cross-layer Design for Computing-in-Memory

Analog Optical Computing for Artificial Intelligence

Artificial intelligence accelerator using photonic computing

Next-generation Co-Packaged Optics for Future Disaggregated AI Systems

Deep Learning with Passive Optical Nonlinear Mapping

Photonic-Electronic Integrated Circuits for High-Performance Computing and AI Accelerators

ChatGPT at the Speed of Light: Optical Comb-Based Monolithic Photonic-Electronic Linear-Algebra Accelerators

All-Optical Computing Based on Convolutional Neural Networks

Low-power scalable multilayer optoelectronic neural networks enabled with incoherent light

Photonic optical accelerators: The future engine for the era of modern AI?

Parallel convolutional processing using an integrated photonic tensor core

At the intersection of optics and deep learning: statistical inference, computing, and inverse design

Implementing optical analog computing and electrooptic Hopfield network by silicon photonic circuits

A Survey on Silicon Photonics for Deep Learning

Physical Layer-Aware Digital-Analog Co-Design for Photonic Convolution Neural Network

Parallel cross-layer optimization of high-level synthesis and physical design

Diffraction‐Driven Parallel Convolution Processing with Integrated Photonics

Neuromorphic Silicon Photonics and Hardware-Aware Deep Learning for High-Speed Inference