Abstract:The advancement of artificial intelligence demands flexible multimodal data processing with high throughput and energy efficiency. Photonic integrated circuits (PIC) has demonstrated promising potentials in terms of low latency and low power consumption per operation for linear operations such as matrix-vector multiplication. However, the existing schemes face challenges in their scalability due to the use of photonic circuits that expand with the scale of the operants, despite efforts of exploiting the multiple optical parameter dimensions such as time, wavelength and spatial parallelism. They also lacked flexibility and efficiency in switching between different types of operations or tasks and adapting to multimodal data. In this article, we introduce an optical matrix processor (MP) with a minimalistic recursive structure for both multiplications and accumulations. The MP consists of an eletro-optic ring-modulator implemented as a thin-film lithium niobate PIC that allows flexible configurability and time-division multiplexed scheduling. The MP supports not only versatile linear operations including vector/matrix-vector multiplication and single/multi-kernel convolution but also ultrafast task switching and adaptability to data of different sizes, by simply adjusting the data baud rate relative to the ring delay without structural modifications. We demonstrate its capabilities in a optic-electronic convolutional neural network with a computing throughput up to 73.4 billion operations per second. The MP further supports high scalability through appropriate allocation of wavelength and space resources,extending computing parallelism to handle higher data volumes with higher energy efficiency. This novel scheme paves the way for a new class of photonic processorscapable of managing escalating data workloads with unprecedented flexibility, efficiency and scalability.

Design and analysis of on-chip reconfigurable photonic components for photonic multiply and accumulate operation

Scalable Photonic Reservoir Computing Based on Pulse Propagation in Parallel Passive Dispersive Links

A Reconfigurable Photonic Computing Chip with Easily Scalable Topology

Analysis and codesign of electronic–photonic integrated circuit hardware accelerator for machine learning application

Parallel Photonic Acceleration Processor for Matrix-Matrix Multiplication

Improving Scalability of Mach-Zehnder Interferometer Based Photonic Computers via Algorithm-Hardware Codesign

M3ICRO: Machine Learning-Enabled Compact Photonic Tensor Core based on PRogrammable Multi-Operand Multimode Interference

A mode-multiplexed photonic integrated vector dot-product core from inverse design

Deep photonic network platform enabling arbitrary and broadband optical functionality

Photonic computing to accelerate data processing in wireless communications

Deep Photonic Networks with Arbitrary and Broadband Functionality

Multifunctional Mixed Analog/digital Signal Processor Based on Integrated Photonics

Multi-functional photonic processors using coherent network of micro-ring resonators

Analysis of Integration Technologies for High-Speed Analog Neuromorphic Photonics

Scalable and Versatile Linear Computation with Minimalistic Photonic Matrix Processor

Integrated photonics modular arithmetic processor

Optoelectronic Computing Evaluation and Deployment Platform Based on a 256-MAC Silicon Photonic Chip

A multifunctional optical computing system based on directed logic and micro-ring resonator

Inverse-designed Photonic Computing Core for Parallel Matrix-vector Multiplication

Photonic-Electronic Integrated Circuits for High-Performance Computing and AI Accelerators

Comparison of Microcomb-Based Radio-Frequency Photonic Transversal Signal Processors Implemented with Discrete Components Versus Integrated Chips