Abstract:The advancement of artificial intelligence demands flexible multimodal data processing with high throughput and energy efficiency. Photonic integrated circuits (PIC) has demonstrated promising potentials in terms of low latency and low power consumption per operation for linear operations such as matrix-vector multiplication. However, the existing schemes face challenges in their scalability due to the use of photonic circuits that expand with the scale of the operants, despite efforts of exploiting the multiple optical parameter dimensions such as time, wavelength and spatial parallelism. They also lacked flexibility and efficiency in switching between different types of operations or tasks and adapting to multimodal data. In this article, we introduce an optical matrix processor (MP) with a minimalistic recursive structure for both multiplications and accumulations. The MP consists of an eletro-optic ring-modulator implemented as a thin-film lithium niobate PIC that allows flexible configurability and time-division multiplexed scheduling. The MP supports not only versatile linear operations including vector/matrix-vector multiplication and single/multi-kernel convolution but also ultrafast task switching and adaptability to data of different sizes, by simply adjusting the data baud rate relative to the ring delay without structural modifications. We demonstrate its capabilities in a optic-electronic convolutional neural network with a computing throughput up to 73.4 billion operations per second. The MP further supports high scalability through appropriate allocation of wavelength and space resources,extending computing parallelism to handle higher data volumes with higher energy efficiency. This novel scheme paves the way for a new class of photonic processorscapable of managing escalating data workloads with unprecedented flexibility, efficiency and scalability.

A Reconfigurable Matrix Multiplication Coprocessor with High Area and Energy Efficiency for Visual Intelligent and Autonomous Mobile Robots

A Low-Power In-Memory Multiplication and Accumulation Array with Modified Radix-4 Input and Canonical Signed Digit Weights

A Reconfigurable Visual-Inertial Odometry Accelerated Core with High Area and Energy Efficiency for Autonomous Mobile Robots

Design Of A Dynamic Reconfigurable Coprocessor For Flexible Precision Matrix Algorithms In Media Processing And Industrial Control Applications

Vectorizable Design and Implementation of Matrix Multiplication on Vector Processor

Scalable Systolic Array Multiplier Optimized by Sparse Matrix.

A Memristor Crossbar Based Computing Engine Optimized for High Speed and Accuracy

Design of a Reconfigurable Coprocessor for Double Precision Floating Point Matrix Algorithms

Design of a Dynamically Reconfigurable Arithmetic Unit for Matrix Algorithms

Silicon-based Optoelectronics for General-Purpose Matrix Computation: a Review

Reconfigurable Matrix Multiplier with On-Site Reinforcement Learning.

A Memristive Neural Network Based Matrix Equation Solver with High Versatility and High Energy Efficiency

Scalable and Versatile Linear Computation with Minimalistic Photonic Matrix Processor

Matrix computing coprocessor for an embedded system

Quartet: A 22nm 0.09mj/lnference Digital Compute-in-Memory Versatile AI Accelerator with Heterogeneous Tensor Engines and Off-Chip-Less Dataflow

Technological Exploration of Rram Crossbar Array for Matrix-Vector Multiplication

RoboVisio: A Micro-Robot Vision Domain-Specific SoC for Autonomous Navigation Enabling Fully-on-Chip Intelligence via 2-MB eMRAM

NeuralMatrix: Compute the Entire Neural Networks with Linear Matrix Operations for Efficient Inference

Coherent General-Purpose Photonic Matrix Processor

An SRAM-Based Reconfigurable Cognitive Computation Matrix for Sensor Edge Applications

DiP: A Scalable, Energy-Efficient Systolic Array for Matrix Multiplication Acceleration