Abstract:The slowing down of Moore's law has driven the development of application-specific processors for deep learning. Analog photonic processors offer a promising solution for accelerating matrix-vector multiplications (MVMs) in deep learning by leveraging parallel computations in the optical domain. Intensity-based photonic MVM processors, which do not utilize the phase information of light, are appealing due to their simplified operations. However, existing intensity-based schemes for such processors often employ wavelength multiplexing or mode multiplexing, both of which have limited scalability due to high insertion loss or wavelength crosstalk. In this work, we present a scalable intensity-based photonic MVM processor based on the concept of waveguide multiplexing. This scheme employs multiport photodetectors (PDs) to sum the intensities of multiple optical signals, eliminating the need for multiple wavelengths or modes. A 16-port Ge PD with a 3 dB bandwidth of 11.8 GHz at a bias voltage of -3 V is demonstrated, and it can be further scaled up to handle 250 ports while maintaining a 6.1 GHz operation bandwidth. A 4 $\times$ 4 circuit fabricated on a Si-on-insulator (SOI) platform is used to perform MVMs in a 3-layer neural network designed for classifying Iris flowers, achieving a classification accuracy of 93.3%. Furthermore, the performance of large-scale circuits in a convolutional neural network (CNN) for Fashion-MNIST is simulated, resulting in a classification accuracy of 90.53%. This work provides a simplified and scalable approach to photonic MVM, laying a foundation for large-scale and multi-dimensional photonic matrix-matrix multiplication in optical neural networks.

On-chip Optical Matrix-Vector Multiplier Based on Mode Division Multiplexing

A new method for optical vector-matrix multiplier

Parallel Photonic Acceleration Processor for Matrix-Matrix Multiplication

Optical Vector-Matrix Multiplication Based on Ternary Optical Processor

Waveguide-multiplexed photonic matrix-vector multiplication processor using multiport photodetectors

Integrated Silicon Multifunctional Mode-Division Multiplexing System

A 4×4 MMI-MZ optical switch matrix on SOI based on carrier injection

Three-mode All-Optical (de)multiplexing on a SOI Chip

Mode-Division Multiplexing for Silicon Photonic Network-on-chip.

Microring Modulator Matrix Integrated with Mode Multiplexer and De-Multiplexer for On-Chip Optical Interconnect

Design and experimental verification for optical module of optical vector-matrix multiplier.

Monolithically Mode Division Multiplexing Photonic Integrated Circuit for Large-Capacity Optical Interconnection

Integrated WDM-compatible Optical Mode Division Multiplexing Neural Network Accelerator

Optical mode division multiplexing inspired photonic neural network accelerator

Silicon Integrated Nanophotonic Devices for On-Chip Multi-Mode Interconnects

Chip-to-chip optical multimode communication with universal mode processors

A 32-Channel Hybrid Wavelength-/Mode-Division (de)multiplexer on Silicon

Broadband and Fabrication-Tolerant On-Chip Scalable Mode-Division Multiplexing Based on Mode-Evolution Counter-Tapered Couplers

On-chip WDM mode-division multiplexing interconnection with optional demodulation function.

On-Chip Mode-Division Multiplexing Transmission with Modal Crosstalk Mitigation Employing Low-Coherence Matched Detection

On-Chip Non-Blocking Optical Mode Exchanger for Mode-Division Multiplexing Interconnection Networks