Abstract:Photonic neural networks (PNNs), as emerging analog computing paradigms, have the potential to break both the power consumption wall and processing speed boundary of digital computing architectures. However, most reported PNNs were mainly focused on real-valued regions, where phases of optical fields were only utilized as indirect information to affect optical amplitudes. Moreover, the quantization of phase information at each node of multi-layer PNNs is disregarded. In this work, we propose and demonstrate a Clements-enhanced complex-valued mesh (CCM) with balanced detection units (BDUs), which can capture both the amplitude and phase information at one layer and pass them on to the next layer. Besides, by introducing $N/2$ additional phase shifters to the Clements architecture, the proposed CCM possesses a complete characterization ability for arbitrary N-order complex unitary matrices. In this way, both the input vectors and the weighted matrices can be mapped into complex-valued regions and further implemented on the proposed CCM, in which the corresponding computing density is increased by four times with the comparison of real-valued meshes. To validate the proposed CCM with BDUs, we also fabricated a silicon-based on-chip 4×4 mesh with a footprint of 7.86 mm $^{2}$ and experimentally verified its performances on a two-class classification task of King-Rook vs. King (KRK) in chess and a ten-class classification of handwritten digits from MNIST database, yielding tested accuracies of 94.06 $\%$ and 91.75 $\%$ , respectively. The proposed passive on-chip CCM together with BDUs might provide another solution for next-generation artificial intelligence hardware with enhanced performances.

Physics-informed Neural Network for Multi-Singularity Structured Light Recognition

Deep-learning-based recognition of multi-singularity structured light

Untrained Neural Network Enabling Fast and Universal Structured-Illumination Microscopy

Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Machine learning meets Singular Optics: Speckle-based Structured light demultiplexing

Optical Encryption Using Attention-Inserted Physics-Driven Single-Pixel Imaging

Dynamic-excitation-based Steady-State Non-Line-of-sight Imaging Via Multi-Branch Convolutional Neural Network

Clements-Enhanced Complex-Valued Coherent Mesh with Balanced Detection Units for Photonic Neural Networks

Dynamic single-photon 3D imaging with a sparsity-based neural network

Low-power scalable multilayer optoelectronic neural networks enabled with incoherent light

Optical Machine Learning with Incoherent Light and a Single-Pixel Detector

Depth Reconstruction with Neural Signed Distance Fields in Structured Light Systems

A novel multiple-image encryption with multi-petals structured light

Generalized Fringe-to-Phase Framework for Single-Shot 3D Reconstruction Integrating Structured Light with Deep Learning

Parameter-free super-resolution structured illumination microscopy via a physics-enhanced neural network

Deep learning facilitated superhigh-resolution recognition of structured light ellipticities

Optical authentication scheme based on all-optical neural network

Complex-valued universal linear transformations and image encryption using spatially incoherent diffractive networks

Single‐Shot Recognition of 3D Phase Images with Deep Learning

Accurate but Fragile Passive Non-Line-of-sight Recognition