Abstract:An emerging generative artificial intelligence (AI) based on neural networks starts to grow in popularity with a revolutionizing capability of creating new and original content. As giant generative models with millions to billions of parameters are developed, trained and maintained, a massive and energy-efficient computing power is highly required. However, conventional digital computers are struggling to keep up with the pace of the generative model improvements. In this paper, we propose and demonstrate high-throughput optical neural networks based on temporal computing. The core weighted summation operation is realized with the use of high-speed electro-optic modulation and low-speed balanced photodetection. The input data and weight are encoded in a time sequence separately and loaded on an optical signal via two electro-optic modulators sequentially. By precisely controlling the synchronization time of the data and weight loading, the matrix multiplication is performed. Followed by a balanced photodetector, the summation is conducted, thanks to the electron accumulation of the inherent electronic integrator circuit of the low-speed photodetector. Thus, the linear weighted summation operation is implemented based on temporal computing in the optical domain. With the proposed optical linear weighted summation, a fully-connected neural network and convolutional neural network are realized. Thanks to the high-speed feature of temporal computing, a high data throughput of the optical neural network is experimentally demonstrated, and the weighting coefficients can be specified on demand, which enables a strong programmability of the optical neural network. By leveraging wavelength multiplexing technology, a scalable optical neural network could be created with a massive computing power and strong reconfigurability, which holds great potential for future giant AI applications.

Seamless Optical Cloud Computing across Edge-Metro Network for Generative AI

An Edge-Cloud Collaboration Framework for Generative AI Service Provision with Synergetic Big Cloud Model and Small Edge Models

Optoelectronic generative adversarial networks

An Overview on Generative AI at Scale with Edge-Cloud Computing

Cloud-Edge Collaboration Based Power IoT Scene Perception Mechanism

Delocalized photonic deep learning on the internet's edge

Offloading and Quality Control for AI Generated Content Services in 6G Mobile Edge Computing Networks

Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI

Reliable adaptive edge-cloud collaborative DNN inference acceleration scheme combining computing and communication resources in optical networks

Sustainable AI Processing at the Edge

Building energy efficient semantic segmentation in intelligent edge computing

All-Optical Computing Based on Convolutional Neural Networks

High-throughput optical neural networks based on temporal computing

AI on the Edge: Rethinking AI-based IoT Applications Using Specialized Edge Architectures

Adaptive Compression Offloading and Resource Allocation for Edge Vision Computing

Computing in the Era of Large Generative Models: From Cloud-Native to AI-Native

Distributed Rendering for Cloud Gaming in Cloud-Edge-End Cooperation Networks

Computing Network: a New Multi-Access Edge Computing

An edge-cloud collaborative computing platform for building AIoT applications efficiently

Multichannel meta-imager for parallel front-end optical computations