Abstract:As a dedicated quantum device, Ising machines could solve large-scale binary optimization problems in milliseconds. There is emerging interest in utilizing Ising machines to train feedforward neural networks due to the prosperity of generative artificial intelligence. However, existing methods can only train single-layer feedforward networks because of the complex nonlinear network topology. This paper proposes an Ising learning algorithm to train quantized neural network (QNN), by incorporating two essential techinques, namely binary representation of topological network and order reduction of loss function. As far as we know, this is the first algorithm to train multi-layer feedforward networks on Ising machines, providing an alternative to gradient-based backpropagation. Firstly, training QNN is formulated as a quadratic constrained binary optimization (QCBO) problem by representing neuron connection and activation function as equality constraints. All quantized variables are encoded by binary bits based on binary encoding protocol. Secondly, QCBO is converted to a quadratic unconstrained binary optimization (QUBO) problem, that can be efficiently solved on Ising machines. The conversion leverages both penalty function and Rosenberg order reduction, who together eliminate equality constraints and reduce high-order loss function into a quadratic one. With some assumptions, theoretical analysis shows the space complexity of our algorithm is $\mathcal{O}(H^2L + HLN\log H)$, quantifying the required number of Ising spins. Finally, the algorithm effectiveness is validated with a simulated Ising machine on MNIST dataset. After annealing 700 ms, the classification accuracy achieves 98.3%. Among 100 runs, the success probability of finding the optimal solution is 72%. Along with the increasing number of spins on Ising machine, our algorithm has the potential to train deeper neural networks.

Photonic Hopfield Neural Network for the Ising Problem.

Nanophotonic spin-glass for realization of a coherent Ising machine

On-demand photonic Ising machine with simplified Hamiltonian calculation by phase encoding and intensity detection

An On-demand Photonic Ising Machine with Simplified Hamiltonian Calculation by Phase-encoding and Intensity Detection.

Heuristic Recurrent Algorithms for Photonic Ising Machines

An Integrated All‐Optical Ising Machine with Unlimited Spin Array Size and Coupling

Nanophotonic Phased Array XY Hamiltonian Solver

Scalable On-Chip Optoelectronic Ising Machine Utilizing Thin-Film Lithium Niobate Photonics

Efficient Hardware Configuration Method for Photonic Neural Network with Genetic Algorithm

20736-node Weighted Max-Cut Problem Solving by Quadrature Photonic Spatial Ising Machine

Electrically Programmable Phase-Change Photonic Memory for Optical Neural Networks with Nanoseconds in Situ Training Capability

Combinatorial optimization solving by coherent Ising machines based on spiking neural networks

Encoding arbitrary Ising Hamiltonians on Spatial Photonic Ising Machines

A single shot coherent Ising machine based on a network of injection-locked multicore fiber lasers

Training Multi-layer Neural Networks on Ising Machine

Easily Scalable Photonic Tensor Core Based on Tunable Units with Single Internal Phase Shifters

Optimization with photonic wave-based annealers

Photonic Neural Networks and Its Applications

Reconstructing the Hopfield network as an inverse Ising problem

Programmable Photonic Simulator for Spin Glass Models