Abstract:Matching, a task to optimally assign limited resources under constraints, is a fundamental technology for society. The task potentially has various objectives, conditions, and constraints; however, the efficient neural network architecture for matching is underexplored. This paper proposes a novel graph neural network (GNN), \textit{WeaveNet}, designed for bipartite graphs. Since a bipartite graph is generally dense, general GNN architectures lose node-wise information by over-smoothing when deeply stacked. Such a phenomenon is undesirable for solving matching problems. WeaveNet avoids it by preserving edge-wise information while passing messages densely to reach a better solution. To evaluate the model, we approximated one of the \textit{strongly NP-hard} problems, \textit{fair stable matching}. Despite its inherent difficulties and the network's general purpose design, our model reached a comparative performance with state-of-the-art algorithms specially designed for stable matching for small numbers of agents.
What problem does this paper attempt to address?
### The Problem the Paper Attempts to Solve
This paper attempts to solve the Matching Problem, specifically the Two-sided Matching Problem. The Matching Problem refers to how to optimally allocate limited resources under certain constraints. This type of problem is fundamentally important in society as it can be applied to various decision-making scenarios, such as job matching and multi-object tracking.
Specifically, the paper proposes a new Graph Neural Network (GNN) architecture called WeaveNet, designed to handle matching problems on Bipartite Graphs. Bipartite Graphs are typically dense, and general GNN architectures tend to lose node information due to over-smoothing when deeply stacked, which is detrimental to solving matching problems. WeaveNet addresses this issue by retaining edge information and avoiding excessive message passing in dense graphs.
To evaluate the effectiveness of WeaveNet, the paper tests it on a strongly NP-hard problem—the Fair Stable Matching Problem. Despite the inherent difficulty of this problem and the general design of WeaveNet, experimental results show that WeaveNet achieves performance comparable to state-of-the-art algorithms specifically designed for stable matching on small-scale problem instances.
### Main Contributions
1. **Proposing WeaveNet**: A new neural network architecture for matching problems, significantly outperforming traditional learning-based methods.
2. **Performance Comparison**: Achieving, for the first time, a learning model that performs comparably to state-of-the-art handcrafted algorithms on small-scale problem instances (N=20, 30).
3. **Unsupervised Training**: Demonstrating, for the first time, the performance of unsupervised training of deep models through continuous relaxation of discrete conditions.
4. **Benchmark Code**: Providing stable benchmark code, opening new avenues for research in learning-based combinatorial optimization.
### Background and Related Work
- **Stable Matching Problem**: The paper evaluates the typical two-sided stable matching problem. The stable matching problem involves two sets A and B, where each agent in the sets has a preference list. A matching m is considered unstable if there exists an unmatched pair {av, bw} such that there are matched pairs {av, bj} and {ai, bw} that satisfy certain conditions. Stable matching requires the absence of such blocking pairs.
- **Fairness Metrics**: To compensate for unfairness, various fairness metrics are proposed, including Sex Equality Cost (SEq), Regret Cost (Reg), Egalitarian Cost (Egal), and Balance Cost (Bal).
- **Existing Methods**: Existing methods include the Gale-Shapley algorithm, DACC algorithm, and PowerBalance algorithm, which perform differently under various circumstances.
### Methods and Models
- **WeaveNet Architecture**: WeaveNet processes input data through Feature Weaving Layers, which can effectively handle variable-sized inputs while maintaining permutation invariance. Each Feature Weaving Layer processes features through cross-concatenation and local structure Eℓ.
- **Relaxed Continuous Optimization**: To optimize the model in an end-to-end manner, the paper relaxes the discrete loss functions into continuous loss functions for optimization. This includes matching condition loss Lm, stability loss Ls, and fairness loss Lf or Lb.
### Experimental Results
- **Comparison with Learning-based Methods**: On small-scale problem instances with N<10, WeaveNet significantly outperforms other learning-based methods such as MLP and DBM.
- **Comparison with Algorithmic Methods**: On larger-scale problem instances with N=20, 30, WeaveNet achieves performance comparable to or even better than state-of-the-art algorithms in most cases.
- **Large-scale Demonstration**: On large-scale problem instances with N=100, WeaveNet still shows performance close to state-of-the-art algorithms, although in some cases, the Hungarian algorithm is needed to enforce one-to-one matching.
### Conclusion
The paper proposes a new neural network architecture called WeaveNet for solving matching problems on bipartite graphs.