Abstract:With the popularity of photo-sharing websites, the number of web images has exploded into unseen magnitude. Annotating such large-scale data will cost huge amount of human resources and is thus unaffordable. Motivated by this challenging problem, we propose a novel sparse graph based multilabel propagation (SGMP) scheme for super large scale datasets. Both the efficacy and accuracy of the image annotation are further investigated under different graph construction strategies, where Gaussian noise and non-Gaussian sparse noise are simultaneously considered in the formulations of these strategies. Our proposed approach outperforms the state-of-the-art algorithms by focusing on: (1) For large-scale graph construction, a simple yet efficient LSH ( Locality Sensitive Hashing )-based sparse graph construction scheme is proposed to speed up the construction. We perform the multilabel propagation on this hashing-based graph construction, which is derived with LSH approach followed by sparse graph construction within the individual hashing buckets; (2) To further improve the accuracy, we propose a novel sparsity induced scalable graph construction scheme, which is based on a general sparse optimization framework. Sparsity essentially implies a very strong prior: for large scale optimization, the values of most variables shall be zeros when the solution reaches the optimum. By utilizing this prior, the solutions of large-scale sparse optimization problems can be derived by solving a series of much smaller scale subproblems; (3) For multilabel propagation, different from the traditional algorithms that propagate over individual label independently, our proposed propagation first encodes the label information of an image as a unit label confidence vector and naturally imposes inter-label constraints and manipulates labels interactively. Then, the entire propagation problem is formulated on the concept of Kullback-Leibler divergence defined on probabilistic distributions, which guides the propagation of the supervision information. Extensive experiments on the benchmark dataset NUS-WIDE with 270k images and its lite version NUS-WIDE-LITE with 56k images well demonstrate the effectiveness and scalability of the proposed multi-label propagation scheme.

Large-Scale Graph Label Propagation on GPUs

GPU-Accelerated Graph Label Propagation for Real-Time Fraud Detection

Graph Learning on Millions of Data in Seconds: Label Propagation Acceleration on Graph Using Data Distribution

LargeGraph: An Efficient Dependency-Aware GPU-Accelerated Large-Scale Graph Processing

GraphPEG

Engineering A Workload-balanced Push-Relabel Algorithm for Massive Graphs on GPUs

Large-Scale Multilabel Propagation Based on Efficient Sparse Graph Construction

A Distributed Graph-Parallel Computing System with Lightweight Communication Overhead

Lightweight Label Propagation for Large-Scale Network Data

Memory Efficient GPU-based Label Propagation Algorithm (LPA) for Community Detection on Large Graphs

LTPG: Large-Batch Transaction Processing on GPUs with Deterministic Concurrency Control

CuLDA_CGS: Solving Large-scale LDA Problems on GPUs

A BSP Model Graph Processing System on Many Cores

FastGL: A GPU-Efficient Framework for Accelerating Sampling-Based GNN Training at Large Scale

GLoP: Enabling Massively Parallel Incident Response Through GPU Log Processing

NeuGraph: Parallel Deep Neural Network Computation on Large Graphs

Make Bricks with a Little Straw: Large-Scale Spatio-Temporal Graph Learning with Restricted GPU-Memory Capacity

LSM-GNN: Large-scale Storage-based Multi-GPU GNN Training by Optimizing Data Transfer Scheme

PaGraph

Efficient Graph Neural Network Inference at Large Scale

HPGA: A High-Performance Graph Analytics Framework on the GPU