Abstract:As is the case in many big data mining scenarios with a large scale of samples, the heavy computation cost hinders the application of machine learning, which has to iteratively compute by passing over the whole dataset without considering the roles of different samples in training computation. However, we argue that most of the samples dominating computation resources contribute little to the gradient-based model update, particularly when the model is close to convergence. We define this observation as the Sample Contribution Pattern (SCP) in machine learning. This paper proposes two approaches to exploit SCP by detecting gradient characteristics and triggering the reuse of outdated gradients. In particular, this paper reports research results in (1) the definition and description of SCP to reveal an intrinsic gradient contribution pattern of different samples; (2) a novel SCP-based optimizing algorithm (SCPOA) that outperforms alternative tested algorithms in terms of computation overhead; (3) a variant of SCPOA that incorporates discarding-recovering mechanisms to carefully tradeoff between model accuracy and computation cost; (4) the implementation and evaluation of two algorithms based on popular distributed big data mining platforms running typical sample-sets; (5) intuitive convergence proof of the algorithms. Our experimental results illustrate that the proposed approaches can significantly reduce the computation cost with competitive accuracy.

Mining Constrained Cube Gradient for Materialized Cube

Mining Constrained Cube Gradient Using Condensed Cube

The mining of fuzzy gradient in the case of materialized cube

The Incremental Mining of Constrained Cube Gradients

The Research of the Cube Gradient Mining

Significant Gradients Mining Based on Data Cube Computation

OLGM: AN ONLINE CUBE GRADIENT MINING TOOL

Mining Spatial Co-Location Patterns With Dynamic Neighborhood Constraint

Requirement-Based Data Cube Schema Design

SCANCHUNK:AN EFFICIENT ALGORITHM FOR HUNTING DENSE REGIONS IN DATA CUBE

Convergence of Projected Subgradient Method with Sparse or Low-Rank Constraints

Strategies for Complex Data Cube Queries

A Clustered Dwarf Structure to Speed Up Queries on Data Cubes

Closed Constrained Gradient Mining in Retail Databases

A Cube Analytical Mining Framework for Stream Data

Mining Interestingness Sub-cubes in Multi-dimensional Data

Spatial Data Cube: Provides Better Support for Spatial Data Mining

Extended Derivation Cube Based View Materialization Selection in Distributed Data Warehouse

SAQP++: Bridging the Gap Between Sampling-Based Approximate Query Processing and Aggregate Precomputation.

Sample Contribution Pattern Based Big Data Mining Optimization Algorithms

Regression Cubes with Lossless Compression and Aggregation