The investigation of basic processes of rapidly hardening wood-cement-water mixture with CO2

H. Qi,P. Cooper,D. Hooton

DOI: https://doi.org/10.1007/s00107-009-0351-z

2010-02-01

European Journal of Wood and Wood Products

Abstract:

What problem does this paper attempt to address?

Probabilistic Analysis for the Random Assignment Problem

SU Zhong-gen

DOI: https://doi.org/10.3969/j.issn.1000-0917.2005.02.002

IF: 1.675

2005-01-01

Advances in Mathematics

Abstract:Suppose that (ti,j)1≤i,j≤n is an n×n cost matrix of independent exponential random variables with parameter 1. Consider the optimal assignment cost Ane =: minπ sum from i=1 to n=1 ti,π(i), where π = (π(1),…,π(n)) is a permutation of 1,2,… ,n. This paper reviews some recent developments on EAne, and the focus will be upon Aldous' objective methods and local weak convergence, as well as the celebrated Parisi conjecture with proofs. Several challenging mathematical problems are presented at the end of the paper.
Physicist's view on the unbalanced k-cardinality assignment problem

Patrice Koehl,Henri Orland

DOI: https://doi.org/10.1103/PhysRevE.110.014108

Abstract:The k-cardinality unbalanced assignment problem asks for assigning k "agents" to k "tasks" on a one-to-one basis, while minimizing the total cost associated with the assignment, with the total number of agents N and the total number of tasks M possibly different and larger than k. While many exact algorithms have been proposed to find such an optimal assignment, these methods are computationally prohibitive when the problem is large. We propose an approach to solving the k-cardinality assignment problem using techniques adapted from statistical physics. This paper provides a full description of this formalism, including all the proofs of its main claims. We derive a strongly concave free-energy function that captures the constraints of the k-assignment problem at a finite temperature. We prove that this free energy decreases monotonically as a function of β, the inverse of temperature, to the optimal assignment cost, providing a robust framework for temperature annealing. We also prove that for large enough β values the exact solution to the k-assignment problem can be derived using simple round-off to the nearest integer of the elements of the computed assignment matrix. We show that this framework can be adapted to handle degenerate k-assignment problems. We describe a computer implementation of our framework that is optimized for the GPU parallel architecture, using the library CUDA. This implementation is found to be as efficient as state-of-the-art implementations of parallel Hungarian algorithms on generic assignment problems, and orders of magnitude faster than those algorithms for pathological assignment cases.
A novel stochastic method with modified extremal optimization and nearest neighbor search for hard combinatorial problems

Guo-Qiang Zeng,Yong-Zai Lu,Wei-Jie Mao

DOI: https://doi.org/10.1109/WCICA.2010.5554748

2010-01-01

Intelligent Control and Automation

Abstract:The combinatorial optimization occurs in many real-world problems including the fields of engineering, physics and economics. It has been recognized that some problems with highly degenerate states are difficult to solve in terms of many existing optimization algorithms. This paper proposes a novel stochastic method with modified extremal optimization (EO) and nearest neighbor search to deal with these problems. It starts from making use of the recent discovered statistical property to generate the initial configurations by the nearest neighbor search and then further explores the complex configuration spaces by a modified EO approach that applies more general probability distributions-based evolution mechanism. The experimental results with some hard instances of traveling salesman problem (TSP), a popular benchmark for combinatorial optimization problems demonstrate that the proposed method may provide better performance than other physics-inspired algorithms such as simulated annealing, EO and self-organized algorithm.
A Parallel Function Evaluation Approach for Solution to Large-Scale Equation-Oriented Models.

Yannan Ma,Zhijiang Shao,Xi Chen,Lorenz T. Biegler

DOI: https://doi.org/10.1016/j.compchemeng.2016.07.015

IF: 4.13

2016-01-01

Computers & Chemical Engineering

Abstract:The equation-oriented (EO) approach is widely used for process simulation and optimization. Nevertheless, large-scale EO models consist of a huge number of nonlinear equations and make the solution procedure a challenging and time-consuming task. For most gradient-based numerical algorithms, function evaluations are the dominant step during the solution procedure. Here, a parallel computation method is developed for function evaluations within EO optimization strategies. After dividing the equations into several groups, function evaluations are calculated by using multiple threads on a parallel hardware platform simultaneously. Theoretical analysis for the speedup ratio is conducted. The implementation of the proposed method on a multi-core processor platform as well as a graphics processing unit (GPU) platform is then presented with several case studies. Numerical results are compared and discussed to show that the multi-core processor implementation has good computational performance, whereas the GPU implementation only achieves computational acceleration under relatively specific conditions.
Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

Jinming Xu,Ye Tian,Ying Sun,Gesualdo Scutari

DOI: https://doi.org/10.1109/tsp.2021.3086579

IF: 4.875

2021-01-01

IEEE Transactions on Signal Processing

Abstract:We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic framework for such a class of problems and provide a unified convergence analysis leveraging the theory of operator splitting. Distinguishing features of our scheme are: (i) When the agents' functions are strongly convex, the algorithm converges at a linear rate, whose dependence on the agents' functions and network topology is decoupled, matching the typical rates of centralized optimization; the rate expression improves on existing results; (ii) When the objective function is convex (but not strongly convex), similar separation as in (i) is established for the coefficient of the proved sublinear rate; (iii) The algorithm can adjust the ratio between the number of communications and computations to achieve a rate (in terms of computations) independent on the network connectivity; and (iv) A by-product of our analysis is a tuning recommendation for several existing (non accelerated) distributed algorithms yielding the fastest provably (worst-case) convergence rate. This is the first time that a general distributed algorithmic framework applicable to composite optimization enjoys all such properties.
A Bilevel Decomposition Approach for Many Homogeneous Computing Tasks Scheduling in Software-Defined Industrial Networks

Yong Wang,Yixiong Feng,Xuanzhi Jin,Yiping Feng,Zhiwu Li,Jianrong Tan

DOI: https://doi.org/10.1109/tii.2022.3188347

IF: 12.3

2023-01-01

IEEE Transactions on Industrial Informatics

Abstract:To confront the great challenge of industrial big data, the software-defined industrial networks (SDINs) are introduced to dynamically coordinate these data flows among the heterogeneous and distributed computing resources. Deciding how to more efficiently schedule many homogeneous computing tasks, which extensively appear in SDIN, becomes of critical importance. To this end, this article first illustrates some related notations and assumptions of the homogeneous computing tasks and computing networks, from which a new targeted optimization model is formulated. Then, the model is significantly enhanced by reformulating all the nonlinear constraints and inventively establishing the symmetry-breaking constraints and computation time cuts. Furthermore, considering the computational complexity, the scheduling process with many homogeneous computing tasks is further viewed as two associated phases: computing nodes assignment and tasks sequencing. As a result, a novel bilevel decomposition algorithm is proposed using Lagrangian decomposition and a new form of Lagrangian relaxation. Finally, a real industrial scenario is chosen, and three comparison algorithms are used to demonstrate the preponderant performance of the proposed algorithm.
An Algorithm for the Assignment Game Beyond Additive Valuations

Eric Balkanski,Christopher En,Yuri Faenza

2024-06-19

Abstract:The assignment game, introduced by Shapley and Shubik (1971), is a classic model for two-sided matching markets between buyers and sellers. In the original assignment game, it is assumed that payments lead to transferable utility and that buyers have unit-demand valuations for the items being sold. Two important and mostly independent lines of work have studied more general settings with imperfectly transferable utility and gross substitutes valuations. Multiple efficient algorithms have been proposed for computing a competitive equilibrium, the standard solution concept in assignment games, in these two settings. Our main result is an efficient algorithm for computing competitive equilibria in a setting with both imperfectly transferable utility and gross substitutes valuations. Our algorithm combines augmenting path techniques from maximum matching and algorithms for matroid intersection. We also show that, in a mild generalization of our model, computing a competitive equilibrium is NP-hard.

Discrete Mathematics,Computer Science and Game Theory
An explicit analysis of the entropic penalty in linear programming

Jonathan Weed

DOI: https://doi.org/10.48550/arXiv.1806.01879

2018-06-06

Abstract:Solving linear programs by using entropic penalization has recently attracted new interest in the optimization community, since this strategy forms the basis for the fastest-known algorithms for the optimal transport problem, with many applications in modern large-scale machine learning. Crucial to these applications has been an analysis of how quickly solutions to the penalized program approach true optima to the original linear program. More than 20 years ago, Cominetti and San Martín showed that this convergence is exponentially fast; however, their proof is asymptotic and does not give any indication of how accurately the entropic program approximates the original program for any particular choice of the penalization parameter. We close this long-standing gap in the literature regarding entropic penalization by giving a new proof of the exponential convergence, valid for any linear program. Our proof is non-asymptotic, yields explicit constants, and has the virtue of being extremely simple. We provide matching lower bounds and show that the entropic approach does not lead to a near-linear time approximation scheme for the linear assignment problem.

Optimization and Control,Machine Learning
On the convergence of graph matching: graduated assignment revisited

Yu Tian,Junchi Yan,Hequan Zhang,Ya Zhang,Xiaokang Yang,Hongyuan Zha

DOI: https://doi.org/10.1007/978-3-642-33712-3_59

2012-01-01

Abstract:We focus on the problem of graph matching that is fundamental in computer vision and machine learning. Many state-of-the-arts frequently formulate it as integer quadratic programming, which incorporates both unary and second-order terms. This formulation is in general NP-hard thus obtaining an exact solution is computationally intractable. Therefore most algorithms seek the approximate optimum by relaxing techniques. This paper commences with the finding of the "circular" character of solution chain obtained by the iterative Gradient Assignment (via Hungarian method) in the discrete domain, and proposes a method for guiding the solver converging to a fixed point, resulting a convergent algorithm for graph matching in discrete domain. Furthermore, we extend the algorithms to their counterparts in continuous domain, proving the classical graduated assignment algorithm will converge to a double-circular solution chain, and the proposed Soft Constrained Graduated Assignment (SCGA) method will converge to a fixed (discrete) point, both under wild conditions. Competitive performances are reported in both synthetic and real experiments.
GPU-accelerated Parallel Solutions to the Quadratic Assignment Problem

Clara Novoa,Apan Qasem

2023-07-21

Abstract:The Quadratic Assignment Problem (QAP) is an important combinatorial optimization problem with applications in many areas including logistics and manufacturing. QAP is known to be NP-hard, a computationally challenging problem, which requires the use of sophisticated heuristics in finding acceptable solutions for most real-world data sets. In this paper, we present GPU-accelerated implementations of a 2opt and a tabu search algorithm for solving the QAP. For both algorithms, we extract parallelism at multiple levels and implement novel code optimization techniques that fully utilize the GPU hardware. On a series of experiments on the well-known QAPLIB data sets, our solutions, on average run an order-of-magnitude faster than previous implementations and deliver up to a factor of 63 speedup on specific instances. The quality of the solutions produced by our implementations of 2opt and tabu is within 1.03% and 0.15% of the best known values. The experimental results also provide key insight into the performance characteristics of accelerated QAP solvers. In particular, the results reveal that both algorithmic choice and the shape of the input data sets are key factors in finding efficient implementations.

Distributed, Parallel, and Cluster Computing,Mathematical Software
Dynamic Combinatorial Assignment

Thành Nguyen,Alexander Teytelboym,Shai Vardi

2023-03-24

Abstract:We study a model of dynamic combinatorial assignment of indivisible objects without money. We introduce a new solution concept called ``dynamic approximate competitive equilibrium from equal incomes'' (DACEEI), which stipulates that markets must approximately clear in almost all time periods. A naive repeated application of approximate competitive equilibrium from equal incomes (Budish, 2011) does not yield a desirable outcome because the approximation error in market-clearing compounds quickly over time. We therefore develop a new version of the static approximate competitive equilibrium from carefully constructed random budgets which ensures that, in expectation, markets clear exactly. We then use it to design the ``online combinatorial assignment mechanism'' (OCAM) which implements a DACEEI with high probability. The OCAM is (i) group-strategyproof up to one object (ii) envy-free up to one object for almost all agents (iii) approximately market-clearing in almost all periods with high probability when the market is large and arrivals are random. Applications include refugee resettlement, daycare assignment, and airport slot allocation.

Theoretical Economics,Computer Science and Game Theory
Random Assignment Method Based on Dynamic Constraint and Genetic Algorithm

Fachao Li,Chenxia Jin,Limin Liu

DOI: https://doi.org/10.1109/ICICIC.2007.472

2007-01-01

Abstract:In this paper, by using the dynamic relationship between mathematical expectation and variance and the compound quantitative description of random variable, an instructive solution model for random assignment problem has been developed; combining the characteristic of assignment problem, give the concrete scheme based on genetic algrithm (denoted by B.DC(S)GA-RAM, for short); finally, consider its convergence using Markov chain theory, and analyze its performance through an example. All these indicate that, this solution model can effectively merge decision consciousness into the assignment process, posses interesting features of strong interpretability, easy operation and higher computation efficiency, so it can be widely used in many fields.
Experimental analysis of algorithms for the Independent quadratic assignment problem

Wei Yang,Yang Wang,Ante Ćustić,Abraham P. Punnen

DOI: https://doi.org/10.1016/j.cor.2024.106704

IF: 5.159

2024-05-18

Computers & Operations Research

Abstract:The independent quadratic assignment problem is a variation of the well-known Koopmans-Beckman quadratic assignment problem. The model has a wide variety of applications but it is strongly NP-hard and is also hard to approximate. In this paper we present innovative and simple heuristic algorithms to optimize the problem based on the paradigms of local search, very large-scale neighborhood (VLSN) search, and local search with path-relinking. The performance of these algorithms are analyzed using results generated by extensive computational experiments. Our experimental study highlights that the strategies of path-relinking and VLSN search when worked in unison produced superior outcomes, outperforming algorithms that employ these strategies individually. This underscores the power of hybrid algorithmic approaches in solving complex optimization problems, in particular, the independent quadratic assignment problem. This is the first experimental study available on the independent quadratic assignment problem. We also have constructed (and made available) test instances with different characteristics which can be used as benchmarks in future experimental studies on the problem.

computer science, interdisciplinary applications,engineering, industrial,operations research & management science
Efficient Combinatorial Optimization via Heat Diffusion

Hengyuan Ma,Wenlian Lu,Jianfeng Feng

2024-09-26

Abstract:Combinatorial optimization problems are widespread but inherently challenging due to their discrete nature. The primary limitation of existing methods is that they can only access a small fraction of the solution space at each iteration, resulting in limited efficiency for searching the global optimal. To overcome this challenge, diverging from conventional efforts of expanding the solver's search scope, we focus on enabling information to actively propagate to the solver through heat diffusion. By transforming the target function while preserving its optima, heat diffusion facilitates information flow from distant regions to the solver, providing more efficient navigation. Utilizing heat diffusion, we propose a framework for solving general combinatorial optimization problems. The proposed methodology demonstrates superior performance across a range of the most challenging and widely encountered combinatorial optimizations. Echoing recent advancements in harnessing thermodynamics for generative artificial intelligence, our study further reveals its significant potential in advancing combinatorial optimization.

Machine Learning,Combinatorics,Applied Physics
The Random Quadratic Assignment Problem

Gerald Paul,Jia Shao,H. Eugene Stanley

DOI: https://doi.org/10.1007/s10955-011-0308-6

2011-01-05

Abstract:Optimal assignment of classes to classrooms \cite{dickey}, design of DNA microarrays \cite{carvalho}, cross species gene analysis \cite{kolar}, creation of hospital layouts cite{elshafei}, and assignment of components to locations on circuit boards \cite{steinberg} are a few of the many problems which have been formulated as a quadratic assignment problem (QAP). Originally formulated in 1957, the QAP is one of the most difficult of all combinatorial optimization problems. Here, we use statistical mechanical methods to study the asymptotic behavior of problems in which the entries of at least one of the two matrices that specify the problem are chosen from a random distribution $P$. Surprisingly, this case has not been studied before using statistical methods despite the fact that the QAP was first proposed over 50 years ago \cite{Koopmans}. We find simple forms for $C_{\rm min}$ and $C_{\rm max}$, the costs of the minimal and maximum solutions respectively. Notable features of our results are the symmetry of the results for $C_{\rm min}$ and $C_{\rm max}$ and the dependence on $P$ only through its mean and standard deviation, independent of the details of $P$. After the asymptotic cost is determined for a given QAP problem, one can straightforwardly calculate the asymptotic cost of a QAP problem specified with a different random distribution $P$.

Statistical Mechanics,Combinatorics
Fast computation of global solutions to the single-period unit commitment problem

Cheng Lu,Zhibin Deng,Shu-Cherng Fang,Qingwei Jin,Wenxun Xing

DOI: https://doi.org/10.1007/s10878-019-00489-9

2019-01-01

Journal of Combinatorial Optimization

Abstract:The single-period unit commitment problem has significant applications in electricity markets. An efficient global algorithm not only provides the optimal schedule that achieves the lowest cost, but also plays an important role for deriving the market-clearing price. As of today, the problem is mainly solved by using a general-purpose mixed-integer quadratic programming solver such as CPLEX or Gurobi. This paper proposes an extremely efficient global optimization algorithm for solving the problem. We propose a conjugate function based convex relaxation and design a special dual algorithm to compute a tight lower bound of the problem in 𝒪(nlog n) complexity. Then, a branch-and-bound algorithm is designed for finding a global solution to the problem. Computational experiments show that the proposed algorithm solves test instances with 500 integer variables in less than 0.01 s, whereas current state-of-the-art solvers fail to solve the same test instances in one hour. This superior performance of the proposed algorithm clearly indicates its potential in day-ahead and real-time electricity markets.
Game-theoretical approach for task allocation problems with constraints

Chunxia Liu,Kaihong Lu,Xiaojie Chen,Attila Szolnoki

2023-08-21

Abstract:The distributed task allocation problem, as one of the most interesting distributed optimization challenges, has received considerable research attention recently. Previous works mainly focused on the task allocation problem in a population of individuals, where there are no constraints for affording task amounts. The latter condition, however, cannot always be hold. In this paper, we study the task allocation problem with constraints of task allocation in a game-theoretical framework. We assume that each individual can afford different amounts of task and the cost function is convex. To investigate the problem in the framework of population games, we construct a potential game and calculate the fitness function for each individual. We prove that when the Nash equilibrium point in the potential game is in the feasible solutions for the limited task allocation problem, the Nash equilibrium point is the unique globally optimal solution. Otherwise, we also derive analytically the unique globally optimal solution. In addition, in order to confirm our theoretical results, we consider the exponential and quadratic forms of cost function for each agent. Two algorithms with the mentioned representative cost functions are proposed to numerically seek the optimal solution to the limited task problems. We further perform Monte Carlo simulations which provide agreeing results with our analytical calculations.

Computer Science and Game Theory,Optimization and Control
On Finding Stable and Efficient Solutions for the Team Formation Problem

Hoda Atef Yekta,David Bergman,Robert Day

DOI: https://doi.org/10.48550/arXiv.1804.00309

2018-04-01

Optimization and Control

Abstract:The assignment of personnel to teams is a fundamental and ubiquitous managerial function, typically involving several objectives and a variety of idiosyncratic practical constraints. Despite the prevalence of this task in practice, the process is seldom approached as a precise optimization problem over the reported preferences of all agents. This is due in part to the underlying computational complexity that occurs when quadratic (i.e., intra-team interpersonal) interactions are taken into consideration, and also due to game-theoretic considerations, when those taking part in the process are self-interested agents. Variants of this fundamental decision problem arise in a number of settings, including, for example, human resources and project management, military platooning, sports-league management, ride sharing, data clustering, and in assigning students to group projects. In this paper, we study a mathematical-programming approach to "team formation" focused on the interplay between two of the most common objectives considered in the related literature: economic efficiency (i.e., the maximization of social welfare) and game-theoretic stability (e.g., finding a core solution when one exists). With a weighted objective across these two goals, the problem is modeled as a bi-level binary optimization problem, and transformed into a single-level, exponentially sized binary integer program. We then devise a branch-cut-and-price algorithms and demonstrate its efficacy through an extensive set of simulations, with favorable comparisons to other algorithms from the literature.
New Auction Algorithms for the Assignment Problem and Extensions

Dimitri Bertsekas

2023-10-22

Abstract:We consider the classical linear assignment problem, and we introduce new auction algorithms for its optimal and suboptimal solution. The algorithms are founded on duality theory, and are related to ideas of competitive bidding by persons for objects and the attendant market equilibrium, which underlie real-life auction processes. We distinguish between two fundamentally different types of bidding mechanisms: aggressive and cooperative. Mathematically, aggressive bidding relies on a notion of approximate coordinate descent in dual space, an epsilon-complementary slackness condition to regulate the amount of descent approximation, and the idea of epsilon-scaling to resolve efficiently the price wars that occur naturally as multiple bidders compete for a smaller number of valuable objects. Cooperative bidding avoids price wars through detection and cooperative resolution of any competitive impasse that involves a group of persons. We discuss the relations between the aggressive and the cooperative bidding approaches, we derive new algorithms and variations that combine ideas from both of them, and we also make connections with other primal-dual methods, including the Hungarian method. Furthermore, our discussion points the way to algorithmic extensions that apply more broadly to network optimization, including shortest path, max-flow, transportation, and minimum cost flow problems with both linear and convex cost functions.

Computer Science and Game Theory
Greedy Algorithms for Cone Constrained Optimization with Convergence Guarantees

Francesco Locatello,Michael Tschannen,Gunnar Rätsch,Martin Jaggi

DOI: https://doi.org/10.48550/arXiv.1705.11041

IF: 5.414

2017-05-31

Machine Learning

Abstract:Greedy optimization methods such as Matching Pursuit (MP) and Frank-Wolfe (FW) algorithms regained popularity in recent years due to their simplicity, effectiveness and theoretical guarantees. MP and FW address optimization over the linear span and the convex hull of a set of atoms, respectively. In this paper, we consider the intermediate case of optimization over the convex cone, parametrized as the conic hull of a generic atom set, leading to the first principled definitions of non-negative MP algorithms for which we give explicit convergence rates and demonstrate excellent empirical performance. In particular, we derive sublinear ($\mathcal{O}(1/t)$) convergence on general smooth and convex objectives, and linear convergence ($\mathcal{O}(e^{-t})$) on strongly convex objectives, in both cases for general sets of atoms. Furthermore, we establish a clear correspondence of our algorithms to known algorithms from the MP and FW literature. Our novel algorithms and analyses target general atom sets and general objective functions, and hence are directly applicable to a large variety of learning settings.

The investigation of basic processes of rapidly hardening wood-cement-water mixture with CO2

Probabilistic Analysis for the Random Assignment Problem

Physicist's view on the unbalanced k-cardinality assignment problem

A novel stochastic method with modified extremal optimization and nearest neighbor search for hard combinatorial problems

A Parallel Function Evaluation Approach for Solution to Large-Scale Equation-Oriented Models.

Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis

A Bilevel Decomposition Approach for Many Homogeneous Computing Tasks Scheduling in Software-Defined Industrial Networks

An Algorithm for the Assignment Game Beyond Additive Valuations

An explicit analysis of the entropic penalty in linear programming

On the convergence of graph matching: graduated assignment revisited

GPU-accelerated Parallel Solutions to the Quadratic Assignment Problem

Dynamic Combinatorial Assignment

Random Assignment Method Based on Dynamic Constraint and Genetic Algorithm

Experimental analysis of algorithms for the Independent quadratic assignment problem

Efficient Combinatorial Optimization via Heat Diffusion

The Random Quadratic Assignment Problem

Fast computation of global solutions to the single-period unit commitment problem

Game-theoretical approach for task allocation problems with constraints

On Finding Stable and Efficient Solutions for the Team Formation Problem

New Auction Algorithms for the Assignment Problem and Extensions

Greedy Algorithms for Cone Constrained Optimization with Convergence Guarantees