Abstract:In this paper, we consider a class of nonconvex (not necessarily differentiable) optimization problems called generalized Difference-of-Convex functions (DC) programs, which is minimizing the sum of two separable DC parts and one two-block-variable coupling function. To circumvent the nonconvexity and nonseparability of the problem under consideration, we accordingly introduce a unified Bregman alternating minimization algorithm by maximally exploiting the favorable DC structure of the objective. Specifically, we first follow the spirit of alternating minimization to update each block variable in a sequential order, which can efficiently tackle the nonseparablitity caused by the coupling function. Then, we employ the Fenchel–Young inequality to approximate the second DC components (i.e., concave parts) so that each subproblem reduces to a convex optimization problem, thereby alleviating the computational burden of the nonconvex DC parts. Moreover, each subproblem absorbs a Bregman proximal regularization term, which is usually beneficial for inducing closed-form solutions of subproblems for many cases via choosing appropriate Bregman kernel functions. It is remarkable that our algorithm not only provides an algorithmic framework to understand the iterative schemes of some recently proposed algorithms, but also enjoys implementable schemes with easier subproblems than some state-of-the-art first-order algorithms developed for generic nonconvex and nonsmooth optimization problems. Theoretically, we prove that the sequence generated by our algorithm globally converges to a critical point under the Kurdyka–Łojasiewicz (KŁ) condition. Besides, we estimate the local convergence rates of our algorithm when we further know the prior information of the KŁ exponent. A series of numerical experiments on imaging data demonstrate the reliability and efficiency of the proposed algorithmic framework.

Bregman-divergence-based Arimoto-Blahut algorithm

Generalized quantum Arimoto-Blahut algorithm and its application to quantum information bottleneck

Variations on a Theme by Blahut and Arimoto

A Bregman Proximal Perspective on Classical and Quantum Blahut-Arimoto Algorithms

On the Rate of Convergence by Generalized Baskakov Operators

A Constrained BA Algorithm for Rate-Distortion and Distortion-Rate Functions

Reverse em-problem based on Bregman divergence and its application to classical and quantum information theory

Computing the optimal error exponential function for fixed-length lossy coding in discrete memoryless sources

Computation of Rate-Distortion-Perception Function under f-Divergence Perception Constraints

The Convergence of the Geometric Interpolation Algorithm.

Alternating Minimization Schemes for Computing Rate-Distortion-Perception Functions with $f$-Divergence Perception Constraints

Iterative minimization algorithm on a mixture family

Delay-tolerant distributed Bregman proximal algorithms

Revisit the Arimoto-Blahut algorithm: New Analysis with Approximation

A Unified Bregman Alternating Minimization Algorithm for Generalized DC Programs with Application to Imaging

A unified law of robustness for Bregman divergence losses

A Parametric Generalization of the Baskakov-Schurer-Szász-Stancu Approximation Operators

A Bregman Projection Algorithm with Self Adaptive Step Sizes for Split Variational Inequality Problems Involving Non-Lipschitz Operators

Regularized Rényi divergence minimization through Bregman proximal gradient algorithms

Blahut–Arimoto Algorithms for Inner and Outer Bounds on Capacity Regions of Broadcast Channels