Support of Non-separable Multivariate Scaling Function

Irina Maximenko

DOI: https://doi.org/10.48550/arXiv.0801.0213

2007-12-31

Abstract:We make an estimation of the support of a multivariable scaling function for an arbitrary dilation matrix. We give a method of calculating the values of the scaling function on a tight set using the knowledge of the size of the support.

Classical Analysis and ODEs

What problem does this paper attempt to address?

Supports of Fourier Transforms of Scaling Functions

Zhihua Zhang

DOI: https://doi.org/10.1016/j.acha.2006.05.007

IF: 2.974

2006-01-01

Applied and Computational Harmonic Analysis

Abstract:We characterize the support G of the Fourier transform of the band-limited scaling function and give an approach to the construction of the scaling function. Based on the relations of translates of three point sets G, 12G and G∖12G, we reveal an essential difference of scaling functions corresponding to MRA, weakly translation invariant MRA and translation invariant MRA. Moreover, we consider the case that support of the Fourier transform of the scaling function is a convex set. Finally, we show that the support of Fourier transform of any scaling function cannot be a closed ball.
Elliptic scaling functions as compactly supported multivariate analogs of the B-splines

Victor G. Zakharov

DOI: https://doi.org/10.48550/arXiv.1311.1020

2013-11-05

Abstract:In the paper, we present a family of multivariate compactly supported scaling functions, which we call as elliptic scaling functions. The elliptic scaling functions are the convolution of elliptic splines, which correspond to homogeneous elliptic differential operators, with distributions. The elliptic scaling functions satisfy refinement relations with real isotropic dilation matrices. The elliptic scaling functions satisfy most of the properties of the univariate cardinal B-splines: compact support, refinement relation, partition of unity, total positivity, order of approximation, convolution relation, Riesz basis formation (under a restriction on the mask), etc. The algebraic polynomials contained in the span of integer shifts of any elliptic scaling function belong to the null-space of a homogeneous elliptic differential operator. Similarly to the properties of the B-splines under differentiation, it is possible to define elliptic (not necessarily differential) operators such that the elliptic scaling functions satisfy relations with these operators. In particular, the elliptic scaling functions can be considered as a composition of segments, where the function inside a segment, like a polynomial in the case of the B-splines, vanishes under the action of the introduced operator.

Classical Analysis and ODEs,Numerical Analysis
BIVARIATE NONSEPARABLE SCALING FUNCTION

SZ Yang,ZX Cheng,XX Feng

DOI: https://doi.org/10.1142/9789812796769_0017

2003-01-01

Abstract:A new approach is presented for constructing bivariate nonseparable scaling function by an arbitrary bivariate orthogonal scaling function. i.e., the bivariate nonseparable scaling function can be constructed by the tensor product of two 1-dimensional orthogonal scaling functions. The scaling function generated by our method possesses the interposition property. Based on the scaling function,the Shannon's type sampling theorem on approximation subspace is established easily.
Nonseparable Orthogonal Scaling Functions of L-2(R-N)

SZ Yang,ZX Cheng

DOI: https://doi.org/10.1142/9789812702654_0078

2004-01-01

Abstract:A general method for the construction of nonseparable orthogonal scaling functions with dilation M = alphaI(n) where alpha greater than or equal to 2, and alpha is an element of Z is presented. The wavelets can obtain a more flexible tiling of the time-scale space than in the case alpha = 2. What is more, the approach of this paper can be generalized to construct wavelets related to a general dilation matrix.
Multiscale Support Vector Regression Method in Sobolev Spaces on Bounded Domains

Boxi Xu,Shuai Lu,Min Zhong

DOI: https://doi.org/10.1080/00036811.2014.918261

2014-01-01

Applicable Analysis

Abstract:In this paper, we investigate the multiscale support vector regression (SVR) method for approximation of functions in Sobolev spaces on bounded domains. The Vapnik epsilon-intensive loss function, which has been developed well in learning theory, is introduced to replace the standard l(2) loss function in multiscale least squares methods. Convergence analysis is presented to verify the validity of the multiscale SVR method with scaled versions of compactly supported radial basis functions. Error estimates on noisy observation data are also derived to show the robustness of our proposed algorithm. Numerical simulations support the theoretical predictions.
Scaling the kernel function to improve performance of the support vector machine

Peter Williams,Sheng Li,Jianfeng Feng,Si Wu

DOI: https://doi.org/10.1007/11427391_133

2005-01-01

Abstract:The present study investigates a geometrical method for optimizing the kernel function of a support vector machine. The method is an improvement of the one proposed in [4,5]. It consists of using prior knowledge obtained from conventional SVM training to conformally rescale the initial kernel function, so that the separation between two classes of data is effectively enlarged. It turns out that the new algorithm works efficiently, has few free parameters, consumes very low computational cost, and overcomes the susceptibility of the original method.
On eigenvalues and eigenfunctions of the operators defining multidimensional scaling on some symmetric spaces

Tianyu Ma,Eugene Stepanov

2024-01-22

Abstract:We study asymptotics of the eigenvalues and eigenfunctions of the operators used for constructing multidimensional scaling (MDS) on compact connected Riemannian manifolds, in particular on closed connected symmetric spaces. They are the limits of eigenvalues and eigenvectors of squared distance matrices of an increasing sequence of finite subsets covering the space densely in the limit. We show that for products of spheres and real projective spaces, the numbers of positive and negative eigenvalues of these operators are both infinite. We also find a class of spaces (namely $\mathbb{RP}^n$ with odd $n>1$) whose MDS defining operators are not trace class, and original distances cannot be reconstructed from the eigenvalues and eigenfunctions of these operators.

Metric Geometry
Estimating the Support of a High-Dimensional Distribution

Bernhard Schlkopf,John C. Platt,John Shawe-Taylor,Alex J. Smola,Robert C. Williamson,Bernhard Schölkopf

DOI: https://doi.org/10.1162/089976601750264965

IF: 3.278

2001-07-01

Neural Computation

Abstract:Suppose you are given some data set drawn from an underlying probability distribution P and you want to estimate a “simple” subset S of input space such that the probability that a test point drawn from P lies outside of S equals some a priori specified value between 0 and 1. We propose a method to approach this problem by trying to estimate a function f that is positive on S and negative on the complement. The functional form of f is given by a kernel expansion in terms of a potentially small subset of the training data; it is regularized by controlling the length of the weight vector in an associated feature space. The expansion coefficients are found by solving a quadratic programming problem, which we do by carrying out sequential optimization over pairs of input patterns. We also provide a theoretical analysis of the statistical performance of our algorithm. The algorithm is a natural extension of the support vector algorithm to the case of unlabeled data.

computer science, artificial intelligence,neurosciences
Construction of bivariate nonseparable compactly supported orthogonal wavelets

Jinsong Leng,Tingzhu Huang,Carlo Cattani

DOI: https://doi.org/10.1155/2013/624957

IF: 1.43

2013-01-01

Mathematical Problems in Engineering

Abstract:A method for constructing bivariate nonseparable compactly supported orthogonal scaling functions, and the corresponding wavelets, using the dilation matrix M := 2(n)I = 2(n) [(1 0)(0 1)], (d = detM = 2(2n) > 4, n is an element of N) is given. The accuracy and smoothness of the scaling functions are studied, thus showing that they have the same accuracy order as the univariate Daubechies low-pass filter m(0)(omega), to be used in our method. There follows that the wavelets can be made arbitrarily smooth by properly choosing the accuracy parameter r.
Least Squares Support Vector Machine Based on Scaling Kernel Function

Fang-Fang WU,Yin-Liang ZHAO

DOI: https://doi.org/10.3969/j.issn.1003-6059.2006.05.007

2006-01-01

Abstract:The kernel function of support vector machine (SVM) is an important factor to the learning result of SVM. Based on the wavelet decomposition and conditions of the support vector kernel function, a new scaling kernel function for SVM (SSVM) is proposed. This function is not only a kind of horizontal floating orthonormal function, but also can simulate any curve in quadratic continuous integral space, thus it enhances the generalization ability of the SVM. According to the scaling kernel function and the regularization theory, a least squares support vector machine on scaling kernel function (LS-SSVM) is proposed to simplify the solving process of SSVM. The LS-SSVM is then applied to the regression analysis and classification. Experimental results show that the precision of regression is improved, compared with LS-SVM whose kernel function is Gauss function.
Variational Multiscale Nonparametric Regression: Smooth Functions

Markus Grasmair,Housen Li,Axel Munk

DOI: https://doi.org/10.1214/17-AIHP832

2015-12-03

Abstract:For the problem of nonparametric regression of smooth functions, we reconsider and analyze a constrained variational approach, which we call the MultIscale Nemirovski-Dantzig (MIND) estimator. This can be viewed as a multiscale extension of the Dantzig selector (\emph{Ann. Statist.}, 35(6): 2313--51, 2009) based on early ideas of Nemirovski (\emph{J. Comput. System Sci.}, 23:1--11, 1986). MIND minimizes a homogeneous Sobolev norm under the constraint that the multiresolution norm of the residual is bounded by a universal threshold. The main contribution of this paper is the derivation of convergence rates of MIND with respect to $L^q$-loss, $1 \le q \le \infty$, both almost surely and in expectation. To this end, we introduce the method of approximate source conditions. For a one-dimensional signal, these can be translated into approximation properties of $B$-splines. A remarkable consequence is that MIND attains almost minimax optimal rates simultaneously for a large range of Sobolev and Besov classes, which provides certain adaptation. Complimentary to the asymptotic analysis, we examine the finite sample performance of MIND by numerical simulations.

Statistics Theory
Signed Support Recovery for Single Index Models in High-Dimensions

Matey Neykov,Qian Lin,Jun S. Liu

DOI: https://doi.org/10.4310/amsa.2016.v1.n2.a5

2016-01-01

Annals of Mathematical Sciences and Applications

Abstract:In this paper we study the support recovery problem for single index models $Y=f(\boldsymbol{X}^{\intercal} \boldsymbol{\beta},\varepsilon)$, where $f$ is an unknown link function, $\boldsymbol{X}\sim N_p(0,\mathbb{I}_{p})$ and $\boldsymbol{\beta}$ is an $s$-sparse unit vector such that $\boldsymbol{\beta}_{i}\in \{\pm\frac{1}{\sqrt{s}},0\}$. In particular, we look into the performance of two computationally inexpensive algorithms: (a) the diagonal thresholding sliced inverse regression (DT-SIR) introduced by Lin et al. (2015); and (b) a semi-definite programming (SDP) approach inspired by Amini & Wainwright (2008). When $s=O(p^{1-\delta})$ for some $\delta>0$, we demonstrate that both procedures can succeed in recovering the support of $\boldsymbol{\beta}$ as long as the rescaled sample size $\kappa=\frac{n}{s\log(p-s)}$ is larger than a certain critical threshold. On the other hand, when $\kappa$ is smaller than a critical value, any algorithm fails to recover the support with probability at least $\frac{1}{2}$ asymptotically. In other words, we demonstrate that both DT-SIR and the SDP approach are optimal (up to a scalar) for recovering the support of $\boldsymbol{\beta}$ in terms of sample size. We provide extensive simulations, as well as a real dataset application to help verify our theoretical observations.
Effective scaling registration approach by imposing the emphasis on the scale factor

Minmin Xu,Siyu Xu,Jihua Zhu,Yaochen Li,Jun Wang,Huimin Lu

DOI: https://doi.org/10.48550/arXiv.1705.00086

2019-03-08

Abstract:This paper proposes an effective approach for the scaling registration of $m$-D point sets. Different from the rigid transformation, the scaling registration can not be formulated into the common least square function due to the ill-posed problem caused by the scale factor. Therefore, this paper designs a novel objective function for the scaling registration problem. The appearance of this objective function is a rational fraction, where the numerator item is the least square error and the denominator item is the square of the scale factor. By imposing the emphasis on scale factor, the ill-posed problem can be avoided in the scaling registration. Subsequently, the new objective function can be solved by the proposed scaling iterative closest point (ICP) algorithm, which can obtain the optimal scaling transformation. For the practical applications, the scaling ICP algorithm is further extended to align partially overlapping point sets. Finally, the proposed approach is tested on public data sets and applied to merging grid maps of different resolutions. Experimental results demonstrate its superiority over previous approaches on efficiency and robustness.

Computer Vision and Pattern Recognition
The statistical rate for support matrix machines under low rankness and row (column) sparsity

Ling Peng,Xiaohui Liu,Xiangyong Tan,Yiweng Zhou,Shihua Luo

DOI: https://doi.org/10.1007/s00362-024-01570-0

2024-05-26

Statistical Papers

Abstract:This paper proposes a novel estimator for support vector machines with matrix-valued covariates in a high-dimensional setting. We assume that the underlying parameter matrix lies in a low-dimensional subspace that is simultaneously low-rank and row (column) sparse. We formulate the problem as a regularized hinge loss minimization problem using the nuclear and group lasso norms as penalties to exploit the low-dimensional structure. Our primary focus is deriving the statistical convergence rate of the regularized estimator for the unknown parameter matrix. To validate our theoretical findings, we conducted numerical experiments on both simulated and real-world datasets, demonstrating the efficacy of the regularized support matrix machines framework.

statistics & probability
Nonharmonic multivariate Fourier transforms and matrices: condition numbers and hyperplane geometry

Weilin Li

2024-07-15

Abstract:Consider an operator that takes the Fourier transform of a discrete measure supported in $\mathcal{X}\subset[-\frac 12,\frac 12)^d$ and restricts it to a compact $\Omega\subset\mathbb{R}^d$. We provide lower bounds for its smallest singular value when $\Omega$ is either a ball or cube of radius $m$, and under different types of geometric assumptions on $\mathcal{X}$. We first show that if distances between points in $\mathcal{X}$ are lower bounded by a $\delta$ that is allowed to be arbitrarily small, then the smallest singular value is at least $Cm^{d/2} (m\delta)^{\lambda-1}$, where $\lambda$ is the maximum number of elements in $\mathcal{X}$ contained within any ball or cube of an explicitly given radius. This estimate communicates a localization effect of the Fourier transform. While it is sharp, the smallest singular value behaves better than expected for many $\mathcal{X}$, including when we dilate a generic set by parameter $\delta$. We next show that if there is a $\eta$ such that, for each $x\in\mathcal{X}$, the set $\mathcal{X}\setminus\{x\}$ locally consists of at most $r$ hyperplanes whose distances to $x$ are at least $\eta$, then the smallest singular value is at least $C m^{d/2} (m\eta)^r$. For dilations of a generic set by $\delta$, the lower bound becomes $C m^{d/2} (m\delta)^{\lceil (\lambda-1)/d\rceil }$. The appearance of a $1/d$ factor in the exponent indicates that compared to worst case scenarios, the condition number of nonharmonic Fourier transforms is better than expected for typical sets and improve with higher dimensionality.

Numerical Analysis
Sparse Support Recovery with Non-smooth Loss Functions

Kévin Degraux,Gabriel Peyré,Jalal M. Fadili,Laurent Jacques

DOI: https://doi.org/10.48550/arXiv.1611.01030

2016-11-03

Abstract:In this paper, we study the support recovery guarantees of underdetermined sparse regression using the $\ell_1$-norm as a regularizer and a non-smooth loss function for data fidelity. More precisely, we focus in detail on the cases of $\ell_1$ and $\ell_\infty$ losses, and contrast them with the usual $\ell_2$ loss. While these losses are routinely used to account for either sparse ($\ell_1$ loss) or uniform ($\ell_\infty$ loss) noise models, a theoretical analysis of their performance is still lacking. In this article, we extend the existing theory from the smooth $\ell_2$ case to these non-smooth cases. We derive a sharp condition which ensures that the support of the vector to recover is stable to small additive noise in the observations, as long as the loss constraint size is tuned proportionally to the noise level. A distinctive feature of our theory is that it also explains what happens when the support is unstable. While the support is not stable anymore, we identify an "extended support" and show that this extended support is stable to small additive noise. To exemplify the usefulness of our theory, we give a detailed numerical analysis of the support stability/instability of compressed sensing recovery with these different losses. This highlights different parameter regimes, ranging from total support stability to progressively increasing support instability.

Information Theory
Spectral analysis of matrix scaling and operator scaling

Tsz Chiu Kwok,Lap Chi Lau,Akshay Ramachandran

DOI: https://doi.org/10.48550/arXiv.1904.03213

2019-04-06

Abstract:We present a spectral analysis for matrix scaling and operator scaling. We prove that if the input matrix or operator has a spectral gap, then a natural gradient flow has linear convergence. This implies that a simple gradient descent algorithm also has linear convergence under the same assumption. The spectral gap condition for operator scaling is closely related to the notion of quantum expander studied in quantum information theory. The spectral analysis also provides bounds on some important quantities of the scaling problems, such as the condition number of the scaling solution and the capacity of the matrix and operator. These bounds can be used in various applications of scaling problems, including matrix scaling on expander graphs, permanent lower bounds on random matrices, the Paulsen problem on random frames, and Brascamp-Lieb constants on random operators. In some applications, the inputs of interest satisfy the spectral condition and we prove significantly stronger bounds than the worst case bounds.

Data Structures and Algorithms,Functional Analysis,Optimization and Control,Quantum Physics
Spectral multidimensional scaling

Yonathan Aflalo,Ron Kimmel

DOI: https://doi.org/10.1073/pnas.1308708110

2013-11-05

Abstract:An important tool in information analysis is dimensionality reduction. There are various approaches for large data simplification by scaling its dimensions down that play a significant role in recognition and classification tasks. The efficiency of dimension reduction tools is measured in terms of memory and computational complexity, which are usually a function of the number of the given data points. Sparse local operators that involve substantially less than quadratic complexity at one end, and faithful multiscale models with quadratic cost at the other end, make the design of dimension reduction procedure a delicate balance between modeling accuracy and efficiency. Here, we combine the benefits of both and propose a low-dimensional multiscale modeling of the data, at a modest computational cost. The idea is to project the classical multidimensional scaling problem into the data spectral domain extracted from its Laplace-Beltrami operator. There, embedding into a small dimensional Euclidean space is accomplished while optimizing for a small number of coefficients. We provide a theoretical support and demonstrate that working in the natural eigenspace of the data, one could reduce the process complexity while maintaining the model fidelity. As examples, we efficiently canonize nonrigid shapes by embedding their intrinsic metric into , a method often used for matching and classifying almost isometric articulated objects. Finally, we demonstrate the method by exposing the style in which handwritten digits appear in a large collection of images. We also visualize clustering of digits by treating images as feature points that we map to a plane.
The Characterization of Compact Support of Fourier Transform for Scaling Function and Orthonormal Wavelets of L~2(R~s)

Huang Yongdong,Cheng Zhengxing,Han Huili

2009-01-01

Acta Mathematica Scientia

Abstract:In this paper,under a weaker condition,the authors give the sufficient and necessary condition thatφ(x) is a scaling function of L~2(R~S),in view of support of Fourier transform forφ(x).Furthermore,suppose {ψ_μ} is an orthonormal wavelet of L~2(R~S) and the whole support of its Fourier transform is Under the weakest condition that each |φ_μ| is continuous forω∈[A_i,D_i]),the authors give results of the above whole support of {ψ_μ},these results are characterized by some equalities and inequalities.They have improved completely Long's results and Zhang's results.
The Gradient Projection Method for a Supporting Function on the Unit Sphere and Its Applications

Balashov, M. V.

DOI: https://doi.org/10.1134/s096554252470009x

2024-06-08

Computational Mathematics and Mathematical Physics

Abstract:We consider minimization of the supporting function of a convex compact set on the unit sphere. In essence, this is the problem of projecting zero onto a compact convex set. We consider sufficient conditions for solving this problem with a linear rate using a first order algorithm—the gradient projection method with a fixed step-size and with Armijo's step-size. We consider some applications for problems with set-valued mappings. The mappings in the work basically are given through the set-valued integral of a set-valued mapping with convex and compact images or as the Minkowski sum of finite number of convex compact sets, e.g., ellipsoids. Unlike another solution ways, e.g., with approximation in a certain sense of the mapping, the considered algorithm much weaker depends on the dimension of the space and other parameters of the problem. It also allows efficient error estimation. Numerical experiments confirm the effectiveness of the considered approach.

mathematics, applied,physics, mathematical

Support of Non-separable Multivariate Scaling Function

Supports of Fourier Transforms of Scaling Functions

Elliptic scaling functions as compactly supported multivariate analogs of the B-splines

BIVARIATE NONSEPARABLE SCALING FUNCTION

Nonseparable Orthogonal Scaling Functions of L-2(R-N)

Multiscale Support Vector Regression Method in Sobolev Spaces on Bounded Domains

Scaling the kernel function to improve performance of the support vector machine

On eigenvalues and eigenfunctions of the operators defining multidimensional scaling on some symmetric spaces

Estimating the Support of a High-Dimensional Distribution

Construction of bivariate nonseparable compactly supported orthogonal wavelets

Least Squares Support Vector Machine Based on Scaling Kernel Function

Variational Multiscale Nonparametric Regression: Smooth Functions

Signed Support Recovery for Single Index Models in High-Dimensions

Effective scaling registration approach by imposing the emphasis on the scale factor

The statistical rate for support matrix machines under low rankness and row (column) sparsity

Nonharmonic multivariate Fourier transforms and matrices: condition numbers and hyperplane geometry

Sparse Support Recovery with Non-smooth Loss Functions

Spectral analysis of matrix scaling and operator scaling

Spectral multidimensional scaling

The Characterization of Compact Support of Fourier Transform for Scaling Function and Orthonormal Wavelets of L~2(R~s)

The Gradient Projection Method for a Supporting Function on the Unit Sphere and Its Applications