Probabilistic Local Structure Models

Xiang Sean Zhou,Yong Rui,Thomas S. Huang

DOI: https://doi.org/10.1007/978-1-4615-0497-9_4

2003-01-01

Abstract: Small, local evidences can reveal a great deal in an image.

What problem does this paper attempt to address?

Imagerank : Spectral Techniques for Structural Analysis of Image Database

XF He,WY Ma,HJ Zhang

DOI: https://doi.org/10.1109/icme.2003.1220845

2003-01-01

Abstract:Drawing on the correspondence between spectral clustering, spectral dimensionality reduction, and the connections to the Markov chain theory, we present a novel unified framework for structural analysis of image database using spectral techniques. The framework provides a computationally efficient approach to both clustering and dimensionality reduction, or 2-D visualization. Within this framework, we can also infer the semantic degrees of the images, i.e. imagerank, which characterize the richness of semantics contained in the images. Some illustrative examples are discussed.
Correlation Analysis Framework for Localization-Based Superresolution Microscopy.

Joerg Schnitzbauer,Yina Wang,Shijie Zhao,Matthew Bakalar,Tulip Nuwal,Baohui Chen,Bo Huang

DOI: https://doi.org/10.1073/pnas.1711314115

2018-01-01

Abstract:Superresolution images reconstructed from single-molecule localizations can reveal cellular structures close to the macromolecular scale and are now being used routinely in many biomedical research applications. However, because of their coordinate-based representation, a widely applicable and unified analysis platform that can extract a quantitative description and biophysical parameters from these images is yet to be established. Here, we propose a conceptual framework for correlation analysis of coordinate-based superresolution images using distance histograms. We demonstrate the application of this concept in multiple scenarios, including image alignment, tracking of diffusing molecules, as well as for quantification of colocalization, showing its superior performance over existing approaches.
Local Probabilistic Model for Bayesian Classification: a Generalized Local Classification Model

Chengsheng Mao,Lijuan Lu,Bin Hu

DOI: https://doi.org/10.48550/arXiv.1812.05221

2018-12-13

Abstract:In Bayesian classification, it is important to establish a probabilistic model for each class for likelihood estimation. Most of the previous methods modeled the probability distribution in the whole sample space. However, real-world problems are usually too complex to model in the whole sample space; some fundamental assumptions are required to simplify the global model, for example, the class conditional independence assumption for naive Bayesian classification. In this paper, with the insight that the distribution in a local sample space should be simpler than that in the whole sample space, a local probabilistic model established for a local region is expected much simpler and can relax the fundamental assumptions that may not be true in the whole sample space. Based on these advantages we propose establishing local probabilistic models for Bayesian classification. In addition, a Bayesian classifier adopting a local probabilistic model can even be viewed as a generalized local classification model; by tuning the size of the local region and the corresponding local model assumption, a fitting model can be established for a particular classification problem. The experimental results on several real-world datasets demonstrate the effectiveness of local probabilistic models for Bayesian classification.

Machine Learning
Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Sen Liu,Chaolun Xia,Xiaohong Jiang

DOI: https://doi.org/10.1109/ICDM.2010.136

2010-01-01

Abstract:Probabilistic latent semantic analysis is a topic modeling technique to discover the hidden structure in binary and count data. As a mixture model, it performs a probabilistic mixture decomposition on the co-occurrence matrix, which produces two matrices assigned with probabilistic explanations. However, the factorized matrices may be rather smooth, which means we may obtain global feature and topic representations rather than expected local ones. To resolve this problem, one of the solutions is to revise the decomposition process with considerations of sparsity. In this paper, we present an approach that provides direct control over sparsity during the expectation maximization process. Furthermore, by using the log penalty function as sparsity measurement instead of the widely used L2 norm, we can approximate the re-estimation of parameters in linear time, as same as original PLSA does, while many other approaches require much more time. Experiments on face databases are reported to show visual representations on obtaining local features, and detailed improvements in clustering tasks compared with the original process.
Title From Information Scaling of Natural Images to Regimes of Statistical Models Permalink

Ying Nian Wu,Song-Chun Zhu,Cheng-en Guo

2004-01-01

Abstract:Computer vision can be considered a highly specialized data collection and data analysis problem. We need to understand the special properties of image data in order to construct statistical models for representing the wide variety of image patterns. One special property of vision that distinguishes itself from other sensory data such as speech data is that distance or scale plays a profound role in image data. More specifically, visual objects and patterns can appear at a wide range of distances or scales, and the same visual pattern appearing at different distances or scales produces different image data with different statistical properties, thus entails different regimes of statistical models. In particular, we show that the entropy rate of the image data changes over the viewing distance (as well as the camera resolution). Moreover, the inferential uncertainty changes with viewing distance too. We call these changes information scaling. From this perspective, we examine both empirically and theoretically two prominent and yet largely isolated research themes in image modeling literature, namely, wavelet sparse coding and Markov random fields. Our results indicate that the two models are appropriate on two different entropy regimes: sparse coding targets the low entropy regime, whereas the random fields are suitable for the high entropy regime. Because of information scaling, both models are necessary for representing and interpreting image intensity patterns in the whole entropy range, and information scaling triggers transitions between these two regimes of models. This motivates us to propose a full-zoom primal sketch model that integrates both sparse coding and Markov random fields. In this model, local image intensity patterns are classified into “sketchable regime” and “non-sketchable regime” by a sketchability criterion. In the sketchable regime, the image data are represented deterministically by highly parametrized sketch primitives. In the non-sketchable regime, the image data are characterized by Markov random fields whose sufficient statistics summarize computational results from failed attempts of sparse coding. The contribution of our work is two folded. First, information scaling provides a dimension to chart the space of natural images. Second, the full-zoom modeling scheme provides a natural integration of sparse coding and Markov random fields, thus enables us to develop a new and richer class of statistical models.
A New Structure of the Focal Element in Object Recognition

Hongfeng Long,Zhenming Peng,Yong Deng

DOI: https://doi.org/10.1002/int.22675

IF: 8.993

2021-01-01

International Journal of Intelligent Systems

Abstract:The research on uncertainty is a hot spot in artificial intelligence, especially in actual applications. Most research focus on measuring the uncertainty between evidence, ignoring the structure of evidence. When a sample has multiple features, the traditional structure of the focal element cannot handle and display the uncertainty between multiple features directly. Hence, we proposed a new structure of the focal element considering multiple features into one focal element and provided the corresponding basic probability assignment calculation. To apply the new structure in practices, we provided a new object recognition method combining the fractal feature and credible evidence. The new method can improve the robustness of the algorithm in a noisy environment. In the end, some experiments have illustrated the validity and correctness of the proposed method.
Inferring Local Structure from Pairwise Correlations

Mahajabin Rahman,Ilya Nemenman

DOI: https://doi.org/10.1103/PhysRevE.108.034410

2023-10-18

Abstract:To construct models of large, multivariate complex systems, such as those in biology, one needs to constrain which variables are allowed to interact. This can be viewed as detecting "local" structures among the variables. In the context of a simple toy model of 2D natural and synthetic images, we show that pairwise correlations between the variables -- even when severely undersampled -- provide enough information to recover local relations, including the dimensionality of the data, and to reconstruct arrangement of pixels in fully scrambled images. This proves to be successful even though higher order interaction structures are present in our data. We build intuition behind the success, which we hope might contribute to modeling complex, multivariate systems and to explaining the success of modern attention-based machine learning approaches.

Data Analysis, Statistics and Probability,Machine Learning,Other Statistics
Probabilistic Dyadic Data Analysis with Local and Global Consistency.

Deng Cai,Xuanhui Wang,Xiaofei He

DOI: https://doi.org/10.1145/1553374.1553388

2009-01-01

Abstract:Dyadic data arises in many real world applications such as social network analysis and information retrieval. In order to discover the underlying or hidden structure in the dyadic data, many topic modeling techniques were proposed. The typical algorithms include Probabilistic Latent Semantic Analysis (PLSA) and Latent Dirichlet Allocation (LDA). The probability density functions obtained by both of these two algorithms are supported on the Euclidean space. However, many previous studies have shown naturally occurring data may reside on or close to an underlying submanifold. We introduce a probabilistic framework for modeling both the topical and geometrical structure of the dyadic data that explicitly takes into account the local manifold structure. Specifically, the local manifold structure is modeled by a graph. The graph Laplacian, analogous to the Laplace-Beltrami operator on manifolds, is applied to smooth the probability density functions. As a result, the obtained probabilistic distributions are concentrated around the data manifold. Experimental results on real data sets demonstrate the effectiveness of the proposed approach.
Learning a Probabilistic Topology Discovering Model for Scene Categorization.

Luming Zhang,Rongrong Ji,Yingjie Xia,Ying Zhang,Xuelong Li

DOI: https://doi.org/10.1109/TNNLS.2014.2347398

IF: 14.255

2015-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:A recent advance in scene categorization prefers a topological based modeling to capture the existence and relationships among different scene components. To that effect, local features are typically used to handle photographing variances such as occlusions and clutters. However, in many cases, the local features alone cannot well capture the scene semantics since they are extracted from tiny regions (e.g., 4×4 patches) within an image. In this paper, we mine a discriminative topology and a low-redundant topology from the local descriptors under a probabilistic perspective, which are further integrated into a boosting framework for scene categorization. In particular, by decomposing a scene image into basic components, a graphlet model is used to describe their spatial interactions. Accordingly, scene categorization is formulated as an intergraphlet matching problem. The above procedure is further accelerated by introducing a probabilistic based representative topology selection scheme that makes the pairwise graphlet comparison trackable despite their exponentially increasing volumes. The selected graphlets are highly discriminative and independent, characterizing the topological characteristics of scene images. A weak learner is subsequently trained for each topology, which are boosted together to jointly describe the scene image. In our experiment, the visualized graphlets demonstrate that the mined topological patterns are representative to scene categories, and our proposed method beats state-of-the-art models on five popular scene data sets.
Probabilistic Image Model and Its Information-Theoretic Properties

YQ ZHANG,MH LOEW,RL PICKHOLTZ

DOI: https://doi.org/10.1109/tsp.1993.193191

IF: 4.875

1993-01-01

IEEE Transactions on Signal Processing

Abstract:In this paper, we propose a new method to construct the joint probability model from a specified first-order distribution and correlation structure. The construction procedure can be interpreted in two ways: (1) It embodies the maximum entropy principle, or (2) It is considered as a correlated non-Gaussian source generated by a nonlinear transformation from a correlated Gaussian source. Its stochastic properties [mean,correlation] and information-theoretic properties [entropy, rate-distortion bound] are examined. An example for the lognormal distribution is given to illustrate the construction process and the characteristics of the source. This approach should remove the limitations imposed by earlier methods, and make for more realistic modeling of medical images.
Towards training-free appearance-based localization: Probabilistic models for whole-image descriptors

Stephanie M. Lowry,Gordon F. Wyeth,Michael J. Milford

DOI: https://doi.org/10.1109/icra.2014.6906932

2014-05-01

Abstract:Whole image descriptors have been shown to be remarkably robust to perceptual change especially compared to local features. However, whole-image-based localization systems typically rely on heuristic methods for determining appropriate matching thresholds in a particular environment. These environment-specific tuning requirements and the lack of a meaningful interpretation of arbitrary thresholds limit the general applicability of these systems. In this paper we present a Bayesian model of probability for whole-image descriptors that can be seamlessly integrated into localization systems designed for probabilistic visual input. We demonstrate this method using CAT -Graph, an appearance-based visual localization system originally designed for a FAB-MAP-style probabilistic input. We show that using whole-image descriptors as visual input extends CAT-Graph's functionality to environments that experience a greater amount of perceptual change. We also present a method of estimating whole-image probability models in an online manner, removing the need for a prior training phase. We show that this online, automated training method can perform comparably to pretrained, manually tuned local descriptor methods.
Evaluation of Local Features for Structure from Motion.

Mingwei Cao,Li Cao,Wei Jia,Yujie Li,Zhihan Lv,Liping Zheng,Xiaoping Liu

DOI: https://doi.org/10.1007/s11042-018-5864-1

IF: 2.577

2018-01-01

Multimedia Tools and Applications

Abstract:Structure from motion (SFM) is an effective approach for reconstructing large-scale 3D scene from multiple images. In this field, many local feature methods have been proposed to detect feature point and compute descriptor. For designing a robust SFM system, how to select a good feature from existing methods is an important problem. In this paper, we aim to help different users for making decision by an experimental way for large-scale 3D reconstruction where many high resolution images are captured. To this end, we make a comprehensive evaluation of several local features on the ground truth datasets. Experimental results show that SIFT and SURF have a better performance than that of some binary features such as ORB and BRISK.
Positioning Localities Based On Spatial Assertions

Y. Liu,Q. H. Guo,John Wieczorek,Michael F. Goodchild

DOI: https://doi.org/10.1080/13658810802247114

2009-01-01

International Journal of Geographical Information Science

Abstract:In practice, descriptive localities are often communicated using named places and spatial relationships. Uncertainty associated with such descriptions of localities is inevitable, and knowledge of such uncertainty is normally not explicit. When translating descriptive localities into spatially explicit ones, it is critical to circumscribe locations and to estimate the associated uncertainty based on a set of appropriate spatial relationships. In conventional research on qualitative spatial reasoning (QSR), spatial relationships are modeled using formal logic. Unfortunately, QSR cannot deal with the uncertainty of a position. In this paper, based on the conceptual model of spatial assertions, we introduce the uncertainty field model to represent the probability distribution of a point locality. Using probability operations, we can combine a set of assertions to position a locality. Conflicts among assertions for a single locality can be detected based on the resulting field. Since spatial relationships play an important role in the uncertainty of target objects, we investigate conceptually the uncertainty fields associated with various types of spatial relationships (for example, topological, directional and metric). In a concrete application, these uncertainty fields can be customized and used without altering the proposed framework.
Probabilistic and Semantic Descriptions of Image Manifolds and Their Applications

Peter Tu,Zhaoyuan Yang,Richard Hartley,Zhiwei Xu,Jing Zhang,Yiwei Fu,Dylan Campbell,Jaskirat Singh,Tianyu Wang

2023-11-12

Abstract:This paper begins with a description of methods for estimating image probability density functions that reflects the observation that such data is usually constrained to lie in restricted regions of the high-dimensional image space-not every pattern of pixels is an image. It is common to say that images lie on a lower-dimensional manifold in the high-dimensional space. However, it is not the case that all points on the manifold have an equal probability of being images. Images are unevenly distributed on the manifold, and our task is to devise ways to model this distribution as a probability distribution. We therefore consider popular generative models. For our purposes, generative/probabilistic models should have the properties of 1) sample generation: the possibility to sample from this distribution with the modelled density function, and 2) probability computation: given a previously unseen sample from the dataset of interest, one should be able to compute its probability, at least up to a normalising constant. To this end, we investigate the use of methods such as normalising flow and diffusion models. We then show how semantic interpretations are used to describe points on the manifold. To achieve this, we consider an emergent language framework that uses variational encoders for a disentangled representation of points that reside on a given manifold. Trajectories between points on a manifold can then be described as evolving semantic descriptions. We also show that such probabilistic descriptions (bounded) can be used to improve semantic consistency by constructing defences against adversarial attacks. We evaluate our methods with improved semantic robustness and OoD detection capability, explainable and editable semantic interpolation, and improved classification accuracy under patch attacks. We also discuss the limitation in diffusion models.

Computer Vision and Pattern Recognition
Positioning Localities from Spatial Assertions Based on Voronoi Neighboring

YongXi Gong,GuiCai Li,Yu Liu,Jian Yang

DOI: https://doi.org/10.1007/s11431-010-3203-5

2010-01-01

Science China Technological Sciences

Abstract:With the rapid development of Internet, much spatial information contained in non-structured or semi-structured documents is available on the World Wide Web. In such documents, localities are always textually described using spatial relationships and named places, instead of numerical coordinates. Hence, extracting positional information from locality descriptions is an important task. In this paper, we bridge two aspects of locality descriptions, namely generating locality descriptions and positioning localities, and provide a method to compute probability density according to the selection probability of a reference object to describe the position of the target object. Refinement operation on uncertainty field is used to deal with locality description involving multiple reference objects. Three metrics are introduced to measure the results of positioning localities. We choose the mixed selection probability function based on Euclidean distance and Voronoi stolen-area to compute probability density function. Finally, we use three cases to demonstrate the proposed methods.
Probabilistic Visual Place Recognition for Hierarchical Localization

Ming Xu,Niko Sünderhauf,Michael Milford

DOI: https://doi.org/10.1109/LRA.2020.3040134

2021-05-07

Abstract:Visual localization techniques often comprise a hierarchical localization pipeline, with a visual place recognition module used as a coarse localizer to initialize a pose refinement stage. While improving the pose refinement step has been the focus of much recent research, most work on the coarse localization stage has focused on improvements like increased invariance to appearance change, without improving what can be loose error tolerances. In this letter, we propose two methods which adapt image retrieval techniques used for visual place recognition to the Bayesian state estimation formulation for localization. We demonstrate significant improvements to the localization accuracy of the coarse localization stage using our methods, whilst retaining state-of-the-art performance under severe appearance change. Using extensive experimentation on the Oxford RobotCar dataset, results show that our approach outperforms comparable state-of-the-art methods in terms of precision-recall performance for localizing image sequences. In addition, our proposed methods provides the flexibility to contextually scale localization latency in order to achieve these improvements. The improved initial localization estimate opens up the possibility of both improved overall localization performance and modified pose refinement techniques that leverage this improved spatial prior.

Computer Vision and Pattern Recognition,Robotics
Localized Co-Occurrence Model for Fast Approximate Search in 3D Structure Databases

Zi Huang,Heng Tao Shen,Xiaofang Zhou

DOI: https://doi.org/10.1109/TKDE.2007.190729

IF: 9.235

2008-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Similarity search for 3D structure data sets is fundamental to many database applications such as molecular biology, image registration, and computer-aided design. Identifying the common 3D subtructures between two objects is an important research problem. However, it is well known that computing structural similarity is very expensive due to the high exponential time complexity of structure similarity measures. As the structure databases keep growing rapidly, real-time search from large-structure databases becomes problematic. In this paper, we present a novel statistical model, that is, the multiresolution Localized Co-Occurrence Model (LCM), to approximately measure the similarity between the two point-based 3D structures in linear time complexity for fast retrieval. LCM could capture both distribution characteristics and spatial structure of 3D data by localizing the point co-occurrence relationship within a predefined neighborhood system. As a step further, a novel structure query processing method called the incremental and Bounded search (iBound) is also proposed to speed up the search process. iBound avoids a large amount of expensive computation at higher resolution LCMs. By superposing two LCMs, their largest common substructure can also be found quickly. Finally, our experiment results prove the effectiveness and efficiency of our methods.
Learning Probabilistic Structure to Group Image Edges for Object Extraction

Yangyu Tao,Lin Liang,Yingqing Xu

DOI: https://doi.org/10.1109/icme.2009.5202497

2009-01-01

Abstract:We investigate exploiting the class specific information in the conventional perceptual edge grouping for the task of object extraction, since the domain information is usually available in practice. Instead of applying the classical Gestalt principles, we turn to learn a class specific probabilistic structure model from training images. During the learning, both geometrical and photometric features such as color and texture are fused. Experiments show the model is fairly robust to the intra-class variations of object as well as background clutters. Moreover, we design a novel saliency measure for the grouping based on the probabilistic structure model. The object extraction is formulated as an optimization problem which can be efficiently solved by the recently developed ratio contour algorithm. The effectiveness of the proposed method is demonstrated by the experiments on real images.
Foundations of Vision-Based Localization: A New Approach to Localizability Analysis Using Stochastic Geometry

Haozhou Hu,Harpreet S. Dhillon,R. Michael Buehrer

2024-09-15

Abstract:Despite significant algorithmic advances in vision-based positioning, a comprehensive probabilistic framework to study its performance has remained unexplored. The main objective of this paper is to develop such a framework using ideas from stochastic geometry. Due to limitations in sensor resolution, the level of detail in prior information, and computational resources, we may not be able to differentiate between landmarks with similar appearances in the vision data, such as trees, lampposts, and bus stops. While one cannot accurately determine the absolute target position using a single indistinguishable landmark, obtaining an approximate position fix is possible if the target can see multiple landmarks whose geometric placement on the map is unique. Modeling the locations of these indistinguishable landmarks as a Poisson point process (PPP) $\Phi$ on $\mathbb{R}^2$, we develop a new approach to analyze the localizability in this setting. From the target location $\mathbb{x}$, the measurements are obtained from landmarks within the visibility region. These measurements, including ranges and angles to the landmarks, denoted as $f(\mathbb{x})$, can be treated as mappings from the target location. We are interested in understanding the probability that the measurements $f(\mathbb{x})$ are sufficiently distinct from the measurement $f(\mathbb{x}_0)$ at the given location, which we term localizability. Expressions of localizability probability are derived for specific vision-inspired measurements, such as ranges to landmarks and snapshots of their locations. Our analysis reveals that the localizability probability approaches one when the landmark intensity tends to infinity, which means that error-free localization is achievable in this limiting regime.

Information Theory,Signal Processing,Computation
Local Causal Structure Learning in the Presence of Latent Variables

Feng Xie,Zheng Li,Peng Wu,Yan Zeng,Chunchen Liu,Zhi Geng

2024-06-06

Abstract:Discovering causal relationships from observational data, particularly in the presence of latent variables, poses a challenging problem. While current local structure learning methods have proven effective and efficient when the focus lies solely on the local relationships of a target variable, they operate under the assumption of causal sufficiency. This assumption implies that all the common causes of the measured variables are observed, leaving no room for latent variables. Such a premise can be easily violated in various real-world applications, resulting in inaccurate structures that may adversely impact downstream tasks. In light of this, our paper delves into the primary investigation of locally identifying potential parents and children of a target from observational data that may include latent variables. Specifically, we harness the causal information from m-separation and V-structures to derive theoretical consistency results, effectively bridging the gap between global and local structure learning. Together with the newly developed stop rules, we present a principled method for determining whether a variable is a direct cause or effect of a target. Further, we theoretically demonstrate the correctness of our approach under the standard causal Markov and faithfulness conditions, with infinite samples. Experimental results on both synthetic and real-world data validate the effectiveness and efficiency of our approach.

Machine Learning,Artificial Intelligence

Probabilistic Local Structure Models

Imagerank : Spectral Techniques for Structural Analysis of Image Database

Correlation Analysis Framework for Localization-Based Superresolution Microscopy.

Local Probabilistic Model for Bayesian Classification: a Generalized Local Classification Model

Efficient Probabilistic Latent Semantic Analysis with Sparsity Control

Title From Information Scaling of Natural Images to Regimes of Statistical Models Permalink

A New Structure of the Focal Element in Object Recognition

Inferring Local Structure from Pairwise Correlations

Probabilistic Dyadic Data Analysis with Local and Global Consistency.

Learning a Probabilistic Topology Discovering Model for Scene Categorization.

Probabilistic Image Model and Its Information-Theoretic Properties

Towards training-free appearance-based localization: Probabilistic models for whole-image descriptors

Evaluation of Local Features for Structure from Motion.

Positioning Localities Based On Spatial Assertions

Probabilistic and Semantic Descriptions of Image Manifolds and Their Applications

Positioning Localities from Spatial Assertions Based on Voronoi Neighboring

Probabilistic Visual Place Recognition for Hierarchical Localization

Localized Co-Occurrence Model for Fast Approximate Search in 3D Structure Databases

Learning Probabilistic Structure to Group Image Edges for Object Extraction

Foundations of Vision-Based Localization: A New Approach to Localizability Analysis Using Stochastic Geometry

Local Causal Structure Learning in the Presence of Latent Variables