Comparisons of Reasoning Mechanisms for Computer Vision

Ze-Nian Li

DOI: https://doi.org/10.48550/arXiv.1304.2743

2013-03-28

Abstract:An evidential reasoning mechanism based on the Dempster-Shafer theory of evidence is introduced. Its performance in real-world image analysis is compared with other mechanisms based on the Bayesian formalism and a simple weight combination method.

Computer Vision and Pattern Recognition,Artificial Intelligence

What problem does this paper attempt to address?

Evidential Reasoning in Image Understanding

Minchuan Zhang,Su-shing Chen

DOI: https://doi.org/10.48550/arXiv.1304.2749

2013-03-28

Abstract:In this paper, we present some results of evidential reasoning in understanding multispectral images of remote sensing systems. The Dempster-Shafer approach of combination of evidences is pursued to yield contextual classification results, which are compared with previous results of the Bayesian context free classification, contextual classifications of dynamic programming and stochastic relaxation approaches.

Computer Vision and Pattern Recognition,Artificial Intelligence
Conditional Evidence Theory and Its Application in Knowledge Discovery

Yongchuan Tang,Shouqian Sun,Yangguang Liu

DOI: https://doi.org/10.1007/978-3-540-24655-8_54

2004-01-01

Abstract:In this paper, we develop the conditional evidence theory and apply it to knowledge discovery in database. In this theory, we assume that a priori knowledge about generic situation and evidence about situation at hand can be modelled by two independent random sets. Dempster's rule of combination is a popular method used in evidence theory, we think that this rule can be applied to knowledge revision, but isn't appropriate for knowledge updating. Based on random set theory, we develop a new bayesian updating rule in evidence theory. More importantly, we show that bayesian updating rule can be performed incrementally by using Mobius transforms.
A Behaviorally Evidence-based Method for Computing Spatial Comparisons of Image Scenarios

Ziyang Weng,Shuhao Wang,Ziyu Zhang,Renyi Liu

DOI: https://doi.org/10.53106/160792642023092405009

2023-01-01

Abstract:Large amounts of noise and a lack of contextual domain knowledge lead to slow and inefficient cross-domain image learning. This paper proposes an image scenario spatial data classification model based on evidence-based behavioral logic, intervenes in image annotation through evidence-based dynamic knowledge graphs, and uses spatial similarity measurement to evaluate the effectiveness and robustness of the method. The results show that: 1) Organizing the dynamic knowledge graphs of contextual domain knowledge by behavioral logic can significantly improve the association efficiency of each model. 2) The calculation method of image scenario space comparison based on behavior evidence can decrypt the implicit knowledge of images and significantly improve the effectiveness of image scenario space interpretation. The research results are helpful to guide the design and implementation of cross-domain image interpretation systems and improve the efficiency of information sharing.
Using Dempster-Shafer Theory Of Evidence For Situation Inference

Susan Mckeever,Juan Ye,Lorcan Coyle,Simon Dobson

DOI: https://doi.org/10.1007/978-3-642-04471-7_12

2009-01-01

Abstract:In the domain of ubiquitous computing, the ability to identify the occurrence of situations is a core function of being 'context-aware'. Given the uncertain nature of sensor information and inference rules, reasoning techniques that cater for uncertainty hold promise for enabling the inference process. In our work, we apply the Dempster Shafer theory of evidence to infer situation occurence with minimal use of training data. We describe a, set of evidential operations for sensor mass functions using context quality and evidence accumulation for continuous situation detection. We demonstrate how our approach enables situation inference with uncertain information using a case study based on a published smart home activity data set.
A Comparison of Evidence Fusion Rules for Situation Recognition in Sensor-Based Environments

susan mckeever,juan ye

DOI: https://doi.org/10.1007/978-3-319-04406-4_16

2013-01-01

Abstract:Dempster-Shafer (DS) theory, and its associated Dempster rule of combination, has been widely used to determine belief based on uncertain evidence sources. Variations to the original Dempster rule of combination have appeared in the literature to support particular scenarios where unreliable results may result from the use of original DS theory. While theoretical explanations of the rule variations are explained, there is a lack of empirical comparisons of the DS theory and its variations against real data sets. In this work, we examine several variations to DS theory. Using two real-world sensor data sets, we compare the performance of DS theory and several of its variations in recognising situations. The empirical results shed insight on how to select these fusion rules based on the nature of sensor data, the relationship of this data over time to the higher level hypotheses and the choice of frame of discernment.
Comparison of Evidential Reasoning Algorithm with Linear Combination in Decision Making

Chao Fu,Bingbing Hou,Wenjun Chang,Nanping Feng,Shanlin Yang

DOI: https://doi.org/10.1007/s40815-019-00746-3

IF: 4.085

2019-10-22

International Journal of Fuzzy Systems

Abstract:Evidential reasoning (ER) approach is a representative method for analyzing uncertain multi-criteria decision-making (MCDM) and multi-criteria group decision-making (MCGDM) problems. Its core is ER algorithm used to combine belief distributions on criteria, which is developed based on Dempster's rule of combination and probability theory. The ER algorithm is nonlinear and more computationally complex than linear combination of belief distributions. To address the necessity of the ER algorithm in MCDM and MCGDM, it is compared with linear combination from three perspectives by simulation. The first is to examine differences between the aggregated assessments derived from the ER algorithm and linear combination. The second is to examine error rates of best alternatives derived from two combination ways. The third is to examine alternative ranking differences derived from two combination ways. To facilitate the comparison, difference between aggregated assessments is designed and score function of alternative is developed from the expected utilities of alternative. Simulation experiments show that differences between the aggregated assessments are influenced by the number of assessment grades, and error rates of best alternatives and alternative ranking differences are influenced by the numbers of criteria and alternatives.

computer science, information systems,automation & control systems, artificial intelligence
Take A Step Back: Rethinking the Two Stages in Visual Reasoning

Mingyu Zhang,Jiting Cai,Mingyu Liu,Yue Xu,Cewu Lu,Yong-Lu Li

2024-07-29

Abstract:Visual reasoning, as a prominent research area, plays a crucial role in AI by facilitating concept formation and interaction with the world. However, current works are usually carried out separately on small datasets thus lacking generalization ability. Through rigorous evaluation of diverse benchmarks, we demonstrate the shortcomings of existing ad-hoc methods in achieving cross-domain reasoning and their tendency to data bias fitting. In this paper, we revisit visual reasoning with a two-stage perspective: (1) symbolization and (2) logical reasoning given symbols or their representations. We find that the reasoning stage is better at generalization than symbolization. Thus, it is more efficient to implement symbolization via separated encoders for different data domains while using a shared reasoner. Given our findings, we establish design principles for visual reasoning frameworks following the separated symbolization and shared reasoning. The proposed two-stage framework achieves impressive generalization ability on various visual reasoning tasks, including puzzles, physical prediction, and visual question answering (VQA), encompassing both 2D and 3D modalities. We believe our insights will pave the way for generalizable visual reasoning.

Computer Vision and Pattern Recognition
Selective Vision is the Challenge for Visual Reasoning: A Benchmark for Visual Argument Understanding

Jiwan Chung,Sungjae Lee,Minseo Kim,Seungju Han,Ashkan Yousefpour,Jack Hessel,Youngjae Yu

2024-10-23

Abstract:Visual arguments, often used in advertising or social causes, rely on images to persuade viewers to do or believe something. Understanding these arguments requires selective vision: only specific visual stimuli within an image are relevant to the argument, and relevance can only be understood within the context of a broader argumentative structure. While visual arguments are readily appreciated by human audiences, we ask: are today's AI capable of similar understanding? We present VisArgs, a dataset of 1,611 images annotated with 5,112 visual premises (with regions), 5,574 commonsense premises, and reasoning trees connecting them into structured arguments. We propose three tasks for evaluating visual argument understanding: premise localization, premise identification, and conclusion deduction. Experiments show that 1) machines struggle to capture visual cues: GPT-4-O achieved 78.5% accuracy, while humans reached 98.0%. Models also performed 19.5% worse when distinguishing between irrelevant objects within the image compared to external objects. 2) Providing relevant visual premises improved model performance significantly.

Computation and Language,Computer Vision and Pattern Recognition
Evidential Reasoning in a Network Usage Prediction Testbed

Ronald P. Loui

DOI: https://doi.org/10.48550/arXiv.1304.2368

IF: 14.4

2013-03-27

Artificial Intelligence

Abstract:This paper reports on empirical work aimed at comparing evidential reasoning techniques. While there is prima facie evidence for some conclusions, this i6 work in progress; the present focus is methodology, with the goal that subsequent results be meaningful. The domain is a network of UNIX* cycle servers, and the task is to predict properties of the state of the network from partial descriptions of the state. Actual data from the network are taken and used for blindfold testing in a betting game that allows abstention. The focal technique has been Kyburg's method for reasoning with data of varying relevance to a particular query, though the aim is to be able eventually to compare various uncertainty calculi. The conclusions are not novel, but are instructive. 1. All of the calculi performed better than human subjects, so unbiased access to sample experience is apparently of value. 2. Performance depends on metric: (a) when trials are repeated, net = gains - losses favors methods that place many bets, if the probability of placing a correct bet is sufficiently high; that is, it favors point-valued formalisms; (b) yield = gains/(gains + lossee) favors methods that bet only when sure to bet correctly; that is, it favors interval-valued formalisms. 3. Among the calculi, there were no clear winners or losers. Methods are identified for eliminating the bias of the net as a performance criterion and for separating the calculi effectively: in both cases by posting odds for the betting game in the appropriate way.
Comparing Visual Reasoning in Humans and AI

Shravan Murlidaran,William Yang Wang,Miguel P. Eckstein

DOI: https://doi.org/10.48550/arXiv.2104.14102

IF: 14.4

2021-04-29

Artificial Intelligence

Abstract:Recent advances in natural language processing and computer vision have led to AI models that interpret simple scenes at human levels. Yet, we do not have a complete understanding of how humans and AI models differ in their interpretation of more complex scenes. We created a dataset of complex scenes that contained human behaviors and social interactions. AI and humans had to describe the scenes with a sentence. We used a quantitative metric of similarity between scene descriptions of the AI/human and ground truth of five other human descriptions of each scene. Results show that the machine/human agreement scene descriptions are much lower than human/human agreement for our complex scenes. Using an experimental manipulation that occludes different spatial regions of the scenes, we assessed how machines and humans vary in utilizing regions of images to understand the scenes. Together, our results are a first step toward understanding how machines fall short of human visual reasoning with complex scenes depicting human behaviors.
Logical Vision: One-Shot Meta-Interpretive Learning From Real Images

Wang-Zhou Dai,Stephen Muggleton,Jing Wen,Alireza Tamaddoni-Nezhad,Zhi-Hua Zhou

DOI: https://doi.org/10.1007/978-3-319-78090-0_4

2017-01-01

Abstract:Statistical machine learning is widely used in image classification. However, most techniques (1) require many images to achieve high accuracy and (2) do not provide support for reasoning below the level of classification, and so are unable to support secondary reasoning, such as the existence and position of light sources and other objects outside the image. In recent work an Inductive Logic Programming approach called Logical Vision (LV) was shown to overcome some of these limitations. LV uses Meta-Interpretive Learning combined with low-level extraction of high-contrast points sampled from the image to learn recursive logic programs describing the image. This paper extends LV by using (a) richer background knowledge enabling secondary reasoning from raw images, such as light reflection that can itself be learned and used for resolving visual ambiguities, which cannot be easily modelled using statistical approaches, (b) a wider class of background models representing classical 2D shapes such as circles and ellipses, (c) primitive-level statistical estimators to handle noise in real images. Our results indicate that the new noise-robust version of LV is able to handle secondary reasoning task in real images with few data, which is very similar to scientific discovery process of humans. Specifically, it uses a single example (i.e. one-shot LV) converges to an accuracy at least comparable to thirty-shot statistical machine learner on the prediction of hidden light sources. Moreover, we demonstrate that the learned theory can be used to identify ambiguities in the convexity/concavity of objects such as craters.
Weighted Evidence Combination with Ranking Distance

Yi Yang,Yongqing Zhou,Deqiang Han,Wei Ai

DOI: https://doi.org/10.1109/iccais.2018.8570508

2018-01-01

Abstract:The theory of belief functions, also called Dempster-Shafer evidence theory, is a powerful tool for uncertainty modeling and reasoning. However, one might encounter counter-intuitive results when using Dempster's rule in evidence combination. To handle this problem, an alternative weighted combination method is proposed in this paper, where the weights are generated according to the ranking distance between those evidences to combine. Experimental results show that our proposed approach can obtain rational combination results when compared with prevailing methods.
Research of artificial neural network intelligent recognition technology assisted by dempster-shafer evidence combination theory

DongCai Qu,Xiangwei Meng,Juan Huang,You He

DOI: https://doi.org/10.1109/icosp.2004.1452577

2004-01-01

Abstract:The D-S evidence combination theory is another important uncertainty inference method different from information processing by neural network, which is applied widely in intelligent information processing, and highly practical in engineering. On concisely introducing the Dempster-Shafer evidence combination theory frame, this article researches into the neural network intelligent recognition technology assisted by Dempster-Shafter evidence combination theory, sets forth the intelligent recognition tactics, presents the method and procedure of multi-sensor data fusion intelligent recognition on account of the calculating case, and puts forward some questions to be inquired.
From Recognition to Cognition: Visual Commonsense Reasoning

Rowan Zellers,Yonatan Bisk,Ali Farhadi,Yejin Choi

DOI: https://doi.org/10.1109/cvpr.2019.00688

2019-06-01

Abstract:Visual understanding goes well beyond object recognition. With one glance at an image, we can effortlessly imagine the world beyond the pixels: for instance, we can infer people’s actions, goals, and mental states. While this task is easy for humans, it is tremendously difficult for today’s vision systems, requiring higher-order cognition and commonsense reasoning about the world. We formalize this task as Visual Commonsense Reasoning. Given a challenging question about an image, a machine must answer correctly and then provide a rationale justifying its answer. Next, we introduce a new dataset, , consisting of 290k multiple choice QA problems derived from 110k movie scenes. The key recipe for generating non-trivial and high-quality problems at scale is Adversarial Matching, a new approach to transform rich annotations into multiple choice questions with minimal bias. Experimental results show that while humans find easy (over 90% accuracy), state-of-the-art vision models struggle (~45%). To move towards cognition-level understanding, we present a new reasoning engine, Recognition to Cognition Networks (R2C), that models the necessary layered inferences for grounding, contextualization, and reasoning. R2C helps narrow the gap between humans and machines (∼65%); still, the challenge is far from solved, and we provide analysis that suggests avenues for future work.
ROME: Evaluating Pre-trained Vision-Language Models on Reasoning beyond Visual Common Sense

Kankan Zhou,Eason Lai,Wei Bin Au Yeong,Kyriakos Mouratidis,Jing Jiang

2023-10-30

Abstract:Humans possess a strong capability for reasoning beyond common sense. For example, given an unconventional image of a goldfish laying on the table next to an empty fishbowl, a human would effortlessly determine that the fish is not inside the fishbowl. The case, however, may be different for a vision-language model, whose reasoning could gravitate towards the common scenario that the fish is inside the bowl, despite the visual input. In this paper, we introduce a novel probing dataset named ROME (reasoning beyond commonsense knowledge) to evaluate whether the state-of-the-art pre-trained vision-language models have the reasoning capability to correctly interpret counter-intuitive content. ROME contains images that defy commonsense knowledge with regards to color, shape, material, size and positional relation. Experiments on the state-of-the-art pre-trained vision-language models reveal that most of these models are still largely incapable of interpreting counter-intuitive scenarios. We hope that ROME will spur further investigations on reasoning beyond commonsense knowledge in vision-language research.

Computation and Language,Artificial Intelligence,Computer Vision and Pattern Recognition
Metaprobability and Dempster-Shafer in Evidential Reasoning

Robert Fung,Chee Yee Chong

DOI: https://doi.org/10.48550/arXiv.1304.3427

2013-03-28

Abstract:Evidential reasoning in expert systems has often used ad-hoc uncertainty calculi. Although it is generally accepted that probability theory provides a firm theoretical foundation, researchers have found some problems with its use as a workable uncertainty calculus. Among these problems are representation of ignorance, consistency of probabilistic judgements, and adjustment of a priori judgements with experience. The application of metaprobability theory to evidential reasoning is a new approach to solving these problems. Metaprobability theory can be viewed as a way to provide soft or hard constraints on beliefs in much the same manner as the Dempster-Shafer theory provides constraints on probability masses on subsets of the state space. Thus, we use the Dempster-Shafer theory, an alternative theory of evidential reasoning to illuminate metaprobability theory as a theory of evidential reasoning. The goal of this paper is to compare how metaprobability theory and Dempster-Shafer theory handle the adjustment of beliefs with evidence with respect to a particular thought experiment. Sections 2 and 3 give brief descriptions of the metaprobability and Dempster-Shafer theories. Metaprobability theory deals with higher order probabilities applied to evidential reasoning. Dempster-Shafer theory is a generalization of probability theory which has evolved from a theory of upper and lower probabilities. Section 4 describes a thought experiment and the metaprobability and DempsterShafer analysis of the experiment. The thought experiment focuses on forming beliefs about a population with 6 types of members {1, 2, 3, 4, 5, 6}. A type is uniquely defined by the values of three features: A, B, C. That is, if the three features of one member of the population were known then its type could be ascertained. Each of the three features has two possible values, (e.g. A can be either "a0" or "al"). Beliefs are formed from evidence accrued from two sensors: sensor A, and sensor B. Each sensor senses the corresponding defining feature. Sensor A reports that half of its observations are "a0" and half the observations are 'al'. Sensor B reports that half of its observations are ``b0,' and half are "bl". Based on these two pieces of evidence, what should be the beliefs on the distribution of types in the population? Note that the third feature is not observed by any sensor.

Artificial Intelligence
Sequential Weighted Combination for Unreliable Evidence Based on Evidence Variance

Deqiang Han,Yong Deng,Chongzhao Han

DOI: https://doi.org/10.1016/j.dss.2013.05.004

IF: 6.969

2013-01-01

Decision Support Systems

Abstract:Dempster-Shafer evidence theory is a powerful tool in uncertainty reasoning and decision-making. However counter-intuitive results can be encountered when unreliable bodies of evidence are combined by using Dempster's rule of combination in some cases. In this paper, a novel sequential evidence combination approach is proposed based on the weighted modification of bodies of evidence according to our proposed variances of evidence sequences. Experimental results show that the proposed approach is rational and effective. The proposed approach is a sequential evidence combination rule.Variance of evidence sequence is used to modify the bodies of evidence.The proposed approach can suppress counter-intuitive behaviors of Dempster's rule.
Towards Unifying Perceptual Reasoning and Logical Reasoning

Hiroyuki Kido

DOI: https://doi.org/10.48550/arXiv.2206.13174

2022-06-27

Abstract:An increasing number of scientific experiments support the view of perception as Bayesian inference, which is rooted in Helmholtz's view of perception as unconscious inference. Recent study of logic presents a view of logical reasoning as Bayesian inference. In this paper, we give a simple probabilistic model that is applicable to both perceptual reasoning and logical reasoning. We show that the model unifies the two essential processes common in perceptual and logical systems: on the one hand, the process by which perceptual and logical knowledge is derived from another knowledge, and on the other hand, the process by which such knowledge is derived from data. We fully characterise the model in terms of logical consequence relations.

Artificial Intelligence
Visual Explanation by High-Level Abduction: On Answer-Set Programming Driven Reasoning about Moving Objects

Jakob Suchan,Mehul Bhatt,Przemysław Wałęga,Carl Schultz

DOI: https://doi.org/10.48550/arXiv.1712.00840

2017-12-04

Abstract:We propose a hybrid architecture for systematically computing robust visual explanation(s) encompassing hypothesis formation, belief revision, and default reasoning with video data. The architecture consists of two tightly integrated synergistic components: (1) (functional) answer set programming based abductive reasoning with space-time tracklets as native entities; and (2) a visual processing pipeline for detection based object tracking and motion analysis. We present the formal framework, its general implementation as a (declarative) method in answer set programming, and an example application and evaluation based on two diverse video datasets: the MOTChallenge benchmark developed by the vision community, and a recently developed Movie Dataset.

Artificial Intelligence,Computer Vision and Pattern Recognition,Logic in Computer Science,Robotics

Comparisons of Reasoning Mechanisms for Computer Vision

Evidential Reasoning in Image Understanding

Conditional Evidence Theory and Its Application in Knowledge Discovery

A Behaviorally Evidence-based Method for Computing Spatial Comparisons of Image Scenarios

Using Dempster-Shafer Theory Of Evidence For Situation Inference

A Comparison of Evidence Fusion Rules for Situation Recognition in Sensor-Based Environments

Comparison of Evidential Reasoning Algorithm with Linear Combination in Decision Making

Take A Step Back: Rethinking the Two Stages in Visual Reasoning

Selective Vision is the Challenge for Visual Reasoning: A Benchmark for Visual Argument Understanding

Evidential Reasoning in a Network Usage Prediction Testbed

Comparing Visual Reasoning in Humans and AI

Logical Vision: One-Shot Meta-Interpretive Learning From Real Images

Weighted Evidence Combination with Ranking Distance

Research of artificial neural network intelligent recognition technology assisted by dempster-shafer evidence combination theory

From Recognition to Cognition: Visual Commonsense Reasoning

ROME: Evaluating Pre-trained Vision-Language Models on Reasoning beyond Visual Common Sense

Metaprobability and Dempster-Shafer in Evidential Reasoning

Sequential Weighted Combination for Unreliable Evidence Based on Evidence Variance

Towards Unifying Perceptual Reasoning and Logical Reasoning

Visual Explanation by High-Level Abduction: On Answer-Set Programming Driven Reasoning about Moving Objects