Abstract:This paper reports on empirical work aimed at comparing evidential reasoning techniques. While there is prima facie evidence for some conclusions, this i6 work in progress; the present focus is methodology, with the goal that subsequent results be meaningful. The domain is a network of UNIX* cycle servers, and the task is to predict properties of the state of the network from partial descriptions of the state. Actual data from the network are taken and used for blindfold testing in a betting game that allows abstention. The focal technique has been Kyburg's method for reasoning with data of varying relevance to a particular query, though the aim is to be able eventually to compare various uncertainty calculi. The conclusions are not novel, but are instructive. 1. All of the calculi performed better than human subjects, so unbiased access to sample experience is apparently of value. 2. Performance depends on metric: (a) when trials are repeated, net = gains - losses favors methods that place many bets, if the probability of placing a correct bet is sufficiently high; that is, it favors point-valued formalisms; (b) yield = gains/(gains + lossee) favors methods that bet only when sure to bet correctly; that is, it favors interval-valued formalisms. 3. Among the calculi, there were no clear winners or losers. Methods are identified for eliminating the bias of the net as a performance criterion and for separating the calculi effectively: in both cases by posting odds for the betting game in the appropriate way.

Some Notes on Betting Commitment Distance in Evidence Theory

Testing by Betting while Borrowing and Bargaining

Belief Interval-Based Distance Measures in the Theory of Belief Functions.

Advances in DS Evidence Theory and Related Discussions

A Modified Belief Entropy in Dempster-Shafer Framework

New Distance Measures of Evidence Based on Belief Intervals.

A Novel Evidence Distance in Power Set Space.

Weighted Evidence Combination with Ranking Distance

Ranking basic belief assignments in decision making under uncertain environment

A Research on the Influence of Evidence Distance Selection on Combination of Conflict Evidences

New Measurement Methods of Evidence Conflict Based on Binary Function

New Dissimilarity Measures in Evidence Theory.

The Application of Different Distance Functions in DS Evidence Theory

Evidential Reasoning in a Network Usage Prediction Testbed

An Efficient Combination Method of Conflict Evidences

Combining belief functions based on distance of evidence

When and to What Extent Should Two Belief Functions Be Discounted?

Evidence Generalization-Based Discounting Method: Assigning Unreliable Information to Partial Ignorance

Probability and Fairness

New Method to Combine Conflict Evidence Based on Pignistic Probability Distance

Modified Evidence Combination Method Based on Pignistic Probability Distance and Uncertainty Degree