Hierarchy and Statistical Heuristic Search.

Bo Zhang

DOI: https://doi.org/10.1016/0167-739x(90)90008-2

IF: 7.307

1990-01-01

Future Generation Computer Systems

Abstract:In this paper we present a framework for a quotient structure model of hierarchy. As an application of this model, a new statistical heuristic search technique is introduced. Its computational complexity is discussed theoretically and some experimental results are showed as well.

What problem does this paper attempt to address?

Online Hierarchical Scheduling: an Approach Using Mathematical Programming

Zhiyi Tan,An Zhang

DOI: https://doi.org/10.1016/j.tcs.2009.08.014

IF: 1.002

2011-01-01

Theoretical Computer Science

Abstract:This paper considers an online hierarchical scheduling problem on parallel identical machines. We are given a set of m machines and a sequence of jobs. Each machine has a different hierarchy, and each job also has a hierarchy associated with it. A job can be assigned to a machine only if its hierarchy is no less than that of the machine. The objective is to minimize the makespan, i.e., the maximum load of all machines. Two models are studied in the paper. For the fractional model, we present an improved algorithm and lower bounds. Both the algorithm and the lower bound are based on solutions of mathematical programming. For any given m, our algorithm is optimal by numerical calculation. For the integral model, we present both a general algorithm for any m, and an improved algorithm with better competitive ratios of 2.333 and 2.610 for m=4 and 5, respectively.
Analysis and Implementation of Extraction Algorithm of Web Hierarchy Structure

FENG Yan,WANG Shen-kang

DOI: https://doi.org/10.3785/j.issn.1008-973x.2005.10.010

2005-01-01

Abstract:A method for rebuilding Web hierarchy structure in order to increase the efficiency of search engine,Web management and recommender system,etc.was proposed.By analyzing the structural information,such as information,directory information and link information the Web tag structure graph was defined and built on the basis of artificial intelligence and graph theory.The Dijkstral algorithm was applied to extract the hierarchy of the Web site.The algorithm structure is composed of five layers: display layer,Web layer,page analysis layer,pretreatment layer and link layer.Experimental results show that the algorithm can be implemented with great efficiency and speed,and that the Web hierarchy structure is correct.
A New Linkless Hierarchical Structure Based on Perfect Hashing

Weiwei Duan,Jianxin Luo,Guiqiang Ni,Qi Hu,Yi Gao

DOI: https://doi.org/10.12783/dtcse/csae2017/17475

2017-01-01

Abstract:We explore using perfect spatial hashing to store octrees efficiently while needing no explicit parent-to-child pointers. Specifically, we design a new linkless hierarchical structure – one that encodes the absolute locations of the subdivided nodes using specific tokens and packs these nodes into hash tables using perfect hashing. Whereas prior methods have overhead in space and time due to the unused links and chain of the indirection pointers, our linkless hierarchical structure has lower storage requirements and has an efficient random accessibility on the GPUs. The performance of our scheme is demonstrated on different 2D/3D datasets together with some classical algorithms.
Quotient Space Model Based Hierarchical Machine Learning

Z Ling,Z Bo

DOI: https://doi.org/10.1109/icnnb.2005.1614704

2005-01-01

Abstract:We proposed a quotient space based model that can represent the world at different granularities and can be used to handle problems hierarchically. The model can be used in two different ways: top-down deduction and bottom-up induction. In this paper, we will discuss the quotient space model based bottom-up induction, i.e., hierarchical learning. Some approaches for learning the structural knowledge from data are presented. The main advantage of hierarchical induction is its efficiency, that is, the whole structure of data can be abstracted at once.
Fuzzy reasoning model under quotient space structure

Ling Zhang,Bo Zhang

DOI: https://doi.org/10.1016/j.ins.2005.03.005

IF: 8.1

2005-01-01

Information Sciences

Abstract:In this paper, we present a theoretical framework of fuzzy reasoning model under quotient space structure. It consists of (1) introducing quotient space structure into fuzzy sets, i.e., constructing fuzzy set representations of different grain-size spaces and their relationships; (2) introducing the concept of fuzzy sets into quotient space theory, i.e., introducing fuzzy equivalence relation and discussing its corresponding reasoning in different grain-size spaces; and (3) discussing the relationship and transformation among different granular computing methodologies. The framework proposed is aimed to combine two powerful abilities in order to enhance the efficiency of fuzzy reasoning: one is the ability of computing with words based on fuzzy set methodology, the other is the ability of hierarchical problem solving based on quotient space approach.
Feature-Based Hierarchy Spatial Index For Geometry Objects

M Tang,Jx Ge,Jx Dong,L Yu

1999-01-01

Abstract:To improve the efficiency of geometric processing in geometric systems, the paper here proposed a new method of geometry index, feature-based hierarchy spatial index (FBHSI), depending on the hierarchy structure of form feature in a feature-based modeling system, and the boundary locality of features in solid models. The method that has been applied in the Boolean operator of solid models has been used in a feature-based modeling system ZD-MCADII.
Quotient space model of hierarchical query-by-humming system

Wang Zhi,Zhang Bo

DOI: https://doi.org/10.1109/GRC.2005.1547375

2005-01-01

Abstract:In this paper, we put ideas of granular computing into the application of query-by-humming. Leading by quotient space theory of problem solving, we present a quotient space model of hierarchical query-by-humming system, which do search in two stages. The first is searching in the quotient space to obtain high recall rate and a narrowed possible region with accepted speed. The second step is doing accurate but relatively slow search in the small original space to achieve high precision. In addition, we improve the previous dynamic programming techniques for melody matching, which tolerate the input error more reasonably. We also compare our hierarchical method with the previous flat note-based algorithm and frame-based algorithm on MIDI-encoded database of Chinese music and obtain promising results both in efficiency and accuracy.
Optimization Hierarchy for Fair Statistical Decision Problems

Anil Aswani,Matt Olfat

DOI: https://doi.org/10.48550/arXiv.1910.08520

2020-12-30

Abstract:Data-driven decision-making has drawn scrutiny from policy makers due to fears of potential discrimination, and a growing literature has begun to develop fair statistical techniques. However, these techniques are often specialized to one model context and based on ad-hoc arguments, which makes it difficult to perform theoretical analysis. This paper develops an optimization hierarchy, which is a sequence of optimization problems with an increasing number of constraints, for fair statistical decision problems. Because our hierarchy is based on the framework of statistical decision problems, this means it provides a systematic approach for developing and studying fair versions of hypothesis testing, decision-making, estimation, regression, and classification. We use the insight that qualitative definitions of fairness are equivalent to statistical independence between the output of a statistical technique and a random variable that measures attributes for which fairness is desired. We use this insight to construct an optimization hierarchy that lends itself to numerical computation, and we use tools from variational analysis and random set theory to prove that higher levels of this hierarchy lead to consistency in the sense that it asymptotically imposes this independence as a constraint in corresponding statistical decision problems. We demonstrate numerical effectiveness of our hierarchy using several data sets, and we use our hierarchy to fairly perform automated dosing of morphine.

Statistics Theory,Optimization and Control
Quotient Space Based Multi-granular Analysis.

Ling Zhang,Bo Zhang

DOI: https://doi.org/10.1007/978-3-540-76719-0_5

2007-01-01

Abstract:We presented a quotient space model that can represent a problem at different granularities; each model has three components: the universe X, property f and structure T. So a multi-granular analysis can be implemented based on the model. The basic properties among different quotient spaces such as the falsity preserving, the truth preserving properties are discussed. There are three quotient-space model construction approaches, i.e., the construction based on universe, based on property and based on structure. Four examples are given to show how a quotient space model can be constructed from a real problem and how benefit we can get from the multi-granular analysis. First, by adding statistical inference method to heuristic search, a statistical heuristic search approach is presented. Due to the hierarchical and multi-granular problem solving strategy, the computational complexity of the new search algorithm is reduced greatly. Second, in the collision-free paths planning in robotics, the topological model is constructed from geometrical one. By using the truth preserving property between these two models, the paths planning can be implemented in the coarser and simpler topological space so that the computational cost is saved. Third, we discuss the quotient space approximation and the multi-resolution signal analysis. And the second-generation wavelet analysis can be obtained from quotientspace based function approximation. It shows the equivalence relation between the quotient space model based analysis and wavelet transform. Fourth, in the automatic assembly sequence planning of mechanical product, we mainly show how a quotient structure can be constructed from the original one. By using the simpler quotient structure, the assembly sequence planning can be simplified greatly. In conclusion, the quotientspace model enables us to implement a multi-granular analysis. And we can get great benefit from the analysis.
Heuristics in Problem Solving:An Integrative Theoretical Framework

ZHANG Gang,BO Qiushi

DOI: https://doi.org/10.15994/j.1000-0763.2012.06.013

2012-01-01

Abstract:Based on the dual-processing model of human memory system,this paper introduces an analytic framework about heuristics in problem solving in order to clarify the concept's connotation and mechanism.The paper also defines four categories of heuristics according to the problem solvers' knowledge so that it could integrate the existing researches on heuristics.
Conceptual Multi-Level Hierarchy for Evaluation and Classification

Doug Won Choi,Jin Gyu Shin

DOI: https://doi.org/10.1109/cit.2010.259

2010-06-01

Abstract:Conceptual hierarchy represents the relationship between objects or concepts in a hierarchical form. The work presented here focuses on creating hierarchies which have a relationship between parent and child nodes but not between siblings. When we evaluate or classify certain objects (e.g., service quality), we often use a conceptual hierarchy which has various items (concept) at its nodes. If the target of the evaluation/classification has more complicated features, we need a more complicated conceptual hierarchy. And currently most conceptual hierarchies are constructed qualitatively. This paper presents two new quantitative approaches in constructing a conceptual multi-level hierarchy. They are novel in the sense that a multi-level hierarchy (conceptual relationship knowledge) can be generated from a set of questionnaire survey data by applying factor analysis, structural equation modeling, and decision tree induction (C5.0) techniques. Through this factor analysis we discovered pattern knowledge from the heap of questionnaire survey data which contained hidden knowledge about the problem domain. It is a fresh idea to consider the questionnaire survey data as another form of knowledge elicitation for pattern discovery. AHP (Analytic Hierarchy Process) is a widely used technique for multi-criteria decision making. The significance of this paper is that it can substitute the qualitative stage of building hierarchy in the AHP technique, which is renowned for its weakness in hierarchy building.
A Novel Feature Decomposition Method To Develop Multi-Hierarchy Model

Qd Wang,Hp Dai,Yx Sun

DOI: https://doi.org/10.1109/ACC.2005.1470457

2005-01-01

Abstract:The comprehensibility of a model is very important since the results should be ultimately be interpreted by a human. This paper presents a new machine learning method, named feature decomposition method based on rough set theory, to discover concept hierarchies and develop a multi-hierarchy model of database. First the features with more relations are selected into a feature group. Then some measures by rough set theory are presented in this paper. According to these measures, the objects defined on the proposed feature group are labeled to discover a new concept. The new concept hierarchies of the database usually have specific meaning, which increase the transparency of data mining process. Finally the rule induction can process on the concept hierarchies of the database to develop a new multi-hierarchy model. The idea presented is illustrated with examples and datasets from UCI Machine Learning Repository. The results show that the multi-hierarchy model established by feature decomposition method can get high classification accuracy and have better comprehensibility.
Towards Design of System Hierarchy (research survey)

Mark Sh. Levin

DOI: https://doi.org/10.48550/arXiv.1212.1735

2012-12-08

Abstract:The paper addresses design/building frameworks for some kinds of tree-like and hierarchical structures of systems. The following approaches are examined: (1) expert-based procedures, (2) hierarchical clustering; (3) spanning problems (e.g., minimum spanning tree, minimum Steiner tree, maximum leaf spanning tree problem; (4) design of organizational 'optimal' hierarchies; (5) design of multi-layer (e.g., three-layer) k-connected network; (6) modification of hierarchies or networks: (i) modification of tree via condensing of neighbor nodes, (ii) hotlink assignment, (iii) transformation of tree into Steiner tree, (iv) restructuring as modification of an initial structural solution into a solution that is the most close to a goal solution while taking into account a cost of the modification. Combinatorial optimization problems are considered as basic ones (e.g., classification, knapsack problem, multiple choice problem, assignment problem). Some numerical examples illustrate the suggested problems and solving frameworks.

Optimization and Control,Artificial Intelligence,Networking and Internet Architecture,Systems and Control
Multi-Attribute Decision Making with Einstein Aggregation Operators in Complex Q-Rung Orthopair Fuzzy Hypersoft Environments

Changyan Ying,Wushour Slamu,Changtian Ying

DOI: https://doi.org/10.3390/e24101494

IF: 2.738

2022-10-20

Entropy

Abstract:The purpose of our research is to extend the formal representation of the human mind to the concept of the complex q-rung orthopair fuzzy hypersoft set (Cq-ROFHSS), a more general hybrid theory. A great deal of imprecision and ambiguity can be captured by it, which is common in human interpretations. It provides a multiparameterized mathematical tool for the order-based fuzzy modeling of contradictory two-dimensional data, which provides a more effective way of expressing time-period problems as well as two-dimensional information within a dataset. Thus, the proposed theory combines the parametric structure of complex q-rung orthopair fuzzy sets and hypersoft sets. Through the use of the parameter q, the framework captures information beyond the limited space of complex intuitionistic fuzzy hypersoft sets and complex Pythagorean fuzzy hypersoft sets. By establishing basic set-theoretic operations, we demonstrate some of the fundamental properties of the model. To expand the mathematical toolbox in this field, Einstein and other basic operations will be introduced to complex q-rung orthopair fuzzy hypersoft values. The relationship between it and existing methods demonstrates its exceptional flexibility. The Einstein aggregation operator, score function, and accuracy function are used to develop two multi-attribute decision-making algorithms, which prioritize based on the score function and accuracy function to ideal schemes under Cq-ROFHSS, which captures subtle differences in periodically inconsistent data sets. The feasibility of the approach will be demonstrated through a case study of selected distributed control systems. The rationality of these strategies has been confirmed by comparison with mainstream technologies. Additionally, we demonstrate that these results are compatible with explicit histograms and Spearman correlation analyses. The strengths of each approach are analyzed in a comparative manner. The proposed model is then examined and compared with other theories, demonstrating its strength, validity, and flexibility.

physics, multidisciplinary
Exploring Hierarchies in Online Social Networks

Can Lu,Jeffrey Xu Yu,Rong-Hua Li,Hao Wei

DOI: https://doi.org/10.48550/arXiv.1502.04220

2015-02-15

Abstract:Social hierarchy (i.e., pyramid structure of societies) is a fundamental concept in sociology and social network analysis. The importance of social hierarchy in a social network is that the topological structure of the social hierarchy is essential in both shaping the nature of social interactions between individuals and unfolding the structure of the social networks. The social hierarchy found in a social network can be utilized to improve the accuracy of link prediction, provide better query results, rank web pages, and study information flow and spread in complex networks. In this paper, we model a social network as a directed graph G, and consider the social hierarchy as DAG (directed acyclic graph) of G, denoted as GD. By DAG, all the vertices in G can be partitioned into different levels, the vertices at the same level represent a disjoint group in the social hierarchy, and all the edges in DAG follow one direction. The main issue we study in this paper is how to find DAG GD in G. The approach we take is to find GD by removing all possible cycles from G such that G = U(G) + GD where U(G) is a maximum Eulerian subgraph which contains all possible cycles. We give the reasons for doing so, investigate the properties of GD found, and discuss the applications. In addition, we develop a novel two-phase algorithm, called Greedy-&-Refine, which greedily computes an Eulerian subgraph and then refines this greedy solution to find the maximum Eulerian subgraph. We give a bound between the greedy solution and the optimal. The quality of our greedy approach is high. We conduct comprehensive experimental studies over 14 real-world datasets. The results show that our algorithms are at least two orders of magnitude faster than the baseline algorithm.

Social and Information Networks,Data Structures and Algorithms
Ordinal Optimization and Quantification of Heuristic Designs

Zhen Shen,Yu-Chi Ho,Qian-Chuan Zhao

DOI: https://doi.org/10.1007/s10626-009-0067-6

2009-01-01

Discrete Event Dynamic Systems

Abstract:This paper focuses on the performance evaluation of complex man-made systems, such as assembly lines, electric power grid, traffic systems, and various paper processing bureaucracies, etc. For such problems, applying the traditional optimization tool of mathematical programming and gradient descent procedures of continuous variables optimization are often inappropriate or infeasible, as the design variables are usually discrete and the accurate evaluation of the system performance via a simulation model can take too much calculation. General search type and heuristic methods are the only two methods to tackle the problems. However, the "goodness" of heuristic methods is generally difficult to quantify while search methods often involve extensive evaluation of systems at many design choices in a large search space using a simulation model resulting in an infeasible computation burden. The purpose of this paper is to address these difficulties simultaneously by extending the recently developed methodology of Ordinal Optimization (OO). Uniform samples are taken out from the whole search space and evaluated with a crude but computationally easy model when applying OO. And, we argue, after ordering via the crude performance estimates, that the lined-up uniform samples can be seen as an approximate ruler. By comparing the heuristic design with such a ruler, we can quantify the heuristic design, just as we measure the length of an object with a ruler. In a previous paper we showed how to quantify a heuristic design for a special case but we did not have the OO ruler idea at that time. In this paper we propose the OO ruler idea and extend the quantifying method to the general case and the multiple independent results case. Experimental results of applying the ruler are also given to illustrate the utility of this approach.
Qualitative Organization of Collections of Shapes Via Quartet Analysis

Shi-Sheng Huang,Ariel Shamir,Chao-Hui Shen,Hao Zhang,Alla Sheffer,Shi-Min Hu,Daniel Coher-Or

DOI: https://doi.org/10.1145/2461912.2461954

IF: 6.2

2013-01-01

ACM Transactions on Graphics

Abstract:We present a method for organizing a heterogeneous collection of 3D shapes for overview and exploration. Instead of relying on quantitative distances, which may become unreliable between dissimilar shapes, we introduce a qualitative analysis which utilizes multiple distance measures but only in cases where the measures can be reliably compared. Our analysis is based on the notion of quartets, each defined by two pairs of shapes, where the shapes in each pair are close to each other, but far apart from the shapes in the other pair. Combining the information from many quartets computed across a shape collection using several distance measures, we create a hierarchical structure we call categorization tree of the shape collection. This tree satisfies the topological (qualitative) constraints imposed by the quartets creating an effective organization of the shapes. We present categorization trees computed on various collections of shapes and compare them to ground truth data from human categorization. We further introduce the concept of degree of separation chart for every shape in the collection and show the effectiveness of using it for interactive shapes exploration.
Quotient Space Based Problem Solving: A Theoretical Foundation Of Granular Computing Preface

Ling Zhang,Bo Zhang

2014-01-01

Abstract:Quotient Space Based Problem Solving provides an in-depth treatment of hierarchical problem solving, computational complexity, and the principles and applications of multi-granular computing, including inference, information fusing, planning, and heuristic search. Explains the theory of hierarchical problem solving, its computational complexity, and discusses the principle and applications of multi-granular computing Describes a human-like, theoretical framework using quotient space theory, that will be of interest to researchers in artificial intelligence. Provides many applications and examples in the engineering and computer science area. Includes complete coverage of planning, heuristic search and coverage of strictly mathematical models.
Iterative Hierarchy and Ranking Process (IHRP): A Novel Effective Hierarchy Method for Densely Connected Systems and Case Study in Student Performance Assessment

Suvojit Dhara,Adrijit Goswami

DOI: https://doi.org/10.48550/arXiv.2306.10409

2024-02-04

Abstract:In real-life decision-making problems, determining the influences of the factors on the decision attribute is one of the primary tasks. To affect the decision attribute most, finding a proper hierarchy among the factors and determining their importance values in the system becomes quite important. Interpretive structural modeling (ISM) is a widely used hierarchy-building method that mines factor inter-influences based on expert opinions. This paper discusses one of the main drawbacks of the conventional ISM method in systems where the factors are densely interrelated. We refer to such systems as "dense systems". We propose a novel iterative hierarchy-building technique, called 'Iterative Hierarchy and Ranking Process'(IHRP) which performs effectively in such dense systems. To take the vagueness of the expert opinions into account, intuitionistic fuzzy linguistics has been used in the research work. In this paper, we propose a two-stage calculation of the relative importance of the factors in the system based on their hierarchical positions and rank the factors accordingly. We have performed a case study on student performance assessment by taking up novel Indian high-school administrative factors' data collected by surveying the experts in this field. A comparative study has been conducted in terms of the correlation of the factor ranking achieved by the proposed method and conventional ISM method with that of standard outranking methods like TOPSIS, and VIKOR. Our proposed IHRP framework achieves an 85-95% correlation compared to a 50-60% correlation for the conventional ISM method. This proves the effectiveness of the proposed method in determining a better hierarchy than the conventional method, especially in dense systems.

Artificial Intelligence,Multiagent Systems
An Update and Summary of Multi-granular Computing and Quotient Structure

Ling Zhang,Bo Zhang

DOI: https://doi.org/10.1109/GrC.2010.67

2010-01-01

Granular Computing

Abstract:Human always conceptualizes the world at different granularities and deals with it hierarchically. This is one of human's characteristics that underlie his/her power. The quotient space model that we presented is a mathematical model of human multi-granular problem solving. In the paper, we introduce the model and discuss how to use the model to deal with the granularity relation, hierarchical problem solving. We also present the future research directions.

Hierarchy and Statistical Heuristic Search.

Online Hierarchical Scheduling: an Approach Using Mathematical Programming

Analysis and Implementation of Extraction Algorithm of Web Hierarchy Structure

A New Linkless Hierarchical Structure Based on Perfect Hashing

Quotient Space Model Based Hierarchical Machine Learning

Fuzzy reasoning model under quotient space structure

Feature-Based Hierarchy Spatial Index For Geometry Objects

Quotient space model of hierarchical query-by-humming system

Optimization Hierarchy for Fair Statistical Decision Problems

Quotient Space Based Multi-granular Analysis.

Heuristics in Problem Solving:An Integrative Theoretical Framework

Conceptual Multi-Level Hierarchy for Evaluation and Classification

A Novel Feature Decomposition Method To Develop Multi-Hierarchy Model

Towards Design of System Hierarchy (research survey)

Multi-Attribute Decision Making with Einstein Aggregation Operators in Complex Q-Rung Orthopair Fuzzy Hypersoft Environments

Exploring Hierarchies in Online Social Networks

Ordinal Optimization and Quantification of Heuristic Designs

Qualitative Organization of Collections of Shapes Via Quartet Analysis

Quotient Space Based Problem Solving: A Theoretical Foundation Of Granular Computing Preface

Iterative Hierarchy and Ranking Process (IHRP): A Novel Effective Hierarchy Method for Densely Connected Systems and Case Study in Student Performance Assessment

An Update and Summary of Multi-granular Computing and Quotient Structure