Ordered Sets for Data Analysis

Sergei O. Kuznetsov
2019-08-28
Abstract:This book dwells on mathematical and algorithmic issues of data analysis based on generality order of descriptions and respective precision. To speak of these topics correctly, we have to go some way getting acquainted with the important notions of relation and order theory. On the one hand, data often have a complex structure with natural order on it. On the other hand, many symbolic methods of data analysis and machine learning allow to compare the obtained classifiers w.r.t. their generality, which is also an order relation. Efficient algorithms are very important in data analysis, especially when one deals with big data, so scalability is a real issue. That is why we analyze the computational complexity of algorithms and problems of data analysis. We start from the basic definitions and facts of algorithmic complexity theory and analyze the complexity of various tools of data analysis we consider. The tools and methods of data analysis, like computing taxonomies, groups of similar objects (concepts and n-clusters), dependencies in data, classification, etc., are illustrated with applications in particular subject domains, from chemoinformatics to text mining and natural language processing.
Logic in Computer Science,Artificial Intelligence
What problem does this paper attempt to address?
The paper primarily explores the application of ordered sets in data analysis, particularly in the fields of relations, orders, lattices, and Formal Concept Analysis (FCA). The paper aims to address the following key issues: 1. **Handling complex data**: As the types of data become increasingly diverse, such as text, chemical structures, biological structures, etc., traditional methods for handling numerical or nominal data are no longer suitable. Therefore, new theories and techniques need to be developed to effectively analyze these complex data. 2. **Utilizing the natural order structure of data**: Many types of data inherently possess some natural order structure. For example, in symbolic data, descriptions can be ordered by generality. Utilizing this natural order structure can help better understand and analyze the data. 3. **Improving algorithm efficiency**: Especially in big data analysis, the efficiency of algorithms is crucial. Therefore, studying the time complexity and space complexity of algorithms is very important for optimizing data processing workflows. 4. **Formal Concept Analysis**: Formal Concept Analysis is a mathematical framework used to discover the conceptual structure within a dataset. By constructing concept lattices, patterns and associations in the data can be revealed, supporting tasks such as data classification and knowledge discovery. 5. **Dependency relationships and rule mining**: The paper also discusses how to extract dependency relationships and rules from data, which is essential for understanding the connections between data and predicting new information. In summary, this paper aims to establish a mathematical and algorithmic framework based on the general order of data descriptions to support efficient and in-depth data analysis. It particularly focuses on how to handle non-numerical data and provides corresponding tools and techniques to analyze the structure and content of these data.