Recognizing Objective Information

Jianfeng Xu,Shuliang Wang,Zhenyu Liu,Yashi Wang,Yingfei Wang,Yingxu Dang

2023-01-01

Abstract:Abstract To understand the importance and necessity of studying objective information, in this chapter, it will first analyzes the similarities and dissimilarities between objective information and subjective knowledge, then introduces the basic forms of information, and finally gives the role of objective information.

What problem does this paper attempt to address?

Research on Metrics and Models for Objective Information

XU JianFeng,TANG Jun,MA XueFeng,XU Bin,SHEN YanLi,QIAO YongJie

DOI: https://doi.org/10.1360/n112014-00040

2015-01-01

Abstract:In this contemporary era, the importance of information is undisputed, but there has never been a common understanding of information, nor has a unanimous conclusion been reached by studies conducted on information metrics. On the basis of previous studies conducted, this paper analyzes the important achievements in research conducted into the properties and metrics of information, as well as their main insufficiencies, and discusses the essence, connotations, mathematical expressions, and basic problems related to information. On the basis of the understanding of the objectivity of information, it then proposes definitions and a sextuple model of objective information, discusses the basic properties of information, and explores the definitions and mathematical expressions of nine kinds of information metrics: extensity, detailedness, sustainability, richness, containability, delay, distribution, validity, and matchability. Through these metrics, this paper establishes a basic underlying framework for objective information theory that provides comprehensive support for systematic analysis and research on information and information systems.
Objective Information Theory: A Sextuple Model and 9 Kinds of Metrics

Xu Jianfeng,Tang Jun,Ma Xuefeng,Xu Bin,Shen Yanli,Qiao Yongjie

DOI: https://doi.org/10.48550/arXiv.1308.3372

2014-04-04

Abstract:In the contemporary era, the importance of information is undisputed, but there has never been a common understanding of information, nor a unanimous conclusion to the researches on information metrics. Based on the previous studies, this paper analyzes the important achievements in the researches of the properties and metrics of information as well as their main insufficiencies, and explores the essence and connotation, the mathematical expressions and other basic problems related to information. On the basis of the understanding of the objectivity of information, it proposes the definitions and a Sextuple model of information; discusses the basic properties of information, and brings forward the definitions and mathematical expressions of nine kinds of metrics of information, i.e., extensity, detailedness, sustainability, containability, delay, richness, distribution, validity and matchability. Through these, this paper establishes a basic theory frame of Objective Information Theory to support the analysis and research on information and information system systematically and comprehensively.

Information Theory
On the Nature of Information: How FAIR Digital Objects are Building-up Semantic Space

Hans-Günther Döbereiner

DOI: https://doi.org/10.3897/rio.8.e95119

2022-10-13

Research Ideas and Outcomes

Abstract:In this paper, we are concerned about the nature of information and how to gather and compose data with the help of so called FAIR digital objects (FDOs) in order to transform them to knowledge. FDOs are digital surrogates of real objects. The nature of information is intrinsically linked to the kind of questions one is asking. One might not ask a question or get philosophical about it. Answers depend on the data different disciplines gather about their objects of study. In Statistical Physics, classical Shannon entropy measures system order which in equilibrium just equals the heat exchanged with the environment. In cell biology, each protein carries certain functions which create specific information. Cognitive science describes how organisms perceive their environment via functional sensors and control behavior accordingly. Note that one can have function and control without meaning. In contrast, psychology is concerned with the assessment of our perceptions by assigning meaning and ensuing actions. Finally, philosophy builds logical constructs and formulates principles, in effect transforming facts into complex knowledge. All these statements make sense, but there is an even more concise way. Indeed, Luciano Floridi provides a precise and thorough classification of information in his central oeuvre On the Philosophy of Information (Floridi 2013). Especially, he performs a sequential construction to develop the attributes which data need to have in order to count as knowledge. Semantic information is necessarily well-formed, meaningful and truthful. Well-formed data becomes meaningful by action based-semantics of an autonomous-agent solving the symbol grounding problem (Taddeo and Floridi 2005) interacting with the environment. Knowledge is created then by being informed through relevant data accounted for. We notice that the notion of agency is crucial for defining meaning. The apparent gap between Sciences and Humanities (Bawden and Robinson 2020) is created by the very existence of meaning. Further, meaning depends on interactions & connotations which are commensurate with the effective complexity of the environment of a particular agent resulting in an array of possible definitions.In his classical paper More is different (Anderson 1972) discussed verbatim the hierarchical nature of science. Each level is made of and obeys the laws of its constituents from one level below with the higher-level exhibiting emergent properties like wetness of water assignable only to the whole system. As we rise through the hierarchies, there is a branch of science for each level of complexity; on each complexity level there are objects for which it is appropriate and fitting to build up vocabulary for the respective levels of description leading to formation of disciplinary languages. It is the central idea of causal emergence that on each level there is an optimal degree of coarse graining to define those objects in such a way that causality becomes maximal between them. This means there is emergence of informative higher scales in complex materials extending to biological systems and into the brain with its neural networks representing our thoughts in a hierarchy of neural correlates. A computational toolkit for optimal level prediction and control has been developed (Hoel and Levin 2020) which was conceptually extended to integrated information theory of consciousness (Albantakis et al. 2019). The large gap between sciences and humanities discussed above exhibits itself in a series of small gaps connected to the emergence of informative higher scales. It has been suggested that the origin of life may be identified as a transition in causal structure and information flow (Walker 2014). Integrated information measures globally how much the causal mechanisms of a system reduce the uncertainty about the possible causes for a given state. A measure of "information flow" that accurately captures causal effects has been proposed (Ay and Polani 2008). The state of the art is presented in (Ay et al. 2022) where the link between information and complexity is discussed. Ay et al single out hierarchical systems and interlevel causation. Even further, (Rosas et al. 2020) reconcile conflicting views of emergence via an exact information-theoretic approach to identify causal emergence in multivariate data. As information becomes differentially richer one eventually needs complexity measures beyond {Rn}. One may define generalized metrices on these spaces (Pirró 2009) measuring information complexity on ever higher hierarchical levels of information. As one rises through hierarchies, information on higher scale is usually gained by coarse graining to arrive at an effective, nevertheless exact description, on the higher scale. It is repeated coarse graining of syntactically well-ordered information layers which eventually leads to semantic information in a process which I conje -Abstract Truncated-

multidisciplinary sciences
Introduction: Information Is What Information Does

Pieter Adriaans,Johan Van Benthem

DOI: https://doi.org/10.1016/B978-0-444-51726-5.50006-6

2008-01-01

Abstract:Information is a high-frequency and low-content phrase that permeates our or- dinary language without attracting much attention, since its meaning has long eroded. Even so, is there more to the notion, and in particular, is there philoso- phy to it? The editors of the series of 'Handbook of the Philosophy of Science" thought so, when they invited us to contribute a volume, more years ago than we care to remember. But right at the start, a distinction must be made concerning the aim of this text, which comes from the philosophy of language. A Hand- book for an established field has a descriptive function in terms of 'what there is', serving as a record of insights and issues. But other, activist Handbooks have a performative use, trying to create a new field by a 'let it be'. The present volume is definitely of the second category. Clearly, one cannot just create an academic discipline by fiat when there is no material to go on. But as it happens, information is a unifying notion across the sciences and humanities, with a backbone of serious mathematical theory. More- over, there is even a whole discipline of 'informatics' ('computer science', in the unfortunate terminology used in some countries) which studies the structure of representation and transformation of information by machines, but gradually also by humans, and various hybrids of the two. Indeed, universities in several coun- tries have created schools of Informatics or Information Sciences, highlighting the central role of information and its associated themes of computation and cognition in the modern academic landscape. But this observation again calls for a distinction, this time concerning our pur- pose. 'Philosophy of information' might mean philosophy of the information sci- ences, just as there is philosophy of the natural sciences, the life sciences, or hu- manities. Such methodological reflection on specific fields is absolutely necessary given the explosion of relevant technical research. It will be found in abundance in the pages of this Handbook, with authors engaging in foundational analysis of disciplines such as computer science, economics, linguistics, or physics. But there is also the parallel, and in some ways more ambitious aim of information as a major category of thought within philosophy itself, which might have the potential of transforming that whole field. Indeed, major philosophers like Fred
An Information-Theoretic Approach to Analyze NLP Classification Tasks

Luran Wang,Mark Gales,Vatsal Raina

2024-02-02

Abstract:Understanding the importance of the inputs on the output is useful across many tasks. This work provides an information-theoretic framework to analyse the influence of inputs for text classification tasks. Natural language processing (NLP) tasks take either a single element input or multiple element inputs to predict an output variable, where an element is a block of text. Each text element has two components: an associated semantic meaning and a linguistic realization. Multiple-choice reading comprehension (MCRC) and sentiment classification (SC) are selected to showcase the framework. For MCRC, it is found that the context influence on the output compared to the question influence reduces on more challenging datasets. In particular, more challenging contexts allow a greater variation in complexity of questions. Hence, test creators need to carefully consider the choice of the context when designing multiple-choice questions for assessment. For SC, it is found the semantic meaning of the input text dominates (above 80\% for all datasets considered) compared to its linguistic realisation when determining the sentiment. The framework is made available at:

Computation and Language,Artificial Intelligence,Information Theory
The Uncertainty and Explainability in Object Recognition

Wei Hui,Liping Yu

DOI: https://doi.org/10.1080/0952813x.2020.1785021

2020-01-01

Journal of Experimental & Theoretical Artificial Intelligence

Abstract:In the object recognition task, due to changes in size, colour, illumination, position, viewing angle, and environmental background, great uncertainty is caused. The invariant recognition capability required to adapt to such diverse uncertainties has also become one of the most challenging goals of artificial intelligence, as only biometric systems can do this. The approach to dealing with uncertainty in the field of pattern recognition is nothing more than training with a large number of samples and powerful machine learning algorithms, and finally generating a classifier. Among them, knowledge representation has not only been ignored, but has even been considered redundant. But research from cognitive psychology and experimental psychology suggests that humans do not use such a huge mechanism. In contrast, we use more similar methods of symbolic artificial intelligence, such as representation, induction, reasoning, interpretation, and constraint propagation, to deal with uncertainty in object recognition. In this paper, the skeleton tree is used as the basic means to form the formal representation of the topological features and geometric features of the object, and based on the generalisation framework, the knowledge extraction of a small number of similar representations is used to form a generalised explicit representation of the knowledge about the object category. This generalised form representation can cope with uncertainties such as size, colour, shape, etc., and is significantly superior to current mainstream machine learning methods in terms of explainability and computational cost.
How to select an objective function using information theory

Timothy O. Hodson,Thomas M. Over,Tyler J. Smith,Lucy M. Marshall

DOI: https://doi.org/10.1029/2023WR035803

2024-06-04

Abstract:In machine learning or scientific computing, model performance is measured with an objective function. But why choose one objective over another? Information theory gives one answer: To maximize the information in the model, select the objective function that represents the error in the fewest bits. To evaluate different objectives, transform them into likelihood functions. As likelihoods, their relative magnitude represents how strongly we should prefer one objective versus another, and the log of that relation represents the difference in their bit-length, as well as the difference in their uncertainty. In other words, prefer whichever objective minimizes the uncertainty. Under the information-theoretic paradigm, the ultimate objective is to maximize information (and minimize uncertainty), as opposed to any specific utility. We argue that this paradigm is well-suited to models that have many uses and no definite utility, like the large Earth system models used to understand the effects of climate change.

Machine Learning
An Introduction to Neural Information Processing

Peiji Liang,Si Wu,Fanji Gu

DOI: https://doi.org/10.1007/978-94-017-7393-5

2015-01-01

Abstract:This book provides an overview of neural information processing research, which is one of the most important branches of neuroscience today. Neural information processing is an interdisciplinary subject, and the merging interaction between neuroscience and mathematics, physics, as well as information science plays a key role in the development of this field. This book begins with the anatomy of the central nervous system, followed by an introduction to various information processing models at different levels. The authors all have extensive experience in mathematics, physics and biomedical engineering,and have worked in this multidisciplinary area for a number of years. They present classical examples of how the pioneers in this field used theoretical analysis, mathematical modeling and computer simulation to solve neurobiological problems, and share their experiences and lessons learned. The book is intended for researchers and students with a mathematics, physics or informatics background who are interested in brain research and keen to understand the necessary neurobiology and how they can use their specialties to address neurobiological problems. It is also provides inspiration for neuroscience students who are interested in learning how to use mathematics, physics or informatics approaches to solve problems in their field.
An Information Investigation into Humanities and Social Sciences

YAN Xue-shan

DOI: https://doi.org/10.3969/j.issn.1671-7023.2006.02.023

2006-01-01

Journal of Huazhong University of Science and Technology

Abstract:The concept of information has penetrated into all the humanities and social sciences,part of natural sciences,and some engineering sciences,many disciplines have been affected by it.This article considers the Informology,Linguistics,Communicology,Psychology as an information discipline group.They take the noumenon, symbol,transmission,processing of information as their tasks,so we call them Social Information Sciences.As a paradigm,we can view News Informatics,History Informatics,Art Informatics,Literature Informatics,Science Informatics,Education Informatics,and Religion Informatics as applied Social Information Sciences.The article has a simple glance on them separately.
Analysis of Core Documents in Information Security Based on Mapping Knowledge Domains.

Hong-zhou Shen,Qin-jian Yuan,Qian-jin Zong,Ling-yu Tong

DOI: https://doi.org/10.5220/0003576704210427

2018-01-01

Abstract:It has been gradually realized that the research of Information Security should beyond the only perspective of technology, but from a perspective of inter-discipline. However, researchers belonging to a certain discipline often seem to have a poor awareness of the contributions made by researchers in other disciplines. In order to help researchers fully understand the contributions made by researchers in other disciplines, this paper, with the method of Mapping Knowledge Domains, identifies four clusters of core documents that get more attention and analyze the contents of core documents in each cluster. Finally, there is also an analysis on evolution of these core documents in this paper.
Overview of Visual Information Representation

Xiang Sean Zhou,Yong Rui,Thomas S. Huang

DOI: https://doi.org/10.1007/978-1-4615-0497-9_2

2003-01-01

Abstract: Machine “sees” every pixel in an image, but can it detect, say, happiness or excitement in a picture or video? Can it EVER “feel” the emotions or semantics behind?
Information-Theoretic Foundations for Machine Learning

Hong Jun Jeon,Benjamin Van Roy

2024-08-20

Abstract:The staggering progress of machine learning in the past decade has been a sight to behold. In retrospect, it is both remarkable and unsettling that these milestones were achievable with little to no rigorous theory to guide experimentation. Despite this fact, practitioners have been able to guide their future experimentation via observations from previous large-scale empirical investigations. However, alluding to Plato's Allegory of the cave, it is likely that the observations which form the field's notion of reality are but shadows representing fragments of that reality. In this work, we propose a theoretical framework which attempts to answer what exists outside of the cave. To the theorist, we provide a framework which is mathematically rigorous and leaves open many interesting ideas for future exploration. To the practitioner, we provide a framework whose results are very intuitive, general, and which will help form principles to guide future investigations. Concretely, we provide a theoretical framework rooted in Bayesian statistics and Shannon's information theory which is general enough to unify the analysis of many phenomena in machine learning. Our framework characterizes the performance of an optimal Bayesian learner, which considers the fundamental limits of information. Throughout this work, we derive very general theoretical results and apply them to derive insights specific to settings ranging from data which is independently and identically distributed under an unknown distribution, to data which is sequential, to data which exhibits hierarchical structure amenable to meta-learning. We conclude with a section dedicated to characterizing the performance of misspecified algorithms. These results are exciting and particularly relevant as we strive to overcome increasingly difficult machine learning challenges in this endlessly complex world.

Machine Learning,Artificial Intelligence
Information structures and uncertainty in an image information system

Gangqiang Zhang,Zhaowen Li,Pengfei Zhang,Ningxin Xie

DOI: https://doi.org/10.3233/jifs-191628

2021-01-04

Abstract:An information system as a database that stands for relationships between objects and attributes is an important mathematical model. An image information system is an information system where each of its information values is an image and its information structures embody internal features of this type of information system. Uncertainty measurement is an effective tool for evaluation. This paper explores measures of uncertainty for an information system by using the proposed information structures. The distance between two objects in an image information system is first given. After that, the fuzzy Tcos-equivalence relation, induced by this system by using Gaussian kernel method, is obtained, where Gaussian kernel is based on this distance. Next, information structures of this system are described by set vectors, dependence between information structures is studied and properties of information structures are given by using inclusion degree, and application for information structures and uncertainty measures of an image information system are investigated by the information structures. Moreover, effectiveness analysis is done to show the feasibility of the proposed measures from the angle of statistics. Finally, an application of the proposed measurement for attribute reduction is given. These results will be helpful for understanding the essence of uncertainty in an image information system.
The Understanding of Spatial-Temporal Behaviors

Yu-Jin Zhang

DOI: https://doi.org/10.4018/978-1-5225-2255-3.ch115

2018-01-01

Abstract:This chapter introduces a cutting-edge research field of computer vision and image understanding – the spatial-temporal behavior understanding. The main concepts, the focus of research, the typical technology, the fast development, etc. of this new field in recent years are overviewed. An important task in computer vision and image understanding is to analyze the scene through image operation on the image of scene in order to guide the action. To do this, one needs to locate the objects in the scene, and to determine how they change its position, attitude, speed, and relationships in the space over time. In short, it is to grasp the action in time and space, to determine the purpose of the operation, and thus to understand the semantics of the information they passed. This is referred ti as the understanding of spatial-temporal behaviors.
Abstract Intelligence

Yingxu Wang,Lotfi A. Zadeh,Bernard Widrow,Newton Howard,Francoise Beaufays,George Baciu,D. Frank Hsu,Guiming Luo,Fumio Mizoguchi,Shushma Patel,Victor Raskin,Shusaku Tsumoto,Wei,Du Zhang

DOI: https://doi.org/10.4018/ijcini.2017010101

IF: 0.9

2017-01-01

International Journal of Cognitive Informatics and Natural Intelligence

Abstract:Basic studies in denotational mathematics and mathematical engineering have led to the theory of abstract intelligence aI, which is a set of mathematical models of natural and computational intelligence in cognitive informatics CI and cognitive computing CC. Abstract intelligence triggers the recent breakthroughs in cognitive systems such as cognitive computers, cognitive robots, cognitive neural networks, and cognitive learning. This paper reports a set of position statements presented in the plenary panel Part II of IEEE ICCI*CC'16 on Cognitive Informatics and Cognitive Computing at Stanford University. The summary is contributed by invited panelists who are part of the world's renowned scholars in the transdisciplinary field of CI and CC.
Identifying Objective and Subjective Words via Topic Modeling

Hanqi Wang,Fei Wu,Weiming Lu,Yi Yang,Xi Li,Xuelong Li,Yueting Zhuang

DOI: https://doi.org/10.1109/TNNLS.2016.2626379

IF: 14.255

2018-01-01

IEEE Transactions on Neural Networks and Learning Systems

Abstract:It is observed that distinct words in a given document have either strong or weak ability in delivering facts (i.e., the objective sense) or expressing opinions (i.e., the subjective sense) depending on the topics they associate with. Motivated by the intuitive assumption that different words have varying degree of discriminative power in delivering the objective sense or the subjective sense with...
New measures of uncertainty for an interval-valued information system

Ningxin Xie,Meng Liu,Zhaowen Li,Gangqiang Zhang

DOI: https://doi.org/10.1016/j.ins.2018.08.047

IF: 8.1

2019-01-01

Information Sciences

Abstract:An information system as a database that represents relationships between objects and attributes is an important mathematical model. An interval-valued information system is a generalized model of single-valued information systems. As important evaluation tools in the field of machine learning, measures of uncertainty can quantify the dependence and similarity between two targets. However, the existing measures of uncertainty for interval-valued information systems have not been thoroughly researched. This paper is devoted to the study of new measures of uncertainty for an interval-valued information system. Information structures are first introduced in a given interval-valued information system. Then, the dependence between two information structures is depicted. Next, new measures of uncertainty for an interval-valued information system are investigated by using the information structures. As an application of the proposed measures, the rough entropy of a rough set is proposed by means of information granulation. Finally, a numerical experiment on the Face recognition dataset is presented to demonstrate the feasibility of the proposed measures, and a statistical effectiveness analysis is conducted. The results are helpful for understanding the essence of uncertainty in interval-valued information systems.

computer science, information systems
Theoretical Unification of the Fractured Aspects of Information

Marcin J. Schroeder

DOI: https://doi.org/10.48550/arXiv.2402.16924

2024-02-26

Abstract:The article has as its main objective the identification of fundamental epistemological obstacles in the study of information related to unnecessary methodological assumptions and the demystification of popular beliefs in the fundamental divisions of the aspects of information that can be understood as Bachelardian rupture of epistemological obstacles. These general considerations are preceded by an overview of the motivations for the study of information and the role of the concept of information in the conceptualization of intelligence, complexity, and consciousness justifying the need for a sufficiently general perspective in the study of information, and are followed at the end of the article by a brief exposition of an example of a possible application in the development of the unified theory of information free from unnecessary divisions and claims of superiority of the existing preferences in methodology. The reference to Gaston Bachelard and his ideas of epistemological obstacles and epistemological ruptures seems highly appropriate for the reflection on the development of information study, in particular in the context of obstacles such as the absence of semantics of information, negligence of its structural analysis, separation of its digital and analog forms, and misguided use of mathematics.

Artificial Intelligence
On the Information Structure,Subtopic and Analytic Problems of Chinese Objects

Wen-xi YE

DOI: https://doi.org/10.16601/j.cnki.issn1002-5227.2015.02.007

2015-01-01

Abstract:The paper comments on the latest research of information structure ,especially on the study of Mary Dalrymlpe & Irina Nikolaeva(2011) .Referring to the factor of discourse ,the article thinks that there are much more complicated situation in the expressions about focus and topic of Chi‐nese objects ,and also provides some pieces of evidence to prove that there are subtopics in the location of ordinary Chinese objects .There are some important constraints on the interface between informa‐tion structure and syntactic structure of Chinese .By elementary investigation , the article supposes that there is one unmarked hierarchical pattern of salient degree of topics in Chinese .T he nominal syn‐tactic elements all have the potential function of topicality .Under the situation of unmarkedness ,the elements of higher topicality are arranged ahead ,and relatively the ones of lower topicality are ar‐ranged behind .Finally ,the article proposes one series of problems about Chinese objects that should be explored in future .

Recognizing Objective Information

Research on Metrics and Models for Objective Information

Objective Information Theory: A Sextuple Model and 9 Kinds of Metrics

On the Nature of Information: How FAIR Digital Objects are Building-up Semantic Space

Introduction: Information Is What Information Does

An Information-Theoretic Approach to Analyze NLP Classification Tasks

The Uncertainty and Explainability in Object Recognition

How to select an objective function using information theory

An Introduction to Neural Information Processing

An Information Investigation into Humanities and Social Sciences

Analysis of Core Documents in Information Security Based on Mapping Knowledge Domains.

Overview of Visual Information Representation

Information-Theoretic Foundations for Machine Learning

Information structures and uncertainty in an image information system

The Understanding of Spatial-Temporal Behaviors

Abstract Intelligence

Identifying Objective and Subjective Words via Topic Modeling

New measures of uncertainty for an interval-valued information system

Theoretical Unification of the Fractured Aspects of Information

On the Information Structure,Subtopic and Analytic Problems of Chinese Objects