Abstract:The AI community is increasingly putting its attention towards combining symbolic and neural approaches, as it is often argued that the strengths and weaknesses of these approaches are complementary. One recent trend in the literature are weakly supervised learning techniques that employ operators from fuzzy logics. In particular, these use prior background knowledge described in such logics to help the training of a neural network from unlabeled and noisy data. By interpreting logical symbols using neural networks, this background knowledge can be added to regular loss functions, hence making reasoning a part of learning. We study, both formally and empirically, how a large collection of logical operators from the fuzzy logic literature behave in a differentiable learning setting. We find that many of these operators, including some of the most well-known, are highly unsuitable in this setting. A further finding concerns the treatment of implication in these fuzzy logics, and shows a strong imbalance between gradients driven by the antecedent and the consequent of the implication. Furthermore, we introduce a new family of fuzzy implications (called sigmoidal implications) to tackle this phenomenon. Finally, we empirically show that it is possible to use Differentiable Fuzzy Logics for semi-supervised learning, and compare how different operators behave in practice. We find that, to achieve the largest performance improvement over a supervised baseline, we have to resort to non-standard combinations of logical operators which perform well in learning, but no longer satisfy the usual logical laws.

OR/AND Neurons for Fuzzy Set Connectives Using Ordinal Sums and Genetic Algorithms

One generalization of the naive bayes to fuzzy sets and the design of the fuzzy naive bayes classifier

Linguistic Modelling Based on Semantic Similarity Relation among Linguistic Labels

Fuzzy modeling incorporated with fuzzy d-s theory and fuzzy naive bayes

Learning Disjunctive Concepts Based on Fuzzy Semantic Cell Models Through Principles of Justifiable Granularity and Maximum Fuzzy Entropy

Fuzzy Datalog$^\exists$ over Arbitrary t-Norms

n-ary Fuzzy Logic and Neutrosophic Logic Operators

Analyzing Differentiable Fuzzy Logic Operators

Modeling of Fuzzy Systems Based on the Competitive Neural Network

Fuzzy Logic and Markov Kernels

The Research Of Logical Operators Based On Rough Connection Degree

A Logical Framework for Fuzzy Quantifiers Part I: Basic Properties

New Universal Logic Operation Models And Neurons On Generalized Interval

A Fuzzy Logic for an Ordinal Sum T-Norm

Scales and Hedges in a Logic with Analogous Semantics

A Genetic-Based Method for Training Fuzzy Systems

A new continuous t-norm and its application in fuzzy control

Fuzzy Concept Lattice and Fuzzy Reasoning

Generating methods of some classes of fuzzy implications obtained by unary functions and algebraic structures

The fuzzy genetic algorithm based on rule

EFNN-NullUni: An evolving fuzzy neural network based on null-uninorm