Abstract:Abstract reasoning refers to the ability to analyze information, discover rules at an intangible level, and solve problems in innovative ways. Raven's Progressive Matrices (RPM) test is typically used to examine the capability of abstract reasoning. The subject is asked to identify the correct choice from the answer set to fill the missing panel at the bottom right of RPM (e.g., a 3$\times$3 matrix), following the underlying rules inside the matrix. Recent studies, taking advantage of Convolutional Neural Networks (CNNs), have achieved encouraging progress to accomplish the RPM test. However, they partly ignore necessary inductive biases of RPM solver, such as order sensitivity within each row/column and incremental rule induction. To address this problem, in this paper we propose a Stratified Rule-Aware Network (SRAN) to generate the rule embeddings for two input sequences. Our SRAN learns multiple granularity rule embeddings at different levels, and incrementally integrates the stratified embedding flows through a gated fusion module. With the help of embeddings, a rule similarity metric is applied to guarantee that SRAN can not only be trained using a tuplet loss but also infer the best answer efficiently. We further point out the severe defects existing in the popular RAVEN dataset for RPM test, which prevent from the fair evaluation of the abstract reasoning ability. To fix the defects, we propose an answer set generation algorithm called Attribute Bisection Tree (ABT), forming an improved dataset named Impartial-RAVEN (I-RAVEN for short). Extensive experiments are conducted on both PGM and I-RAVEN datasets, showing that our SRAN outperforms the state-of-the-art models by a considerable margin.

A Statistics Based Approach for Extracting Priority Rules from Trained Neural Networks.

Extracting Symbolic Rules from Trained Neural Network Ensembles

AN APPROACH TO RULE EXTRACTION OF NEURAL NETWORKS

Novel approach for explaining the behavior of trained artificial neural networks with distributed representations

Using Two-Phase Approach to Extract Knowledge from Artificial Neural Networks

Rule Extraction using Artificial Neural Networks

Extract Interpretability-Accuracy balanced Rules from Artificial Neural Networks: A Review

A Rule Extraction Algorithm Based On Attribute Importance

A General Neural Framework for Classification Rule Mining.

Rule Extraction Algorithm for Deep Neural Networks: A Review

Using learning and searching approach to explain neural network with distributed representations

Functional Rule Extraction Method for Artificial Neural Networks

Rule Extraction: Using Neural Networks or for Neural Networks?

A Hybrid Rule Extraction Method Using Rough Sets and Neural Networks

FINRule: Feature Interactive Neural Rule Learning

Application Of Precise-Spike-Driven Rule In Spiking Neural Networks For Optical Character Recognition

Stratified Rule-Aware Network for Abstract Visual Reasoning

Rule-Extraction Methods From Feedforward Neural Networks: A Systematic Literature Review

An Algorithm to Extract Rules from Artificial Neural Networks for Medical Diagnosis Problems

Diagnostic Rule Extraction Using Neural Networks

NeuroRule: A Connectionist Approach to Data Mining