Abstract:Neuro-symbolic models of artificial intelligence (AI) have been recently developed to perform tasks involving abstract visual reasoning that is a hallmark of human intelligence but remains challenging for deep neural network methods. However, most of the current neuro-symbolic models also rely on supervised learning and auxiliary annotations, different from human cognitive processes that are much dependent on the general cognitive abilities of entity and rule recognitions, rather than learning how to solve the specific tasks from examples. In this work, we propose a neuro-symbolic model by self-supervised contrastive learning (NS-SSCL) with unique and invariant representations of entities and rules in the perception and reasoning modules, respectively, to solve Raven’s Progressive Matrices (RPMs) and its variant, a typical type of visual reasoning task used to test human intelligence. The perception module parses each object into invariant representations of attributes. The reasoning module grounds the representations of object attributes to form the latent rule representations also through SSCL. Further, the relationships between the neural representations of object attributes and symbols used for rule reasoning are coherently mapped. Finally, the scene generation engine aggregates all attribute and rule representation distributions to produce a probabilistic representation of the target. NS-SSCL obtains state-of-the-art performance in unsupervised models to solve the RAVEN and V-PROM benchmarks, even better than most of the supervised models. The success of the proposed model suggests that construction of general cognitive abilities like humans may render the AI algorithms to solve complex tasks involving higher-level cognition such as abstract reasoning in a human-like manner.

An Interpretable Neuro-symbolic Model for Raven’s Progressive Matrices Reasoning

An Interpretable Neuro-symbolic Model for Raven's Progressive Matrices Reasoning

Computational Models of Solving Raven's Progressive Matrices: A Comprehensive Introduction

Deep Residual Networks’ Abstract Reasoning Performance on Raven’s Progressive Matrices

Neural Prediction Errors Enable Analogical Visual Reasoning in Human Standard Intelligence Tests.

RAVEN: A Dataset for Relational and Analogical Visual rEasoNing

Visual Perception Inference on Raven's Progressive Matrices by Semi-supervised Contrastive Learning

Modeling Gestalt Visual Reasoning on the Raven's Progressive Matrices Intelligence Test Using Generative Image Inpainting Techniques

A Feature-based Generalizable Prediction Model for Both Perceptual and Abstract Reasoning

A Novel Arbitrary-Position Solver for Raven's Progressive Matrix Problems

Learning to reason over visual objects

Abstract Visual Reasoning by Self-supervised Contrastive Learning

Towards Generative Abstract Reasoning: Completing Raven's Progressive Matrix via Rule Abstraction and Selection

A Cognitively-Inspired Neural Architecture for Visual Abstract Reasoning Using Contrastive Perceptual and Conceptual Processing

A neuro-vector-symbolic architecture for solving Raven's progressive matrices

ViTCN: Vision Transformer Contrastive Network For Reasoning

Abstracting Concept-Changing Rules for Solving Raven's Progressive Matrix Problems

Hierarchical ConViT with Attention-Based Relational Reasoner for Visual Analogical Reasoning

Visual-Imagery-Based Analogical Construction in Geometric Matrix Reasoning Task

Stratified Rule-Aware Network for Abstract Visual Reasoning

Multi-Granularity Modularized Network for Abstract Visual Reasoning