Abstract:AI has made significant progress in solving math problems, but geometry problems remain challenging due to their reliance on both text and diagrams. In the text description, symbolic characters such as "$\triangle$ABC" often serve as a bridge to connect the corresponding diagram. However, by simply tokenizing symbolic characters into individual letters (e.g., 'A', 'B' and 'C'), existing works fail to study them explicitly and thus lose the semantic relationship with the diagram. In this paper, we develop a symbolic character-aware model to fully explore the role of these characters in both text and diagram understanding and optimize the model under a multi-modal reasoning framework. In the text encoder, we propose merging individual symbolic characters to form one semantic unit along with geometric information from the corresponding diagram. For the diagram encoder, we pre-train it under a multi-label classification framework with the symbolic characters as labels. In addition, we enhance the geometry diagram understanding ability via a self-supervised learning method under the masked image modeling auxiliary task. By integrating the proposed model into a general encoder-decoder pipeline for solving geometry problems, we demonstrate its superiority on two benchmark datasets, including GeoQA and Geometry3K, with extensive experiments. Specifically, on GeoQA, the question-solving accuracy is increased from 60.0\% to 64.1\%, achieving a new state-of-the-art accuracy; on Geometry3K, we reduce the question average solving steps from 6.9 down to 6.0 with marginally higher solving accuracy.

Solving Geometry Problems Using a Combination of Symbolic and Numerical Reasoning

Learning to Solve Geometry Problems via Simulating Human Dual-Reasoning Process

A Principled Approach Towards Symbolic Geometric Constraint Satisfaction

Solving olympiad geometry without human demonstrations

FGeo-SSS: A Search-Based Symbolic Solver for Human-like Automated Geometric Reasoning

A Symbolic Character-Aware Model for Solving Geometry Problems

Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning

GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoning

Reasoning with geometric shapes

FGeo-DRL: Deductive Reasoning for Geometric Problems through Deep Reinforcement Learning

EuclidNet: Deep Visual Reasoning for Constructible Problems in Geometry

Solving Some Geometry Problems of the Náboj 2023 Contest with Automated Deduction in GeoGebra Discovery

FGeo-HyperGNet: Geometric Problem Solving Integrating Formal Symbolic System and Hypergraph Neural Network

Fuse, Reason and Verify: Geometry Problem Solving with Parsed Clauses from Diagram

A program to create new geometry proof problems

GAPS: Geometry-Aware Problem Solver

Geometric constraint solving for parametric conics

Enhancing Neural Mathematical Reasoning by Abductive Combination with Symbolic Library

Automatic extraction of structured information from elementary level geometry questions into logic forms

Varied reasoning schema in students' written solutions