A Mathematical Picture Language Project

Arthur Jaffe,Zhengwei Liu

DOI: https://doi.org/10.48550/arXiv.2006.03954

2020-06-07

Abstract:The mathematical picture language project that we began in 2016 has already yielded interesting results. We also point out areas of mathematics and physics where we hope that it will prove useful in the future.

Mathematical Physics,High Energy Physics - Theory,Category Theory,Quantum Physics

What problem does this paper attempt to address?

A Mathematical Picture Language Program

Arthur Jaffe,Zhengwei Liu

DOI: https://doi.org/10.1073/pnas.1710707114

2017-12-13

Abstract:We give an overview of our philosophy of pictures in mathematics. We emphasize a bi-directional process between picture language and mathematical concepts: abstraction and simulation. This motivates a program to understand different subjects, using virtual and real mathematical concepts simulated by pictures.

History and Overview,Mathematical Physics,Category Theory,Operator Algebras,Quantum Algebra
Mathematical Character Between the Instrument and Culture: the Exploration of Mathematical Significance from the Concept of Patterned Mathematical Ontology

李奕娜,刘同舫

DOI: https://doi.org/10.15994/j.1000-0763.2013.01.021

2013-01-01

Abstract:Mathematics is the science of pattern study, and the pattern is formed with logical construction. The concept of pattern abandons the extremely philosophical comprehension of realism and anti-realism. It fully affirms the abstraction and objectivity of mathematics. Based on the concept of patterned mathematical ontology, mathematics includes instrumental character and cultural character. Mathematics penetrates in every branch of science, and provides the necessary instrument for them. It is the incarnation of the rational spirit, and profoundly affects the cultivation of people’s concepts, spirit and way of thinking.
Mathematical Results Inspired by Physics

Kefeng Liu

DOI: https://doi.org/10.48550/arxiv.math/0304460

2003-01-01

Abstract:I will discuss results of three different types in geometry and topology. (1) General vanishing and rigidity theorems of elliptic genera proved by using modular forms, Kac-Moody algebras and vertex operator algebras. (2) The computations of intersection numbers of the moduli spaces of flat connections on a Riemann surface by using heat kernels. (3) The mirror principle about counting curves in Calabi-Yau and general projective manifolds by using hypergeometric series.
Mathematical Language Models: A Survey

Wentao Liu,Hanglei Hu,Jie Zhou,Yuyang Ding,Junsong Li,Jiayi Zeng,Mengliang He,Qin Chen,Bo Jiang,Aimin Zhou,Liang He

DOI: https://doi.org/10.48550/arXiv.2312.07622

2023-12-12

Computation and Language

Abstract:In recent years, there has been remarkable progress in leveraging Language Models (LMs), encompassing Pre-trained Language Models (PLMs) and Large-scale Language Models (LLMs), within the domain of mathematics. This paper conducts a comprehensive survey of mathematical LMs, systematically categorizing pivotal research endeavors from two distinct perspectives: tasks and methodologies. The landscape reveals a large number of proposed mathematical LLMs, which are further delineated into instruction learning, tool-based methods, fundamental CoT techniques, and advanced CoT methodologies. In addition, our survey entails the compilation of over 60 mathematical datasets, including training datasets, benchmark datasets, and augmented datasets. Addressing the primary challenges and delineating future trajectories within the field of mathematical LMs, this survey is positioned as a valuable resource, poised to facilitate and inspire future innovation among researchers invested in advancing this domain.
Art Speaks Maths, Maths Speaks Art

Ninetta Leone,Simone Parisotto,Kasia Targonska-Hadzibabic,Spike Bucklow,Alessandro Launaro,Suzanne Reynolds,Carola-Bibiane Schönlieb

DOI: https://doi.org/10.48550/arXiv.2007.08886

2020-07-17

Computers and Society

Abstract:Our interdisciplinary team Mathematics for Applications in Cultural Heritage (MACH) aims to use mathematical research for the benefit of the arts and humanities. Our ultimate goal is to create user-friendly software toolkits for artists, art conservators and archaeologists. In order for their underlying mathematical engines and functionality to be optimised for the needs of the end users, we pursue an iterative approach based on a continuous communication between the mathematicians and the cultural-heritage members of our team. Our paper illustrates how maths can speak art, but only if first art speaks maths.
Discovering Mathematical Objects of Interest -- A Study of Mathematical Notations

Andre Greiner-Petter,Moritz Schubotz,Fabian Mueller,Corinna Breitinger,Howard S. Cohl,Akiko Aizawa,Bela Gipp

DOI: https://doi.org/10.1145/3366423.3380218

2021-06-22

Abstract:Mathematical notation, i.e., the writing system used to communicate concepts in mathematics, encodes valuable information for a variety of information search and retrieval systems. Yet, mathematical notations remain mostly unutilized by today's systems. In this paper, we present the first in-depth study on the distributions of mathematical notation in two large scientific corpora: the open access arXiv (2.5B mathematical objects) and the mathematical reviewing service for pure and applied mathematics zbMATH (61M mathematical objects). Our study lays a foundation for future research projects on mathematical information retrieval for large scientific corpora. Further, we demonstrate the relevance of our results to a variety of use-cases. For example, to assist semantic extraction systems, to improve scientific search engines, and to facilitate specialized math recommendation systems. The contributions of our presented research are as follows: (1) we present the first distributional analysis of mathematical formulae on arXiv and zbMATH; (2) we retrieve relevant mathematical objects for given textual search queries (e.g., linking $P_{n}^{(\alpha, \beta)}\!\left(x\right)$ with `Jacobi polynomial'); (3) we extend zbMATH's search engine by providing relevant mathematical formulae; and (4) we exemplify the applicability of the results by presenting auto-completion for math inputs as the first contribution to math recommendation systems. To expedite future research projects, we have made available our source code and data.

Digital Libraries,Information Retrieval
A Survey in Mathematical Language Processing

Jordan Meadows,Andre Freitas

2024-04-08

Abstract:Informal mathematical text underpins real-world quantitative reasoning and communication. Developing sophisticated methods of retrieval and abstraction from this dual modality is crucial in the pursuit of the vision of automating discovery in quantitative science and mathematics. We track the development of informal mathematical language processing approaches across five strategic sub-areas in recent years, highlighting the prevailing successful methodological elements along with existing limitations.

Computation and Language
Math Agents: Computational Infrastructure, Mathematical Embedding, and Genomics

Melanie Swan,Takashi Kido,Eric Roland,Renato P. dos Santos

2023-07-05

Abstract:The advancement in generative AI could be boosted with more accessible mathematics. Beyond human-AI chat, large language models (LLMs) are emerging in programming, algorithm discovery, and theorem proving, yet their genomics application is limited. This project introduces Math Agents and mathematical embedding as fresh entries to the "Moore's Law of Mathematics", using a GPT-based workflow to convert equations from literature into LaTeX and Python formats. While many digital equation representations exist, there's a lack of automated large-scale evaluation tools. LLMs are pivotal as linguistic user interfaces, providing natural language access for human-AI chat and formal languages for large-scale AI-assisted computational infrastructure. Given the infinite formal possibility spaces, Math Agents, which interact with math, could potentially shift us from "big data" to "big math". Math, unlike the more flexible natural language, has properties subject to proof, enabling its use beyond traditional applications like high-validation math-certified icons for AI alignment aims. This project aims to use Math Agents and mathematical embeddings to address the ageing issue in information systems biology by applying multiscalar physics mathematics to disease models and genomic data. Generative AI with episodic memory could help analyse causal relations in longitudinal health records, using SIR Precision Health models. Genomic data is suggested for addressing the unsolved Alzheimer's disease problem.

Other Quantitative Biology,Artificial Intelligence,Computation and Language
A Unified Mathematical Language for Medicine and Science

Patrick St-Amant

DOI: https://doi.org/10.48550/arXiv.1409.5045

2014-09-15

Abstract:A unified mathematical language for medicine and science will be presented. Using this language, models for DNA replication, protein synthesis, chemical reactions, neurons and a cardiac cycle of a heart have been built. Models for Turing machines, cellular automaton, fractals and physical systems are also represented with the use of this language. Interestingly, the language comes with a way to represent probability theory concepts and also programming statements. With this language, questions and processes in medicine can be represented as systems of equations; and solutions to these equations are viewed as treatments or previously unknown processes. This language can serve as the framework for the creation of a large interactive open-access scientific database that allows extensive mathematical medicine computations. It can also serve as a basis for exploring ideas related to what could be called metascience.

Quantitative Methods
The human quest for discovering mathematical beauty in the arts

Stefano Balietti

DOI: https://doi.org/10.48550/arXiv.2011.09861

2020-11-12

Computers and Society

Abstract:In the words of the twentieth-century British mathematician G. H. Hardy, "the human function is to 'discover or observe' mathematics" (1). For centuries, starting from the ancient Greeks, mankind has hunted for beauty and order in arts and in nature. This quest for mathematical beauty has led to the discovery of recurrent mathematical structures, such as the golden ratio, Fibonacci, and Lucas numbers, whose ubiquitous presences have been tantalizing the minds of artists and scientists alike. The captivation for this quest comes with high stakes. In fact, art is the definitive expression of human creativity, and its mathematical understanding would deliver us the keys for decoding human culture and its evolution (2). However, it was not until fairly recently that the scope and the scale of the human quest for mathematical beauty was radically expanded by the simultaneous confluence of three separate innovations. The mass digitization of large art archives, the surge in computational power, and the development of robust statistical methods to capture hidden patterns in vast amounts of data have made it possible to reveal the---otherwise unnoticeable to the human eye---mathematics concealed in large artistic corpora. Starting from its inception, marked by the foundational work by Birkhoff (3), progress in the broad field of computational aesthetics has reached a scale that would have been unimaginable just a decade ago. The recent expansion is not limited to the visual arts (2) but includes music (4), stories (5), language phonology (6), humor in jokes (7), and even equations (8); for a comprehensive review, see ref. 9.
From the String Landscape to the Mathematical Landscape: a Machine-Learning Outlook

Yang-Hui He

DOI: https://doi.org/10.48550/arXiv.2202.06086

2022-02-12

Abstract:We review the recent programme of using machine-learning to explore the landscape of mathematical problems. With this paradigm as a model for human intuition - complementary to and in contrast with the more formalistic approach of automated theorem proving - we highlight some experiments on how AI helps with conjecture formulation, pattern recognition and computation.

High Energy Physics - Theory,Machine Learning,History and Overview
A Panorama Of Physical Mathematics c. 2022

Ibrahima Bah,Daniel S. Freed,Gregory W. Moore,Nikita Nekrasov,Shlomo S. Razamat,Sakura Schafer-Nameki

2024-05-10

Abstract:What follows is a broad-brush overview of the recent synergistic interactions between mathematics and theoretical physics of quantum field theory and string theory. The discussion is forward-looking, suggesting potentially useful and fruitful directions and problems, some old, some new, for further development of the subject. This paper is a much extended version of the Snowmass whitepaper on physical mathematics [1].

High Energy Physics - Theory,Strongly Correlated Electrons,Mathematical Physics
MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?

Renrui Zhang,Dongzhi Jiang,Yichi Zhang,Haokun Lin,Ziyu Guo,Pengshuo Qiu,Aojun Zhou,Pan Lu,Kai-Wei Chang,Peng Gao,Hongsheng Li

2024-08-18

Abstract:The remarkable progress of Multi-modal Large Language Models (MLLMs) has garnered unparalleled attention, due to their superior performance in visual contexts. However, their capabilities in visual math problem-solving remain insufficiently evaluated and understood. We investigate current benchmarks to incorporate excessive visual content within textual questions, which potentially assist MLLMs in deducing answers without truly interpreting the input diagrams. To this end, we introduce MathVerse, an all-around visual math benchmark designed for an equitable and in-depth evaluation of MLLMs. We meticulously collect 2,612 high-quality, multi-subject math problems with diagrams from publicly available sources. Each problem is then transformed by human annotators into six distinct versions, each offering varying degrees of information content in multi-modality, contributing to 15K test samples in total. This approach allows MathVerse to comprehensively assess whether and how much MLLMs can truly understand the visual diagrams for mathematical reasoning. In addition, we propose a Chain-of-Thought (CoT) evaluation strategy for a fine-grained assessment of the output answers. Rather than naively judging True or False, we employ GPT-4(V) to adaptively extract crucial reasoning steps, and then score each step with detailed error analysis, which can reveal the intermediate CoT reasoning quality by MLLMs. We hope the MathVerse benchmark may provide unique insights to guide the future development of MLLMs. Project page: <a class="link-external link-https" href="https://mathverse-cuhk.github.io" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition,Artificial Intelligence,Computation and Language,Machine Learning
Mathemyths: Leveraging Large Language Models to Teach Mathematical Language through Child-AI Co-Creative Storytelling

Chao Zhang,Xuechen Liu,Katherine Ziska,Soobin Jeon,Chi-Lin Yu,Ying Xu

DOI: https://doi.org/10.1145/3613904.3642647

2024-02-27

Abstract:Mathematical language is a cornerstone of a child's mathematical development, and children can effectively acquire this language through storytelling with a knowledgeable and engaging partner. In this study, we leverage the recent advances in large language models to conduct free-form, creative conversations with children. Consequently, we developed Mathemyths, a joint storytelling agent that takes turns co-creating stories with children while integrating mathematical terms into the evolving narrative. This paper details our development process, illustrating how prompt-engineering can optimize LLMs for educational contexts. Through a user study involving 35 children aged 4-8 years, our results suggest that when children interacted with Mathemyths, their learning of mathematical language was comparable to those who co-created stories with a human partner. However, we observed differences in how children engaged with co-creation partners of different natures. Overall, we believe that LLM applications, like Mathemyths, offer children a unique conversational experience pertaining to focused learning objectives.

Human-Computer Interaction
A Mathematical Model for Universal Semantics

E. Weinan,Yajun Zhou

DOI: https://doi.org/10.1109/tpami.2020.3022533

IF: 23.6

2019-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:We characterize the meaning of words with language-independent numerical fingerprints, through a mathematical analysis of recurring patterns in texts. Approximating texts by Markov processes on a long-range time scale, we are able to extract topics, discover synonyms, and sketch semantic fields from a particular document of moderate length, without consulting external knowledge-base or thesaurus. Our Markov semantic model allows us to represent each topical concept by a low-dimensional vector, interpretable as algebraic invariants in succinct statistical operations on the document, targeting local environments of individual words. These language-independent semantic representations enable a robot reader to both understand short texts in a given language (automated question-answering) and match medium-length texts across different languages (automated word translation). Our semantic fingerprints quantify local meaning of words in 14 representative languages across five major language families, suggesting a universal and cost-effective mechanism by which human languages are processed at the semantic level. Our protocols and source codes are publicly available on https://github.com/yajun-zhou/linguae-naturalis-principia-mathematica .
Advancing mathematics by guiding human intuition with AI

Alex Davies,Petar Veličković,Lars Buesing,Sam Blackwell,Daniel Zheng,Nenad Tomašev,Richard Tanburn,Peter Battaglia,Charles Blundell,András Juhász,Marc Lackenby,Geordie Williamson,Demis Hassabis,Pushmeet Kohli

DOI: https://doi.org/10.1038/s41586-021-04086-x

IF: 64.8

2021-12-01

Nature

Abstract:Abstract The practice of mathematics involves discovering patterns and using these to formulate and prove conjectures, resulting in theorems. Since the 1960s, mathematicians have used computers to assist in the discovery of patterns and formulation of conjectures 1 , most famously in the Birch and Swinnerton-Dyer conjecture 2 , a Millennium Prize Problem 3 . Here we provide examples of new fundamental results in pure mathematics that have been discovered with the assistance of machine learning—demonstrating a method by which machine learning can aid mathematicians in discovering new conjectures and theorems. We propose a process of using machine learning to discover potential patterns and relations between mathematical objects, understanding them with attribution techniques and using these observations to guide intuition and propose conjectures. We outline this machine-learning-guided framework and demonstrate its successful application to current research questions in distinct areas of pure mathematics, in each case showing how it led to meaningful mathematical contributions on important open problems: a new connection between the algebraic and geometric structure of knots, and a candidate algorithm predicted by the combinatorial invariance conjecture for symmetric groups 4 . Our work may serve as a model for collaboration between the fields of mathematics and artificial intelligence (AI) that can achieve surprising results by leveraging the respective strengths of mathematicians and machine learning.

multidisciplinary sciences
MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Models

Shuai Peng,Di Fu,Liangcai Gao,Xiuqin Zhong,Hongguang Fu,Zhi Tang

2024-08-30

Abstract:The rapid development of large language models (LLMs) has spurred extensive research into their domain-specific capabilities, particularly mathematical reasoning. However, most open-source LLMs focus solely on mathematical reasoning, neglecting the integration with visual injection, despite the fact that many mathematical tasks rely on visual inputs such as geometric diagrams, charts, and function plots. To fill this gap, we introduce \textbf{MultiMath-7B}, a multimodal large language model that bridges the gap between math and vision. \textbf{MultiMath-7B} is trained through a four-stage process, focusing on vision-language alignment, visual and math instruction-tuning, and process-supervised reinforcement learning. We also construct a novel, diverse and comprehensive multimodal mathematical dataset, \textbf{MultiMath-300K}, which spans K-12 levels with image captions and step-wise solutions. MultiMath-7B achieves state-of-the-art (SOTA) performance among open-source models on existing multimodal mathematical benchmarks and also excels on text-only mathematical benchmarks. Our model and dataset are available at {\textcolor{blue}{\url{<a class="link-external link-https" href="https://github.com/pengshuai-rin/MultiMath" rel="external noopener nofollow">this https URL</a>}}}.

Computation and Language,Artificial Intelligence
Large Language Models for Mathematical Reasoning: Progresses and Challenges

Janice Ahn,Rishu Verma,Renze Lou,Di Liu,Rui Zhang,Wenpeng Yin

2024-09-17

Abstract:Mathematical reasoning serves as a cornerstone for assessing the fundamental cognitive capabilities of human intelligence. In recent times, there has been a notable surge in the development of Large Language Models (LLMs) geared towards the automated resolution of mathematical problems. However, the landscape of mathematical problem types is vast and varied, with LLM-oriented techniques undergoing evaluation across diverse datasets and settings. This diversity makes it challenging to discern the true advancements and obstacles within this burgeoning field. This survey endeavors to address four pivotal dimensions: i) a comprehensive exploration of the various mathematical problems and their corresponding datasets that have been investigated; ii) an examination of the spectrum of LLM-oriented techniques that have been proposed for mathematical problem-solving; iii) an overview of factors and concerns affecting LLMs in solving math; and iv) an elucidation of the persisting challenges within this domain. To the best of our knowledge, this survey stands as one of the first extensive examinations of the landscape of LLMs in the realm of mathematics, providing a holistic perspective on the current state, accomplishments, and future challenges in this rapidly evolving field.

Computation and Language
Visually Representing the Landscape of Mathematical Structures

Katherine Gravel,Hayden Jananthan,Jeremy Kepner

DOI: https://doi.org/10.1109/isecon.2019.8882082

2019-03-01

Abstract:The information technology explosion has dramatically increased the application of areas of mathematics traditionally labeled ?pure” or ?theoretical” to wide ranges of fields, which has created a critical need to make abstract mathematics readily accessible to a broader community. This paper presents a method for categorizing and diagramming mathematical structures that enable students and professionals to rapidly understand relationships among and between mathematical structures. This paper also presents 11 maps diagramming 187 mathematical structures through the method described in the paper.

A Mathematical Picture Language Project

A Mathematical Picture Language Program

Mathematical Character Between the Instrument and Culture: the Exploration of Mathematical Significance from the Concept of Patterned Mathematical Ontology

Mathematical Results Inspired by Physics

Mathematical Language Models: A Survey

Art Speaks Maths, Maths Speaks Art

Discovering Mathematical Objects of Interest -- A Study of Mathematical Notations

A Survey in Mathematical Language Processing

Math Agents: Computational Infrastructure, Mathematical Embedding, and Genomics

A Unified Mathematical Language for Medicine and Science

The human quest for discovering mathematical beauty in the arts

From the String Landscape to the Mathematical Landscape: a Machine-Learning Outlook

A Panorama Of Physical Mathematics c. 2022

MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?

Mathemyths: Leveraging Large Language Models to Teach Mathematical Language through Child-AI Co-Creative Storytelling

A Mathematical Model for Universal Semantics

Advancing mathematics by guiding human intuition with AI

MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Models

Large Language Models for Mathematical Reasoning: Progresses and Challenges

Visually Representing the Landscape of Mathematical Structures