Abstract:The recent developments in artificial intelligence (AI) increase the hope that AI can provide a powerful tool to facilitate scientific discovery and to generate and validate new ideas for scientific research autonomously. Large Language Models (LLMs), such as ChatGPT4 have demonstrated remarkable capabilities in understanding and generating human-like text. Their potential extends beyond simple language tasks, offering transformative possibilities in scientific research of all fields. By leveraging vast amounts of data and advanced computational power, LLMs can assist researchers in generating novel ideas, automating routine tasks, and fostering interdisciplinary collaborations. On September 12, 2024, OpenAI released their updated generative artificial intelligence system called ChatGPTo1. This new AI system, built upon chain-of-thought and reinforcement learning, has greatly enhanced logical reasoning abilities and can effectively solve various complex problems from elementary-level mathematical problems to modern scientific research issues in physics, chemistry, and biology. Unlike previous LLMs in which logical reasoning and data analysis abilities are developed through training on actual data, ChatGPTo1 logical reasoning ability and capacity to generate new scientific ideas are primarily acquired through chain-of-thought processes and reinforcement learning rather than pre-training. To examine this, we specifically tested ChatGPTo1 current reasoning and scientific discovery capabilities by developing theoretically complex and quantitatively challenging scientific equations in various fields of neuroscience, such as dynamical systems, nonlinear dynamical systems, dynamical systems on differential manifolds, neural field theory, nonlinear divergence theorems, nonlinear heat conduction equations and Laplace equations and their extensions on differential manifolds, nonlinear statistical analysis methods, deep learning, and other topics involving multiple fields. The current large language models may illustrate a certain degree of general intelligence, even if fundamentally it may be different from human intelligence. However, it does not mean the current LLMs can fully apply such ability in practical applications or that their reasoning potential can be fully tapped. It is essential to explore specific pathways and methods to cultivate their potential for scientific discovery. To accomplish this, we consider how to integrate them with common search engines (such as Google) capabilities and ChatGPT4o cross-modal abilities to better understand new disciplines and scientific discoveries. To this point, the major shortcoming of ChatGPTo1 is that it is not an end-to-end scientific discovery method and lacks the ability to achieve full automation. It also lacks methods for image analysis and full-scale data analysis, making it difficult to use simulation and data analysis to evaluate and test proposed new theories and methods.

Automated Discovery of Integral with Deep Learning

Deep Learning in Automatic Math Word Problem Solvers

Deep-learning based discovery of partial differential equations in integral form from sparse and noisy data

Large Language Models for Mathematical Reasoning: Progresses and Challenges

LLM4ED: Large Language Models for Automatic Equation Discovery

Dynamic Models of Neural Population Dynamics

MathLearner: A Large Language Model Agent Framework for Learning to Solve Mathematical Problems

A Survey of Deep Learning for Mathematical Reasoning

Solving for X and Beyond: Can Large Language Models Solve Complex Math Problems with More-Than-Two Unknowns?

Large language models for automatic equation discovery of nonlinear dynamics

Adapting Large Language Models for Education: Foundational Capabilities, Potentials, and Challenges

Unified Representations for Learning and Reasoning

Mathematical Challenges in Deep Learning

INC-Math: Integrating Natural Language and Code for Enhanced Mathematical Reasoning in Large Language Models

Advancing mathematics by guiding human intuition with AI

Do Large Language Models Truly Grasp Mathematics? An Empirical Exploration From Cognitive Psychology

Boosting Large Language Models with Socratic Method for Conversational Mathematics Teaching

Automated discovery of algorithms from data

LLMs as Potential Brainstorming Partners for Math and Science Problems