Abstract:The recent developments in artificial intelligence (AI) increase the hope that AI can provide a powerful tool to facilitate scientific discovery and to generate and validate new ideas for scientific research autonomously. Large Language Models (LLMs), such as ChatGPT4 have demonstrated remarkable capabilities in understanding and generating human-like text. Their potential extends beyond simple language tasks, offering transformative possibilities in scientific research of all fields. By leveraging vast amounts of data and advanced computational power, LLMs can assist researchers in generating novel ideas, automating routine tasks, and fostering interdisciplinary collaborations. On September 12, 2024, OpenAI released their updated generative artificial intelligence system called ChatGPTo1. This new AI system, built upon chain-of-thought and reinforcement learning, has greatly enhanced logical reasoning abilities and can effectively solve various complex problems from elementary-level mathematical problems to modern scientific research issues in physics, chemistry, and biology. Unlike previous LLMs in which logical reasoning and data analysis abilities are developed through training on actual data, ChatGPTo1 logical reasoning ability and capacity to generate new scientific ideas are primarily acquired through chain-of-thought processes and reinforcement learning rather than pre-training. To examine this, we specifically tested ChatGPTo1 current reasoning and scientific discovery capabilities by developing theoretically complex and quantitatively challenging scientific equations in various fields of neuroscience, such as dynamical systems, nonlinear dynamical systems, dynamical systems on differential manifolds, neural field theory, nonlinear divergence theorems, nonlinear heat conduction equations and Laplace equations and their extensions on differential manifolds, nonlinear statistical analysis methods, deep learning, and other topics involving multiple fields. The current large language models may illustrate a certain degree of general intelligence, even if fundamentally it may be different from human intelligence. However, it does not mean the current LLMs can fully apply such ability in practical applications or that their reasoning potential can be fully tapped. It is essential to explore specific pathways and methods to cultivate their potential for scientific discovery. To accomplish this, we consider how to integrate them with common search engines (such as Google) capabilities and ChatGPT4o cross-modal abilities to better understand new disciplines and scientific discoveries. To this point, the major shortcoming of ChatGPTo1 is that it is not an end-to-end scientific discovery method and lacks the ability to achieve full automation. It also lacks methods for image analysis and full-scale data analysis, making it difficult to use simulation and data analysis to evaluate and test proposed new theories and methods.

Emergent autonomous scientific research capabilities of large language models

Autonomous chemical research with large language models

Transformers and Large Language Models for Chemistry and Drug Discovery

Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectives

MLR-Copilot: Autonomous Machine Learning Research based on Large Language Models Agents

Large Language Models for Scientific Synthesis, Inference and Explanation

Large Language Model based Multi-Agents: A Survey of Progress and Challenges

DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoning

A multi-agent-driven robotic AI chemist enabling autonomous chemical research on demand

Dynamic Models of Neural Population Dynamics

A Survey on Large Language Models from Concept to Implementation

Engineering Exploration and Research on Large Language Models

Large Model Agents: State-of-the-Art, Cooperation Paradigms, Security and Privacy, and Future Trends

Exploring Autonomous Agents through the Lens of Large Language Models: A Review

Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects

Scientific Computing with Large Language Models

A Review of Large Language Models and Autonomous Agents in Chemistry

Exploring Large Language Models to Facilitate Variable Autonomy for Human-Robot Teaming

The Rise and Potential of Large Language Model Based Agents: A Survey

Are Emergent Abilities in Large Language Models just In-Context Learning?

A survey on large language model based autonomous agents