Abstract:The AI community has been exploring a pathway to artificial general intelligence (AGI) by developing "language agents", which are complex large language models (LLMs) pipelines involving both prompting techniques and tool usage methods. While language agents have demonstrated impressive capabilities for many real-world tasks, a fundamental limitation of current language agents research is that they are model-centric, or engineering-centric. That's to say, the progress on prompts, tools, and pipelines of language agents requires substantial manual engineering efforts from human experts rather than automatically learning from data. We believe the transition from model-centric, or engineering-centric, to data-centric, i.e., the ability of language agents to autonomously learn and evolve in environments, is the key for them to possibly achieve AGI. In this work, we introduce agent symbolic learning, a systematic framework that enables language agents to optimize themselves on their own in a data-centric way using symbolic optimizers. Specifically, we consider agents as symbolic networks where learnable weights are defined by prompts, tools, and the way they are stacked together. Agent symbolic learning is designed to optimize the symbolic network within language agents by mimicking two fundamental algorithms in connectionist learning: back-propagation and gradient descent. Instead of dealing with numeric weights, agent symbolic learning works with natural language simulacrums of weights, loss, and gradients. We conduct proof-of-concept experiments on both standard benchmarks and complex real-world tasks and show that agent symbolic learning enables language agents to update themselves after being created and deployed in the wild, resulting in "self-evolving agents".

NEOLAF, an LLM-powered neural-symbolic cognitive architecture

S2rl

Cognitive Architectures for Language Agents

Better than Your Teacher: LLM Agents that learn from Privileged AI Feedback

Converging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Empowered Autonomous Agents

A Neuro-Symbolic Approach to Multi-Agent RL for Interpretability and Probabilistic Decision Making

LLaNA: Large Language and NeRF Assistant

An Artificial Neuron for Enhanced Problem Solving in Large Language Models

Symbolic Learning Enables Self-Evolving Agents

Building Cooperative Embodied Agents Modularly with Large Language Models

Hello Again! LLM-powered Personalized Agent for Long-term Dialogue

DANLI: Deliberative Agent for Following Natural Language Instructions

Learning to Model the World with Language

Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision (Short Version)

Uncertainty-based modulation for lifelong learning

BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents

Continual Learning with Deep Artificial Neurons

LLMatic: Neural Architecture Search via Large Language Models and Quality Diversity Optimization

Decentralized and Lifelong-Adaptive Multi-Agent Collaborative Learning

LACMA: Language-Aligning Contrastive Learning with Meta-Actions for Embodied Instruction Following

From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Control