Abstract:Evaluating the surroundings to gain understanding, frame perspectives, and anticipate behavioral reactions is an inherent human trait. However, these continuous encounters are diverse and complex, posing challenges to their study and experimentation. Researchers have been able to isolate environmental features and study their effect on human perception and behavior. However, the research attempts to replicate and study human behaviors with proxies, such as by integrating virtual mediums and interviews, have been inconsistent. Large language models (LLMs) have recently been unveiled as capable of contextual understanding and semantic reasoning. These models have been trained on large amounts of text and have evolved to mimic believable human behavior. This study explores the current advancements in Generative agents powered by LLMs with the help of perceptual experiments. The experiment employs Generative agents to interact with the urban environments using street view images to plan their journey toward specific goals. The agents are given virtual personalities, which make them distinguishable. They are also provided a memory database to store their thoughts and essential visual information and retrieve it when needed to plan their movement. Since LLMs do not possess embodiment, nor have access to the visual realm, and lack a sense of motion or direction, we designed movement and visual modules that help agents gain an overall understanding of surroundings. The agents are further employed to rate the surroundings they encounter based on their perceived sense of safety and liveliness. As these agents store details in their memory, we query the findings to get details regarding their thought processes. Overall, this study experiments with current AI developments and their potential in simulated human behavior in urban environments.

DECENTRALISED AUTONOMOUS SOCIETY THROUGH LARGE LANGUAGE MODELS’ BASED AGENTS: A PATHWAY TO EMPOWER SMALL COMMUNITIES

Organizing a Society of Language Models: Structures and Mechanisms for Enhanced Collective Intelligence

Artificial Agency and Large Language Models

Exploring Autonomous Agents through the Lens of Large Language Models: A Review

The Systems Engineering Approach in Times of Large Language Models

Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectives

Decoding Large-Language Models: A Systematic Overview of Socio-Technical Impacts, Constraints, and Emerging Questions

Frontier AI Ethics: Anticipating and Evaluating the Societal Impacts of Language Model Agents

Autonomous Building Cyber-Physical Systems Using Decentralized Autonomous Organizations, Digital Twins, and Large Language Model

The Rise and Potential of Large Language Model Based Agents: A Survey

GenAI-powered Multi-Agent Paradigm for Smart Urban Mobility: Opportunities and Challenges for Integrating Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) with Intelligent Transportation Systems

How large language models can reshape collective intelligence

Merging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Powered Autonomous Agents

Synergistic Integration of Large Language Models and Cognitive Architectures for Robust AI: An Exploratory Analysis

Exploring Large Language Model based Intelligent Agents: Definitions, Methods, and Prospects

A survey on large language model based autonomous agents

Large Language Models as Instruments of Power: New Regimes of Autonomous Manipulation and Control

Generative agents in the streets: Exploring the use of Large Language Models (LLMs) in collecting urban perceptions

Large Language Model based Multi-Agents: A Survey of Progress and Challenges