Abstract:Transformer neural networks show promising capabilities, in particular for uses in materials analysis, design, and manufacturing, including their capacity to work effectively with human language, symbols, code, and numerical data. Here, we explore the use of large language models (LLMs) as a tool that can support engineering analysis of materials, applied to retrieving key information about subject areas, developing research hypotheses, discovery of mechanistic relationships across disparate areas of knowledge, and writing and executing simulation codes for active knowledge generation based on physical ground truths. Moreover, when used as sets of AI agents with specific features, capabilities, and instructions, LLMs can provide powerful problem-solution strategies for applications in analysis and design problems. Our experiments focus on using a fine-tuned model, MechGPT, developed based on training data in the mechanics of materials domain. We first affirm how fine-tuning endows LLMs with a reasonable understanding of subject area knowledge. However, when queried outside the context of learned matter, LLMs can have difficulty recalling correct information and may hallucinate. We show how this can be addressed using retrieval-augmented Ontological Knowledge Graph strategies. The graph-based strategy helps us not only to discern how the model understands what concepts are important but also how they are related, which significantly improves generative performance and also naturally allows for injection of new and augmented data sources into generative AI algorithms. We find that the additional feature of relatedness provides advantages over regular retrieval augmentation approaches and not only improves LLM performance but also provides mechanistic insights for exploration of a material design process. Illustrated for a use case of relating distinct areas of knowledge, here, music and proteins, such strategies can also provide an interpretable graph structure with rich information at the node, edge, and subgraph level that provides specific insights into mechanisms and relationships. We discuss other approaches to improve generative qualities, including nonlinear sampling strategies and agent-based modeling that offer enhancements over single-shot generations, whereby LLMs are used to both generate content and assess content against an objective target. Examples provided include complex question answering, code generation, and execution in the context of automated force-field development from actively learned density functional theory (DFT) modeling and data analysis.

Power-up! What Can Generative Models Do for Human Computation Workflows?

Leveraging Generative AI and Large Language Models: A Comprehensive Roadmap for Healthcare Integration

Luminate: Structured Generation and Exploration of Design Space with Large Language Models for Human-AI Co-Creation

Enhancing Efficiency and Innovation with Generative AI

Artificial Artificial Artificial Intelligence: Crowd Workers Widely Use Large Language Models for Text Production Tasks

LLMs as Workers in Human-Computational Algorithms? Replicating Crowdsourcing Pipelines with LLMs

Large Language Models for Constructing and Optimizing Machine Learning Workflows: A Survey

How Can Large Language Models Help Humans in Design and Manufacturing?

LLM-based Frameworks for Power Engineering from Routine to Novel Tasks

Enhancing AI Systems with Agentic Workflows Patterns in Large Language Model

The Robots are Here: Navigating the Generative AI Revolution in Computing Education

Potential Benefits of Employing Large Language Models in Research in Moral Education and Development

Synergizing Human Expertise and AI Efficiency with Language Model for Microscopy Operation and Automated Experiment Design

On Computing Paradigms - Where Will Large Language Models Be Going

Generative Retrieval-Augmented Ontologic Graph and Multiagent Strategies for Interpretive Large Language Model-Based Materials Design

ChatGPT Alternative Solutions: Large Language Models Survey

Generative AI for Economic Research: Use Cases and Implications for Economists

Techniques for supercharging academic writing with generative AI

On the assessment of generative AI in modeling tasks: an experience report with ChatGPT and UML

Generative AI and Process Systems Engineering: The Next Frontier