Abstract:Tool learning enables Large Language Models (LLMs) to interact with external environments by invoking tools, serving as an effective strategy to mitigate the limitations inherent in their pre-training data. In this process, tool documentation plays a crucial role by providing usage instructions for LLMs, thereby facilitating effective tool utilization. This paper concentrates on the critical challenge of bridging the comprehension gap between LLMs and external tools due to the inadequacies and inaccuracies inherent in existing human-centric tool documentation. We propose a novel framework, DRAFT, aimed at Dynamically Refining tool documentation through the Analysis of Feedback and Trails emanating from LLMs' interactions with external tools. This methodology pivots on an innovative trial-and-error approach, consisting of three distinct learning phases: experience gathering, learning from experience, and documentation rewriting, to iteratively enhance the tool documentation. This process is further optimized by implementing a diversity-promoting exploration strategy to ensure explorative diversity and a tool-adaptive termination mechanism to prevent overfitting while enhancing efficiency. Extensive experiments on multiple datasets demonstrate that DRAFT's iterative, feedback-based refinement significantly ameliorates documentation quality, fostering a deeper comprehension and more effective utilization of tools by LLMs. Notably, our analysis reveals that the tool documentation refined via our approach demonstrates robust cross-model generalization capabilities.

Improving Quality of Use Case Documents Through Learning and User Interaction

Automatic Early Defects Detection in Use Case Documents

SimUser: Generating Usability Feedback by Simulating Various Users Interacting with Mobile Applications

Automatically deriving UML sequence diagrams from use cases

Modeling User Psychological Experience and Case Study in Online E-learning.

Applying Use-Case Technology in Requirement Analysis

Documenting use cases in the affective computing domain using Unified Modeling Language

Towards engineering higher quality intelligent environments: a multi case study approach

Research of User Documents Testing Technology

An Integrated Strategy to Systematically Understand and Manage Quality in Use for Web Applications

Requirement Checking: Generating Uses Cases out of Navigational Logs in Web Applications

Towards Efficient Use Case Modeling with Automated Domain Classification and Term Recommendation

Increment Iteraction Method to Capture the Using Case in Modeling Process of UML

From Exploration to Mastery: Enabling LLMs to Master Tools via Self-Driven Interactions

Automated Feature Document Review Via Interpretable Deep Learning.

Enhancing user experience in large language models through human-centered design: Integrating theoretical insights with an experimental study to meet diverse software learning needs with a single document knowledge base

An automated approach to transform use cases into activity diagrams

A Case Study of Usability Testing on an Asynchronous E-Learning Platform

Exploring User Experience of Automatic Documentation Tools

The Design and Research of the UML-based Requirement Elicitation Tool

Use Cases and Feedback in Functional Requirements Analysis