Abstract:Large Language Models (LLMs) are showcasing impressive ability in handling complex reasoning tasks. In real-world situations, problems often span a spectrum of complexities. Humans inherently adjust their problem-solving approaches based on task complexity. However, most methodologies that leverage LLMs tend to adopt a uniform approach: utilizing consistent models, prompting methods, and degrees of problem decomposition, regardless of the problem complexity. Inflexibility of them can bring unnecessary computational overhead or sub-optimal performance. To address this problem, we introduce an Adaptive-Solver framework. It strategically modulates solving strategies based on the difficulties of the problems. Given an initial solution, the framework functions with two primary modules. The initial evaluation module assesses the adequacy of the current solution. If improvements are needed, the subsequent adaptation module comes into play. Within this module, three key adaptation strategies are employed: (1) Model Adaptation: Switching to a stronger LLM when a weaker variant is inadequate. (2) Prompting Method Adaptation: Alternating between different prompting techniques to suit the problem's nuances. (3) Decomposition Granularity Adaptation: Breaking down a complex problem into more fine-grained sub-questions to enhance solvability. Through such dynamic adaptations, our framework not only enhances computational efficiency but also elevates the overall performance. This dual-benefit ensures both the efficiency of the system for simpler tasks and the precision required for more complex questions. Experimental results from complex reasoning tasks reveal that the prompting method adaptation and decomposition granularity adaptation enhance performance across all tasks. Furthermore, the model adaptation approach significantly reduces API costs (up to 50%) while maintaining superior performance.

An Adaptive Framework for Confidence-constraint Rule Set Learning Algorithm in Large Dataset

An adaptive framework for confidence-constraint rule set learning algorithm in large dataset

Constraint-Adaptive Rule Mining in Large Databases

A Practical Rule Learning Framework for Risk Management

Discovering Denial Constraints Based on Deep Reinforcement Learning

Rule-based Data Selection for Large Language Models

Multi-confidence rule acquisition and confidence-preserved attribute reduction in interval-valued decision systems

Scalable Rule Lists Learning with Sampling

Ensemble Belief Rule Base Modeling with Diverse Attribute Selection and Cautious Conjunctive Rule for Classification Problems

RuleR: Improving LLM Controllability by Rule-based Data Recycling

Learning Interpretable Rules for Scalable Data Representation and Classification

Multi-confidence Rule Acquisition Oriented Attribute Reduction of Covering Decision Systems Via Combinatorial Optimization

A Framework for Extended Belief Rule Base Reduction and Training with the Greedy Strategy and Parameter Learning

Adaptive-Solver Framework for Dynamic Strategy Selection in Large Language Model Reasoning

RRL: A Scalable Classifier for Interpretable Rule-Based Representation Learning

ChatRule: Mining Logical Rules with Large Language Models for Knowledge Graph Reasoning

Rule mining over knowledge graphs via reinforcement learning

Sampling scheme-based classification rule mining method using decision tree in big data environment

Rule Generation for Classification: Scalability, Interpretability, and Fairness

On Mining Instance-Centric Classification Rules