Abstract:Large Language Models (LLMs) are showcasing impressive ability in handling complex reasoning tasks. In real-world situations, problems often span a spectrum of complexities. Humans inherently adjust their problem-solving approaches based on task complexity. However, most methodologies that leverage LLMs tend to adopt a uniform approach: utilizing consistent models, prompting methods, and degrees of problem decomposition, regardless of the problem complexity. Inflexibility of them can bring unnecessary computational overhead or sub-optimal performance. To address this problem, we introduce an Adaptive-Solver framework. It strategically modulates solving strategies based on the difficulties of the problems. Given an initial solution, the framework functions with two primary modules. The initial evaluation module assesses the adequacy of the current solution. If improvements are needed, the subsequent adaptation module comes into play. Within this module, three key adaptation strategies are employed: (1) Model Adaptation: Switching to a stronger LLM when a weaker variant is inadequate. (2) Prompting Method Adaptation: Alternating between different prompting techniques to suit the problem's nuances. (3) Decomposition Granularity Adaptation: Breaking down a complex problem into more fine-grained sub-questions to enhance solvability. Through such dynamic adaptations, our framework not only enhances computational efficiency but also elevates the overall performance. This dual-benefit ensures both the efficiency of the system for simpler tasks and the precision required for more complex questions. Experimental results from complex reasoning tasks reveal that the prompting method adaptation and decomposition granularity adaptation enhance performance across all tasks. Furthermore, the model adaptation approach significantly reduces API costs (up to 50%) while maintaining superior performance.

A rewriting system for convex optimization problems

A General System for Heuristic Solution of Convex Problems over Nonconvex Sets

A proof system for certifying symmetry and optimality reasoning in integer programming

An efficient nonconvex reformulation of stagewise convex optimization problems

Domain-specific Languages in a Finite Domain Constraint Programming System

MathDSL: A Domain-Specific Language for Concise Mathematical Solutions Via Program Synthesis

Disciplined Saddle Programming

Differentiable Convex Optimization Layers

A lightweight symbolic virtual machine for solver-aided host languages

Verified reductions for optimization

A Primal-Dual Framework for Symmetric Cone Programming

Lagrangian Reformulation for Nonconvex Optimization: Tailoring Problems to Specialized Solvers

A Language for Describing Optimization Strategies

Formalization of Complexity Analysis of the First-order Algorithms for Convex Optimization

Towards a Scalable Proof Engine: A Performant Prototype Rewriting Primitive for Coq

Design and implementation of a modular interior-point solver for linear optimization

Design and Implementation of DSL Via Category Theoretic Computations

Abstract Modular Systems and Solvers

Sparse Conic Reformulation of Structured QCQPs based on Copositive Optimization with Applications in Stochastic Optimization

Adaptive-Solver Framework for Dynamic Strategy Selection in Large Language Model Reasoning

A Neural Rewriting System to Solve Algorithmic Problems