Abstract:The code written by developers usually suffers from efficiency problems and contain various performance bugs. These inefficiencies necessitate the research of automated refactoring methods for code optimization. Early research in code optimization employs rule-based methods and focuses on specific inefficiency issues, which are labor-intensive and suffer from the low coverage issue. Recent work regards the task as a sequence generation problem, and resorts to deep learning (DL) techniques such as large language models (LLMs). These methods typically prompt LLMs to directly generate optimized code. Although these methods show state-of-the-art performance, such one-step generation paradigm is hard to achieve an optimal solution. First, complex optimization methods such as combinatorial ones are hard to be captured by LLMs. Second, the one-step generation paradigm poses challenge in precisely infusing the knowledge required for effective code optimization within LLMs, resulting in under-optimized <a class="link-external link-http" href="http://code.To" rel="external noopener nofollow">this http URL</a> address these problems, we propose to model this task from the search perspective, and propose a search-based LLMs framework named SBLLM that enables iterative refinement and discovery of improved optimization methods. SBLLM synergistically integrate LLMs with evolutionary search and consists of three key components: 1) an execution-based representative sample selection part that evaluates the fitness of each existing optimized code and prioritizes promising ones to pilot the generation of improved code; 2) an adaptive optimization pattern retrieval part that infuses targeted optimization patterns into the model for guiding LLMs towards rectifying and progressively enhancing their optimization methods; and 3) a genetic operator-inspired chain-of-thought prompting part that aids LLMs in combining different optimization methods and generating improved optimization methods.

Towards LLM-based optimization compilers. Can LLMs learn how to apply a single peephole optimization? Reasoning is all LLMs need!

Should AI Optimize Your Code? A Comparative Study of Current Large Language Models Versus Classical Optimizing Compilers

Code Optimization Chain-of-Thought: Structured Understanding and Self-Checking

LLM Reasoners: New Evaluation, Library, and Analysis of Step-by-Step Reasoning with Large Language Models

Competition-Level Problems are Effective LLM Evaluators

Can LLMs Reason with Rules? Logic Scaffolding for Stress-Testing and Improving LLMs

LLMs-as-Instructors: Learning from Errors Toward Automating Model Improvement

Search-Based LLMs for Code Optimization

Navigating the Labyrinth: Evaluating and Enhancing LLMs' Ability to Reason About Search Problems

Evaluating LLMs' Mathematical and Coding Competency through Ontology-guided Interventions

LLMs for Relational Reasoning: How Far are We?

Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing

Are LLMs Rigorous Logical Reasoner? Empowering Natural Language Proof Generation with Contrastive Stepwise Decoding

Large Language Model-Based Evolutionary Optimizer: Reasoning with elitism

LLM2: Let Large Language Models Harness System 2 Reasoning

Meta Large Language Model Compiler: Foundation Models of Compiler Optimization

Learning From Mistakes Makes LLM Better Reasoner

Can LLMs Reason in the Wild with Programs?

Thinking LLMs: General Instruction Following with Thought Generation

LLMs are Highly-Constrained Biophysical Sequence Optimizers