Abstract:Model merging is an efficient empowerment technique in the machine learning community that does not require the collection of raw training data and does not require expensive computation. As model merging becomes increasingly prevalent across various fields, it is crucial to understand the available model merging techniques comprehensively. However, there is a significant gap in the literature regarding a systematic and thorough review of these techniques. This survey provides a comprehensive overview of model merging methods and theories, their applications in various domains and settings, and future research directions. Specifically, we first propose a new taxonomic approach that exhaustively discusses existing model merging methods. Secondly, we discuss the application of model merging techniques in large language models, multimodal large language models, and 10+ machine learning subfields, including continual learning, multi-task learning, few-shot learning, etc. Finally, we highlight the remaining challenges of model merging and discuss future research directions. A comprehensive list of papers about model merging is available at \url{<a class="link-external link-https" href="https://github.com/EnnengYang/Awesome-Model-Merging-Methods-Theories-Applications" rel="external noopener nofollow">this https URL</a>}.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that in the machine - learning community, as an effective enhancement technique, how can model merging construct a general model by merging the parameters of multiple models with different capabilities without the need for original training data and expensive computation. Although model merging is a relatively new research area, its application scope is expanding rapidly, including areas such as large - language models (LLMs), multi - modal large - language models (MLLMs), and visual - generation models. However, there are still significant gaps in the systematic and comprehensive review of model - merging methods and techniques. Therefore, this paper aims to fill this gap and provide a comprehensive overview of existing model - merging methods, theories, applications, and future research directions. Specifically, the paper mainly focuses on the following aspects: 1. **Classification of existing model - merging methods**: The paper proposes a new classification method, which divides the existing model - merging methods into two stages: pre - merging and during - merging. Pre - merging methods aim to create better conditions for model merging, for example, through techniques such as linearized fine - tuning, architecture transformation, and weight alignment. Methods during the merging process focus on designing complex strategies to merge multiple models and solve task - conflict and interference problems. 2. **Applications of model merging**: The paper discusses in detail the applications of model - merging techniques in base models (such as large - language models, multi - modal large - language models, and visual - generation models) and more than 10 machine - learning sub - fields, including continuous learning, multi - task/multi - domain/multi - objective/auxiliary learning, out - of - distribution/domain generalization, federated learning, zero - shot/few - shot learning, and adversarial learning. These applications show how model merging can solve various challenges in these fields. 3. **Remaining challenges and future research directions**: Although model - merging methods have made some progress, there are still many open challenges in terms of performance gap, theoretical analysis, reliability assurance, and interdisciplinary applications. The paper points out these challenges and discusses future research directions. Through the above three aspects, the paper aims to provide researchers and practitioners with a comprehensive guide to model - merging techniques and promote the further development of this field.

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities

It's Morphing Time: Unleashing the Potential of Multiple LLMs via Multi-objective Optimization

Exploring Model Kinship for Merging Large Language Models

Training-free Heterogeneous Model Merging

Merge, Ensemble, and Cooperate! A Survey on Collaborative Strategies in the Era of Large Language Models

HM3: Hierarchical Multi-Objective Model Merging for Pretrained Models

SUPERMERGE: An Approach For Gradient-Based Model Merging

Unconstrained Model Merging for Enhanced LLM Reasoning

Efficient Multimodal Large Language Models: A Survey

What Matters for Model Merging at Scale?

Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wild

Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging

Unlocking the Potential of Model Merging for Low-Resource Languages

Training-Free Pretrained Model Merging

Realistic Evaluation of Model Merging for Compositional Generalization

How to Merge Your Multimodal Models Over Time?

Model Merging and Safety Alignment: One Bad Model Spoils the Bunch

The Synergy between Data and Multi-Modal Large Language Models: A Survey from Co-Development Perspective

Arcee's MergeKit: A Toolkit for Merging Large Language Models

AdaMerging: Adaptive Model Merging for Multi-Task Learning

Deep Model Fusion: A Survey