Abstract:Deep model fusion/merging is an emerging technique that merges the parameters or predictions of multiple deep learning models into a single one. It combines the abilities of different models to make up for the biases and errors of a single model to achieve better performance. However, deep model fusion on large-scale deep learning models (e.g., LLMs and foundation models) faces several challenges, including high computational cost, high-dimensional parameter space, interference between different heterogeneous models, etc. Although model fusion has attracted widespread attention due to its potential to solve complex real-world tasks, there is still a lack of complete and detailed survey research on this technique. Accordingly, in order to understand the model fusion method better and promote its development, we present a comprehensive survey to summarize the recent progress. Specifically, we categorize existing deep model fusion methods as four-fold: (1) "Mode connectivity", which connects the solutions in weight space via a path of non-increasing loss, in order to obtain better initialization for model fusion; (2) "Alignment" matches units between neural networks to create better conditions for fusion; (3) "Weight average", a classical model fusion method, averages the weights of multiple models to obtain more accurate results closer to the optimal solution; (4) "Ensemble learning" combines the outputs of diverse models, which is a foundational technique for improving the accuracy and robustness of the final model. In addition, we analyze the challenges faced by deep model fusion and propose possible research directions for model fusion in the future. Our review is helpful in deeply understanding the correlation between different model fusion methods and practical application methods, which can enlighten the research in the field of deep model fusion.

Review of Dempster-Shafer Method for Data Fusion

A review of tracking fusion in multi-source information fusion

Data Fusion Algorithm Based on Fuzzy Logic

Improved Evidential Fuzzy C-Means Method

The Fusion Strategy of 2D and 3D Information Based on Deep Learning: A Review

Deep Model Fusion: A Survey

A Survey on Deep Learning for Multimodal Data Fusion

Deep learning in multimodal remote sensing data fusion: A comprehensive review

An Improved Entropy-Weighted Topsis Method for Decision-Level Fusion Evaluation System of Multi-Source Data

A Comparison of Evidence Fusion Rules for Situation Recognition in Sensor-Based Environments

Review of Date Fusion and Decision-making Methods in Situation Awareness

A multi-source heterogeneous spatial big data fusion method based on multiple similarity and voting decision

Decision fusion systems for fault detection and identification in industrial processes

Multisource and Multitemporal Data Fusion in Remote Sensing: A Comprehensive Review of the State of the Art

A systematic review and meta-analysis of Digital Elevation Model (DEM) fusion: pre-processing, methods and applications

A review of remote sensing image fusion methods

A survey on machine learning for data fusion

A Review of Data Fusion Techniques for Government Big Data

Sparse Representation based Multi-sensor Image Fusion: A Review

Several Results and Its Recurrence Formula of Dempster-Shafer Method Applied to Target Fusion Identification