Tools for merging pretrained large language models.

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. ACM Computing Surveys, 2026.

FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion

[COLM 2025] LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation

AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.

Flexible library for merging large language models (LLMs) via evolutionary optimization (ACL 2025 Demo).

Executable Stable Diffusion merge recipes in comfyui

Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)

A collection of weight space learning including papers, codes, and datasets.

Executable State Dict Recipes

[NeurIPS'25 Spotlight🔥] Official Implementation of RobustMerge: Parameter-Efficient Model Merging for MLLMs with Direction Robustness

Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]

Representation Surgery for Multi-Task Model Merging. ICML, 2024.

ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse

The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":

[ICML 2025] No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces (official repository)

Pytorch code for NeurIPS 2025 paper "Accurate and Efficient Low-Rank Model Merging in Core Space"

DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling

Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic

Model merging, task-vector rebasin, and fine-tuning for vision and LLM models.