model-merging

Tools for merging pretrained large language models.

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.

FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion

[COLM 2025] LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation

Executable Stable Diffusion merge recipes in comfyui

AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.

Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)

Flexible library for merging large language models (LLMs) via evolutionary optimization (ACL 2025 Demo).

Executable State Dict Recipes

Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]

ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse

Representation Surgery for Multi-Task Model Merging. ICML, 2024.

DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling

Repository for the paper "U-Net Transplant: The Role of Pre-training for Model Merging in 3D Medical Segmentation" accepted @ MICCAI2025

Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic

[ECCV'24] MaxFusion: Plug & Play multimodal generation in text to image diffusion models

Exploring Model Kinship for Merging Large Language Models

[ECCV 2024] MagMax: Leveraging Model Merging for Seamless Continual Learning (official repository)

[ICML 2025] No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces (official repository)

All-in-one UI for merged LLMs in Hugging Face