LLM Model Merging

YouTube Tutorial

GitHub

You can find the GitHub from here; https://github.com/uygarkurt/Model-Merge

In this specific case, I typed llama-3 into the open LLM leaderboard, took the best 3 models, merged them and created a better ranking model wihtout any training.

As the main libraries we will be using mergekit.


Downloads last month
14,232
Safetensors
Model size
8.03B params
Tensor type
FP16
Β·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for uygarkurt/llama-3-merged-linear

Finetunes
3 models
Merges
2 models
Quantizations
2 models

Spaces using uygarkurt/llama-3-merged-linear 7