uygarkurt/llama3s-merged-linear

LLM Model Merging

YouTube Tutorial

Model Merging: Merge LLMs to Create Frankestein Models - Python, HuggingFace, Mergekit

GitHub

You can find the GitHub from here; https://github.com/uygarkurt/Model-Merge

In this specific case, I typed llama-3 into the open LLM leaderboard, took the best 3 models, merged them and created a better ranking model wihtout any training.

As the main libraries we will be using mergekit.