llama 3 experiments
Collection
Merge and finetune experiments with llama 3, aiming for decensorship and benchmark performance.
•
17 items
•
Updated
This model is based on Llama-3-8b, and is governed by META LLAMA 3 COMMUNITY LICENSE AGREEMENT
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Model Stock merge method using vicgalle/Configurable-Llama-3-8B-v0.2 as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: NousResearch/Meta-Llama-3-8B-Instruct
- model: Locutusque/llama-3-neural-chat-v1-8b
- model: Undi95/Llama-3-Unholy-8B
- model: PathFinderKR/Waktaverse-Llama-3-KO-8B-Instruct
- model: Azure99/blossom-v5-llama3-8b
merge_method: model_stock
base_model: vicgalle/Configurable-Llama-3-8B-v0.2
dtype: bfloat16