--- base_model: - bunnycore/Llama-3.1-8B-TitanFusion - Dampfinchen/Llama-3.1-8B-Ultra-Instruct - Magpie-Align/MagpieLM-8B-Chat-v0.1 - bunnycore/LLama-3.1-8B-Matrix - bunnycore/LLama-3.1-8B-HyperNova-abliteration library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [bunnycore/LLama-3.1-8B-HyperNova-abliteration](https://huggingface.co/bunnycore/LLama-3.1-8B-HyperNova-abliteration) as a base. ### Models Merged The following models were included in the merge: * [bunnycore/Llama-3.1-8B-TitanFusion](https://huggingface.co/bunnycore/Llama-3.1-8B-TitanFusion) * [Dampfinchen/Llama-3.1-8B-Ultra-Instruct](https://huggingface.co/Dampfinchen/Llama-3.1-8B-Ultra-Instruct) * [Magpie-Align/MagpieLM-8B-Chat-v0.1](https://huggingface.co/Magpie-Align/MagpieLM-8B-Chat-v0.1) * [bunnycore/LLama-3.1-8B-Matrix](https://huggingface.co/bunnycore/LLama-3.1-8B-Matrix) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: bunnycore/Llama-3.1-8B-TitanFusion - model: bunnycore/LLama-3.1-8B-Matrix - model: Magpie-Align/MagpieLM-8B-Chat-v0.1 - model: Dampfinchen/Llama-3.1-8B-Ultra-Instruct - model: bunnycore/LLama-3.1-8B-HyperNova-abliteration merge_method: model_stock base_model: bunnycore/LLama-3.1-8B-HyperNova-abliteration dtype: bfloat16 ```