--- base_model: - Nitral-AI/Captain-Eris_Violet-GRPO-v0.420 - HumanLLMs/Human-Like-Mistral-Nemo-Instruct-2407 - TheDrummer/Rocinante-12B-v1.1 - yamatazen/EtherealAurora-12B - nbeerbower/Mistral-Nemo-12B-abliterated-LORA library_name: transformers tags: - mergekit - merge - chatml language: - en - ja --- ![image/png](https://huggingface.co/yamatazen/EtherealNight-12B/resolve/main/EtherealNight-12B.png?download=true) This is a ChatML model. # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [yamatazen/EtherealAurora-12B](https://huggingface.co/yamatazen/EtherealAurora-12B) + [nbeerbower/Mistral-Nemo-12B-abliterated-LORA](https://huggingface.co/nbeerbower/Mistral-Nemo-12B-abliterated-LORA) as a base. ### Models Merged The following models were included in the merge: * [Nitral-AI/Captain-Eris_Violet-GRPO-v0.420](https://huggingface.co/Nitral-AI/Captain-Eris_Violet-GRPO-v0.420) * [HumanLLMs/Human-Like-Mistral-Nemo-Instruct-2407](https://huggingface.co/HumanLLMs/Human-Like-Mistral-Nemo-Instruct-2407) * [TheDrummer/Rocinante-12B-v1.1](https://huggingface.co/TheDrummer/Rocinante-12B-v1.1) ### Configuration The following YAML configuration was used to produce this model: ```yaml base_model: yamatazen/EtherealAurora-12B+nbeerbower/Mistral-Nemo-12B-abliterated-LORA models: - model: Nitral-AI/Captain-Eris_Violet-GRPO-v0.420 - model: HumanLLMs/Human-Like-Mistral-Nemo-Instruct-2407 - model: TheDrummer/Rocinante-12B-v1.1 merge_method: model_stock dtype: bfloat16 parameters: normalize: true ```