metadata
license: cc-by-nc-4.0
tags:
- merge
Merge of KoboldAI/LLaMA2-13B-Psyfighter2 and NeverSleep/Noromaid-13b-v0.1.1
.yaml file for mergekit
models:
- model: LLaMA2-13B-Psyfighter2
- model: Noromaid-13b-v0.1.1
parameters:
density: 0.65
weight: [0, 0.3, 0.7, 1]
merge_method: ties
base_model: LLaMA2-13B-Psyfighter2
parameters:
normalize: true
int8_mask: true
dtype: float16
| Metric | Value |
|---|---|
| Avg. | 59.47 |
| ARC (25-shot) | 61.86 |
| HellaSwag (10-shot) | 84.58 |
| MMLU (5-shot) | 57.04 |
| TruthfulQA (0-shot) | 50.66 |
| Winogrande (5-shot) | 75.37 |
| GSM8K (5-shot) | 27.29 |