Uploaded model

  • Developed by: BarraHome
  • License: apache-2.0
  • Finetuned from model : BarraHome/zephyr-dpo-4bit

This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 59.99
AI2 Reasoning Challenge (25-Shot) 57.85
HellaSwag (10-Shot) 82.72
MMLU (5-Shot) 58.61
TruthfulQA (0-shot) 56.16
Winogrande (5-shot) 74.35
GSM8k (5-shot) 30.25
Downloads last month
4,947
Safetensors
Model size
7.24B params
Tensor type
BF16
Β·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for BarraHome/zephyr-dpo-v2

Base model

unsloth/zephyr-sft
Finetuned
(1)
this model
Quantizations
3 models

Datasets used to train BarraHome/zephyr-dpo-v2

Spaces using BarraHome/zephyr-dpo-v2 6

Evaluation results