Model

trained on custom DPO dataset
- dedup
- ~20000??

Base Moel

ENERGY-DRINK-LOVE/SOLAR_merge

Framework versions

Transformers 4.38.1
Pytorch 2.2.1+cu118
Datasets 2.17.1
Tokenizers 0.15.2

Downloads last month: 1,613

Safetensors

Model size

10.7B params

Tensor type

BF16

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Finetuned from

Space using ENERGY-DRINK-LOVE/SOLAR_merge_DPOv3 1

Evaluation results