File size: 537 Bytes
5c485c1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
---
license: apache-2.0
datasets:
- argilla/OpenHermes2.5-dpo-binarized-alpha
language:
- en
pipeline_tag: text-generation
tags:
- merge
- dpo
- conversation
- text-generation-inference
- Kukedlc/NeuTrixOmniBe-7B-model-remix
---
DPO Finetuned Kukedlc/NeuTrixOmniBe-7B-model-remix using argilla/OpenHermes2.5-dpo-binarized-alpha
argilla dpo binarized pairs is a dataset built on top of: https://huggingface.co/datasets/teknium/OpenHermes-2.5 using https://github.com/argilla-io/distilabel if interested.
Thx for the great data sources. |