|
--- |
|
license: apache-2.0 |
|
datasets: |
|
- argilla/OpenHermes2.5-dpo-binarized-alpha |
|
language: |
|
- en |
|
pipeline_tag: text-generation |
|
tags: |
|
- conversation |
|
- text-generation-inference |
|
- CultriX/NeuralTrix-7B-dpo |
|
- dpo |
|
- Merge |
|
--- |
|
|
|
DPO Finetuned CultriX/NeuralTrix-7B-dpo using argilla/OpenHermes2.5-dpo-binarized-alpha |
|
|
|
argilla dpo binarized pairs is a dataset built on top of: https://huggingface.co/datasets/teknium/OpenHermes-2.5 using https://github.com/argilla-io/distilabel if interested. |
|
|
|
Thx for the great data sources. |
