|
--- |
|
license: apache-2.0 |
|
datasets: We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs |
|
language: |
|
- ko |
|
pipeline_tag: text-generation |
|
--- |
|
|
|
**Explanation** |
|
- With the base model, applied DPO to the small amount of layers with the open dataset , saved just the adapter part |
|
- Merged the base model and the tuned adapter together |
|
|
|
**Base Model** |
|
- [yanolja/KoSOLAR-10.7B-v0.3](https://huggingface.co/yanolja/KoSOLAR-10.7B-v0.3) |
|
|
|
**Used Corpus** |
|
- [We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs](https://huggingface.co/datasets/We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs) |
|
|
|
**Score** |
|
- TBU |
|
|
|
**Log** |
|
- 2024.02.13: Initial version Upload |
|
|
|
**LICENSE** |
|
- Apache 2.0 |
