Hugging Face's logo

Cartinoe5930
/
KoRAE-13b-DPO

Text Generation
Transformers
Safetensors
Korean
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
Cartinoe5930 commited on
Commit
14fdbc6
•
1 Parent(s): d358026

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -35,7 +35,7 @@ For more details, please check the GitHub Repository!
35
  ## Training Details
36
 
37
  - **Hardward:** We utilized A100 80G for finetuning
38
- - **Training factors:** The [Transformers Trainer](https://huggingface.co/docs/transformers/main_classes/trainer) and [Huggingface PEFT](https://huggingface.co/docs/peft/index) were utilized for finetuning.
39
  - **Training Details:** DPO training 1 epoch on [ko_Ultrafeedback_binarized](https://huggingface.co/datasets/maywell/ko_Ultrafeedback_binarized) dataset. [KoRAE-13b](https://huggingface.co/Cartinoe5930/KoRAE-13b) model was used.
40
 
41
  For more details, please check the GitHub Repository!
 
35
  ## Training Details
36
 
37
  - **Hardward:** We utilized A100 80G for finetuning
38
+ - **Training factors:** The [TRL DPOTrainer](https://huggingface.co/docs/trl/main/en/dpo_trainer) and [Huggingface PEFT](https://huggingface.co/docs/peft/index) were utilized for finetuning.
39
  - **Training Details:** DPO training 1 epoch on [ko_Ultrafeedback_binarized](https://huggingface.co/datasets/maywell/ko_Ultrafeedback_binarized) dataset. [KoRAE-13b](https://huggingface.co/Cartinoe5930/KoRAE-13b) model was used.
40
 
41
  For more details, please check the GitHub Repository!