Willy030125
/

finetune-indoMMLU-Merak-7B-v1

text-generation-inference

Model card Files Files and versions Community

Willy030125 commited on Jan 31

Commit

b25d3c2

•

1 Parent(s): 807111c

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -19,6 +19,7 @@ lora_dropout=0.05
 learning_rate = 2e-4
 lr_scheduler = "cosine"
 max_seq_length = 2048
 ```

 learning_rate = 2e-4
 lr_scheduler = "cosine"
+optimizer = "paged_adamw_32bit"
 max_seq_length = 2048
 ```