Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Willy030125
/
finetune-indoMMLU-Merak-7B-v1
like
0
Adapters
Safetensors
Indonesian
text-generation-inference
License:
cc-by-sa-4.0
Model card
Files
Files and versions
Community
1
Deploy
Use this model
Willy030125
commited on
Jan 31
Commit
4873044
•
1 Parent(s):
75d64aa
Create README.md
Browse files
Files changed (1)
hide
show
README.md
+9
-0
README.md
ADDED
Viewed
@@ -0,0 +1,9 @@
1
+
finetune-indoMMLU-Merak-7B-v1
2
+
3
+
lora r=8
4
+
lora_alpha=16
5
+
lora_dropout=0.05
6
+
7
+
learning_rate = 2e-4
8
+
lr_scheduler = "cosine"
9
+
max_seq_length = 2048