CluelessNovice
commited on
Commit
•
d634191
1
Parent(s):
9c36e2a
Update README.md
Browse files
README.md
CHANGED
@@ -9,9 +9,9 @@ license: mit
|
|
9 |
**Performance (on test set):** 85.75% Accuracy
|
10 |
|
11 |
**LoRA config:**
|
12 |
-
- **r:**
|
13 |
- **lora_dropout:** 0
|
14 |
-
- **lora_alpha:**
|
15 |
- **target_modules:** ["query", "key", "value", "intermediate.dense", "output.dense"]
|
16 |
- **modules_to_save:** ["classifier"]
|
17 |
|
|
|
9 |
**Performance (on test set):** 85.75% Accuracy
|
10 |
|
11 |
**LoRA config:**
|
12 |
+
- **r:** 16
|
13 |
- **lora_dropout:** 0
|
14 |
+
- **lora_alpha:** 32
|
15 |
- **target_modules:** ["query", "key", "value", "intermediate.dense", "output.dense"]
|
16 |
- **modules_to_save:** ["classifier"]
|
17 |
|