xianchaowu
commited on
Commit
•
49ffd43
1
Parent(s):
67059e2
llama2-7b-chat
Browse files
README.md
CHANGED
|
@@ -16,6 +16,8 @@ license: llama2
|
|
| 16 |
|ckpt-1600 | 46.51% | 47.44% | -2.87% | -0.78% |
|
| 17 |
|ckpt-1500 | 47.66% | 46.88% | -1.72% | -1.33% |
|
| 18 |
|
|
|
|
|
|
|
| 19 |
### Introduction
|
| 20 |
Determine the rank of LoRA layers by the singular values of pretrained weight matrices.
|
| 21 |
Also, combines:
|
|
|
|
| 16 |
|ckpt-1600 | 46.51% | 47.44% | -2.87% | -0.78% |
|
| 17 |
|ckpt-1500 | 47.66% | 46.88% | -1.72% | -1.33% |
|
| 18 |
|
| 19 |
+
llama2-7b-chat: '0ede8dd71e923db6258295621d817ca8714516d4'
|
| 20 |
+
|
| 21 |
### Introduction
|
| 22 |
Determine the rank of LoRA layers by the singular values of pretrained weight matrices.
|
| 23 |
Also, combines:
|