Update README.md
Browse files
README.md
CHANGED
@@ -72,6 +72,23 @@ It achieves the following results on the evaluation set:
|
|
72 |
|
73 |
KI dataset
|
74 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
75 |
## Training procedure
|
76 |
|
77 |
### Training hyperparameters
|
|
|
72 |
|
73 |
KI dataset
|
74 |
|
75 |
+
|
76 |
+
|
77 |
+
`hf-causal-experimental (pretrained=BEE-spoke-data/NanoLlama-GQA-L10-A32_KV8-v13-KI,revision=main,trust_remote_code=True,dtype='float'), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8`
|
78 |
+
|
79 |
+
| Task |Version| Metric | Value | |Stderr|
|
80 |
+
|--------------|------:|--------|------:|---|-----:|
|
81 |
+
|arc_easy | 0|acc | 0.4322|± |0.0102|
|
82 |
+
| | |acc_norm| 0.3960|± |0.0100|
|
83 |
+
|boolq | 1|acc | 0.6196|± |0.0085|
|
84 |
+
|lambada_openai| 0|ppl |61.6595|± |2.4362|
|
85 |
+
| | |acc | 0.2779|± |0.0062|
|
86 |
+
|openbookqa | 0|acc | 0.1540|± |0.0162|
|
87 |
+
| | |acc_norm| 0.2840|± |0.0202|
|
88 |
+
|piqa | 0|acc | 0.6028|± |0.0114|
|
89 |
+
| | |acc_norm| 0.6028|± |0.0114|
|
90 |
+
|winogrande | 0|acc | 0.5193|± |0.0140|
|
91 |
+
|
92 |
## Training procedure
|
93 |
|
94 |
### Training hyperparameters
|