pszemraj commited on
Commit
650dbcf
1 Parent(s): 29fc3a8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -0
README.md CHANGED
@@ -72,6 +72,23 @@ It achieves the following results on the evaluation set:
72
 
73
  KI dataset
74
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
75
  ## Training procedure
76
 
77
  ### Training hyperparameters
 
72
 
73
  KI dataset
74
 
75
+
76
+
77
+ `hf-causal-experimental (pretrained=BEE-spoke-data/NanoLlama-GQA-L10-A32_KV8-v13-KI,revision=main,trust_remote_code=True,dtype='float'), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8`
78
+
79
+ | Task |Version| Metric | Value | |Stderr|
80
+ |--------------|------:|--------|------:|---|-----:|
81
+ |arc_easy | 0|acc | 0.4322|± |0.0102|
82
+ | | |acc_norm| 0.3960|± |0.0100|
83
+ |boolq | 1|acc | 0.6196|± |0.0085|
84
+ |lambada_openai| 0|ppl |61.6595|± |2.4362|
85
+ | | |acc | 0.2779|± |0.0062|
86
+ |openbookqa | 0|acc | 0.1540|± |0.0162|
87
+ | | |acc_norm| 0.2840|± |0.0202|
88
+ |piqa | 0|acc | 0.6028|± |0.0114|
89
+ | | |acc_norm| 0.6028|± |0.0114|
90
+ |winogrande | 0|acc | 0.5193|± |0.0140|
91
+
92
  ## Training procedure
93
 
94
  ### Training hyperparameters