Text Generation
Transformers
Safetensors
Czech
mpt
custom_code
text-generation-inference
Inference Endpoints
mfajcik commited on
Commit
87bc456
1 Parent(s): 7c9025d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -2,7 +2,7 @@
2
  license: apache-2.0
3
  ---
4
  ### Eval
5
- Dev eval at CS-HellaSwag
6
  | Model | Model Accuracy |
7
  |---------------|----------------|
8
  | mistral7b | 0.4992 |
@@ -13,7 +13,8 @@ Dev eval at CS-HellaSwag
13
  | csmpt-26.5k steps | 0.4524 |
14
 
15
 
16
- However, we ran validation on Hellaswag, and after 100k, the improvements were very noisy if any. The improvement over mistral7b is not significant.
 
17
 
18
 
19
  ### How to setup environment
 
2
  license: apache-2.0
3
  ---
4
  ### Eval
5
+ Dev eval at CS-HellaSwag (automatically translated HellaSwag benchmark)
6
  | Model | Model Accuracy |
7
  |---------------|----------------|
8
  | mistral7b | 0.4992 |
 
13
  | csmpt-26.5k steps | 0.4524 |
14
 
15
 
16
+ However, we ran validation over the course of training on CS-Hellaswag, and after 100k, the improvements were very noisy if any.
17
+ The improvement over mistral7b is not significant.
18
 
19
 
20
  ### How to setup environment