Lambent commited on
Commit
4c4f6c7
1 Parent(s): efd0b5b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -2
README.md CHANGED
@@ -8,8 +8,21 @@ model-index:
8
  results: []
9
  ---
10
 
11
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
- should probably proofread and complete it, then remove this comment. -->
 
 
 
 
 
 
 
 
 
 
 
 
 
13
 
14
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
15
  <details><summary>See axolotl config</summary>
 
8
  results: []
9
  ---
10
 
11
+ Trying out some LISA training.
12
+ A few too many numbers changed to be quite directly comparable, but here's the nous-eval comparisons with the CosmoAlpacaLight using LORA:
13
+
14
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
15
+ |-----------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
16
+ |[CosmoAlpacaLisa-1b](https://huggingface.co/Lambent/CosmoAlpacaLisa-1b)| 23.89| 51.93| 39.93| 28.68| 36.11|
17
+
18
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
19
+ |-------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
20
+ |[CosmoAlpacaLight-1b](https://huggingface.co/Lambent/CosmoAlpacaLight-1b)| 24.28| 51.31| 40.33| 29.47| 36.35|
21
+
22
+ | Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
23
+ |---------------------------------------------------------|------:|------:|---------:|-------:|------:|
24
+ |[cosmo-1b](https://huggingface.co/HuggingFaceTB/cosmo-1b)| 22.97| 52.01| 38.02| 28.73| 35.43|
25
+
26
 
27
  [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
28
  <details><summary>See axolotl config</summary>