Update README.md
Browse files
README.md
CHANGED
@@ -8,8 +8,21 @@ model-index:
|
|
8 |
results: []
|
9 |
---
|
10 |
|
11 |
-
|
12 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
|
14 |
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|
15 |
<details><summary>See axolotl config</summary>
|
|
|
8 |
results: []
|
9 |
---
|
10 |
|
11 |
+
Trying out some LISA training.
|
12 |
+
A few too many numbers changed to be quite directly comparable, but here's the nous-eval comparisons with the CosmoAlpacaLight using LORA:
|
13 |
+
|
14 |
+
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|
15 |
+
|-----------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|
16 |
+
|[CosmoAlpacaLisa-1b](https://huggingface.co/Lambent/CosmoAlpacaLisa-1b)| 23.89| 51.93| 39.93| 28.68| 36.11|
|
17 |
+
|
18 |
+
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|
19 |
+
|-------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
|
20 |
+
|[CosmoAlpacaLight-1b](https://huggingface.co/Lambent/CosmoAlpacaLight-1b)| 24.28| 51.31| 40.33| 29.47| 36.35|
|
21 |
+
|
22 |
+
| Model |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
|
23 |
+
|---------------------------------------------------------|------:|------:|---------:|-------:|------:|
|
24 |
+
|[cosmo-1b](https://huggingface.co/HuggingFaceTB/cosmo-1b)| 22.97| 52.01| 38.02| 28.73| 35.43|
|
25 |
+
|
26 |
|
27 |
[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
|
28 |
<details><summary>See axolotl config</summary>
|