Update README.md

README.md

@@ -1,5 +1,5 @@
 ---
-license: apache-2.0
+license: cc
 base_model: HuggingFaceTB/cosmo-1b
 tags:
 - generated_from_trainer
@@ -11,6 +11,27 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
+Trying out some LISA training.
+This one used the same learning rate as the LORA training and only 4 layers each 10 steps.
+Honestly these numbers are probably noise, with how close they are.
+
+|                                     Model                                     |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
+|-------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
+|[CosmoAlpacaLisa-0.2-1b](https://huggingface.co/Lambent/CosmoAlpacaLisa-0.2-1b)|  23.81|  51.75|     39.31|   29.04|  35.98|
+
+|                                 Model                                 |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
+|-----------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
+|[CosmoAlpacaLisa-1b](https://huggingface.co/Lambent/CosmoAlpacaLisa-1b)|  23.89|  51.93|     39.93|   28.68|  36.11|
+
+|                                  Model                                  |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
+|-------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
+|[CosmoAlpacaLight-1b](https://huggingface.co/Lambent/CosmoAlpacaLight-1b)|  24.28|  51.31|     40.33|   29.47|  36.35|
+
+|                          Model                          |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
+|---------------------------------------------------------|------:|------:|---------:|-------:|------:|
+|[cosmo-1b](https://huggingface.co/HuggingFaceTB/cosmo-1b)|  22.97|  52.01|     38.02|   28.73|  35.43|
+
+
 [<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
 <details><summary>See axolotl config</summary>