|
--- |
|
library_name: transformers |
|
license: other |
|
base_model: tinycompany/ShawtyIsBad-nomic1.5 |
|
tags: |
|
- llama-factory |
|
- full |
|
- generated_from_trainer |
|
model-index: |
|
- name: pretrain |
|
results: [] |
|
--- |
|
|
|
| Task | Shot | Accuracy | Precision | Recall | F1 Score | |
|
|------------------|------|----------|-----------|--------|----------| |
|
| indicxparaphrase | 5 | 0.6119 | 0.9516 | 0.2358 | 0.3779 | |
|
| indicxparaphrase | 0 | 0.7268 | 0.8650 | 0.5375 | 0.6630 | |
|
| indicxnli | 0 | 0.4689 | 0.6390 | 0.4689 | 0.3782 | |
|
| indicxnli | 5 | 0.5022 | 0.5180 | 0.5022 | 0.4651 | |
|
| indicsentiment | 0 | 0.8367 | 0.7511 | 1.0000 | 0.8579 | |
|
| indicsentiment | 5 | 0.9689 | 0.9894 | 0.9472 | 0.9678 | |
|
| indiccopa | 0 | 0.6102 | 0.5701 | 0.8604 | 0.6858 | |
|
| indiccopa | 5 | 0.7194 | 0.7000 | 0.7568 | 0.7273 | |
|
|
|
Todo Tasks: |
|
- [ ] `indicheadline` |
|
- [ ] `indicqa` |
|
- [ ] `in22` Dataset [link](https://indictrans2-public.objectstore.e2enetworks.net/IN22_benchmark.tar.gz) link doesnt work for now. |
|
- [ ] Comparisons with other Indic models. |
|
|
