Commit
•
1b95302
1
Parent(s):
0fc618a
Update README.md
Browse files
README.md
CHANGED
|
@@ -10,6 +10,33 @@ tags:
|
|
| 10 |
- t5
|
| 11 |
- text-classification
|
| 12 |
- mnli
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
---
|
| 14 |
|
| 15 |
# flan-t5-base-mnli
|
|
@@ -50,6 +77,19 @@ candidate_labels = ['travel', 'cooking', 'dancing']
|
|
| 50 |
classifier(sequence_to_classify, candidate_labels)
|
| 51 |
```
|
| 52 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 53 |
## Uses
|
| 54 |
|
| 55 |
#### Direct Use
|
|
|
|
| 10 |
- t5
|
| 11 |
- text-classification
|
| 12 |
- mnli
|
| 13 |
+
model-index:
|
| 14 |
+
- name: sjrhuschlee/flan-t5-base-mnli
|
| 15 |
+
results:
|
| 16 |
+
- task:
|
| 17 |
+
type: text-classification
|
| 18 |
+
name: Text Classsification
|
| 19 |
+
dataset:
|
| 20 |
+
name: glue
|
| 21 |
+
type: glue
|
| 22 |
+
config: mnli
|
| 23 |
+
split: validation_matched
|
| 24 |
+
metrics:
|
| 25 |
+
- type: accuracy
|
| 26 |
+
value: 87.468
|
| 27 |
+
name: Accuracy
|
| 28 |
+
- task:
|
| 29 |
+
type: text-classification
|
| 30 |
+
name: Text Classsification
|
| 31 |
+
dataset:
|
| 32 |
+
name: glue
|
| 33 |
+
type: glue
|
| 34 |
+
config: mnli
|
| 35 |
+
split: validation_mismatched
|
| 36 |
+
metrics:
|
| 37 |
+
- type: accuracy
|
| 38 |
+
value: 87.276
|
| 39 |
+
name: Accuracy
|
| 40 |
---
|
| 41 |
|
| 42 |
# flan-t5-base-mnli
|
|
|
|
| 77 |
classifier(sequence_to_classify, candidate_labels)
|
| 78 |
```
|
| 79 |
|
| 80 |
+
## Metrics
|
| 81 |
+
```bash
|
| 82 |
+
# MNLI
|
| 83 |
+
{
|
| 84 |
+
"eval_accuracy": 0.8746816097809476,
|
| 85 |
+
"eval_accuracy_mm": 0.8727624084621644,
|
| 86 |
+
"eval_loss": 0.4271220564842224,
|
| 87 |
+
"eval_loss_mm": 0.4265698492527008,
|
| 88 |
+
"eval_samples": 9815,
|
| 89 |
+
"eval_samples_mm": 9832,
|
| 90 |
+
}
|
| 91 |
+
```
|
| 92 |
+
|
| 93 |
## Uses
|
| 94 |
|
| 95 |
#### Direct Use
|