MoritzLaurer HF staff commited on
Commit
7be05ca
1 Parent(s): 12a82a1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -64
README.md CHANGED
@@ -1,72 +1,22 @@
1
  ---
2
- license: mit
3
- base_model: microsoft/deberta-v3-large
4
  tags:
5
- - generated_from_trainer
6
- metrics:
7
- - accuracy
8
- model-index:
9
- - name: deberta-v3-large-zeroshot-v1.1-all_except_nli
10
- results: []
11
  ---
12
 
13
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
- should probably proofread and complete it, then remove this comment. -->
15
-
16
- # deberta-v3-large-zeroshot-v1.1-all_except_nli
17
-
18
- This model is a fine-tuned version of [microsoft/deberta-v3-large](https://huggingface.co/microsoft/deberta-v3-large) on an unknown dataset.
19
- It achieves the following results on the evaluation set:
20
- - Loss: 0.3183
21
- - F1 Macro: 0.2132
22
- - F1 Micro: 0.2379
23
- - Accuracy Balanced: 0.2319
24
- - Accuracy: 0.2379
25
- - Precision Macro: 0.4070
26
- - Recall Macro: 0.2319
27
- - Precision Micro: 0.2379
28
- - Recall Micro: 0.2379
29
-
30
- ## Model description
31
-
32
- More information needed
33
-
34
- ## Intended uses & limitations
35
-
36
- More information needed
37
-
38
- ## Training and evaluation data
39
-
40
- More information needed
41
-
42
- ## Training procedure
43
-
44
- ### Training hyperparameters
45
-
46
- The following hyperparameters were used during training:
47
- - learning_rate: 9e-06
48
- - train_batch_size: 16
49
- - eval_batch_size: 64
50
- - seed: 42
51
- - gradient_accumulation_steps: 2
52
- - total_train_batch_size: 32
53
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
54
- - lr_scheduler_type: linear
55
- - lr_scheduler_warmup_ratio: 0.06
56
- - num_epochs: 3
57
-
58
- ### Training results
59
 
60
- | Training Loss | Epoch | Step | Validation Loss | F1 Macro | F1 Micro | Accuracy Balanced | Accuracy | Precision Macro | Recall Macro | Precision Micro | Recall Micro |
61
- |:-------------:|:-----:|:-----:|:---------------:|:--------:|:--------:|:-----------------:|:--------:|:---------------:|:------------:|:---------------:|:------------:|
62
- | 0.1929 | 1.0 | 27664 | 0.3072 | 0.8708 | 0.8831 | 0.8683 | 0.8831 | 0.8735 | 0.8683 | 0.8831 | 0.8831 |
63
- | 0.1426 | 2.0 | 55328 | 0.3692 | 0.8709 | 0.8839 | 0.8664 | 0.8839 | 0.8761 | 0.8664 | 0.8839 | 0.8839 |
64
- | 0.0935 | 3.0 | 82992 | 0.4419 | 0.8747 | 0.8864 | 0.8729 | 0.8864 | 0.8765 | 0.8729 | 0.8864 | 0.8864 |
65
 
 
 
 
 
66
 
67
- ### Framework versions
68
 
69
- - Transformers 4.33.3
70
- - Pytorch 1.11.0+cu113
71
- - Datasets 2.14.6
72
- - Tokenizers 0.12.1
 
1
  ---
2
+ language:
3
+ - en
4
  tags:
5
+ - text-classification
6
+ - zero-shot-classification
7
+ pipeline_tag: zero-shot-classification
8
+ library_name: transformers
9
+ license: mit
 
10
  ---
11
 
12
+ # Model description: deberta-v3-large-mnli-fever-anli-ling-wanli-binary
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
 
14
+ This model was mostly created as a comparative benchmark for another model, see here: https://huggingface.co/MoritzLaurer/deberta-v3-large-zeroshot-v1.1-all-33
 
 
 
 
15
 
16
+ This model was only trained on five NLI datasets, while the other model was trained on many more datasets.
17
+ I mostly recommend using the other model.
18
+ This NLI-only model might only be better for tasks that are not zeroshot classification
19
+ but that adhere more strictly to the original NLI task.
20
 
21
+ See the other model's model card for usage instructions, training data and the paper.
22