mitra-mir commited on
Commit
460f39a
1 Parent(s): 2be25fc

Add SetFit model

Browse files
Files changed (3) hide show
  1. README.md +38 -48
  2. model.safetensors +1 -1
  3. model_head.pkl +1 -1
README.md CHANGED
@@ -10,15 +10,24 @@ tags:
10
  - text-classification
11
  - generated_from_setfit_trainer
12
  widget:
13
- - text: and importance of the climate crisis requires everyone to play their part.
14
- - text: The Group has unused tax losses carried forward of 512m, primarily UK capital
15
- losses, on which no deferred tax is recognised.
16
  - text: If an acquirer of shares is not prepared to provide this declaration, the
17
  Board may refuse to register him as a shareholder with the right to vote.
18
  - text: The Company will also make every effort to improve the effectiveness of its
19
  sustainability reporting.
20
  - text: The Company maintains sufficient liquidity and has a variety of contingent
21
  liquidity resources to manage liquidity across a range of economic scenarios.
 
 
 
 
 
 
 
 
 
 
 
 
22
  inference: true
23
  model-index:
24
  - name: SetFit with sentence-transformers/paraphrase-mpnet-base-v2
@@ -32,7 +41,7 @@ model-index:
32
  split: test
33
  metrics:
34
  - type: accuracy
35
- value: 0.7657430730478589
36
  name: Accuracy
37
  ---
38
 
@@ -64,17 +73,17 @@ The model has been trained using an efficient few-shot learning technique that i
64
  - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
65
 
66
  ### Model Labels
67
- | Label | Examples |
68
- |:------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
69
- | 0.0 | <ul><li>'We believe that no company should prosper while violating the basic human rights of others whether through unlawful slavery, servitude, forced or compulsory labor, or otherwise exploitative means.'</li><li>'The decreases in the current period were offset, in part, by increases in conference and training expenditures incurred.'</li><li>'Environmental Responsibility As a core part of our business, we continually monitor, assess and respond not only to the risks but also to the opportunities posed by changing climate conditions.'</li></ul> |
70
- | 1.0 | <ul><li>'In addition, we have a majority standard for the election of directors on our board.'</li><li>'We generally find that it is more effective to take a collaborative approach in identifying and addressing proposed regulatory changes related to our assets and operations.'</li><li>'Regulations of the Supervisory Board The tasks, responsibilities and internal procedural matters for the Supervisory Board are addressed in the Regulations of the Supervisory Board and are available on our corporate website.'</li></ul> |
71
 
72
  ## Evaluation
73
 
74
  ### Metrics
75
  | Label | Accuracy |
76
  |:--------|:---------|
77
- | **all** | 0.7657 |
78
 
79
  ## Uses
80
 
@@ -92,9 +101,9 @@ Then you can load this model and run inference.
92
  from setfit import SetFitModel
93
 
94
  # Download from the 🤗 Hub
95
- model = SetFitModel.from_pretrained("mitra-mir/setfit-model-ESG-environmental")
96
  # Run inference
97
- preds = model("and importance of the climate crisis requires everyone to play their part.")
98
  ```
99
 
100
  <!--
@@ -124,14 +133,14 @@ preds = model("and importance of the climate crisis requires everyone to play th
124
  ## Training Details
125
 
126
  ### Training Set Metrics
127
- | Training set | Min | Median | Max |
128
- |:-------------|:----|:--------|:----|
129
- | Word count | 3 | 25.4020 | 72 |
130
 
131
  | Label | Training Sample Count |
132
  |:------|:----------------------|
133
- | 0.0 | 148 |
134
- | 1.0 | 51 |
135
 
136
  ### Training Hyperparameters
137
  - batch_size: (16, 16)
@@ -153,38 +162,19 @@ preds = model("and importance of the climate crisis requires everyone to play th
153
  - load_best_model_at_end: False
154
 
155
  ### Training Results
156
- | Epoch | Step | Training Loss | Validation Loss |
157
- |:------:|:----:|:-------------:|:---------------:|
158
- | 0.0020 | 1 | 0.4091 | - |
159
- | 0.1004 | 50 | 0.1992 | - |
160
- | 0.2008 | 100 | 0.0104 | - |
161
- | 0.3012 | 150 | 0.0006 | - |
162
- | 0.4016 | 200 | 0.0003 | - |
163
- | 0.5020 | 250 | 0.0002 | - |
164
- | 0.6024 | 300 | 0.0002 | - |
165
- | 0.7028 | 350 | 0.0001 | - |
166
- | 0.8032 | 400 | 0.0001 | - |
167
- | 0.9036 | 450 | 0.0001 | - |
168
- | 0.0020 | 1 | 0.25 | - |
169
- | 0.1004 | 50 | 0.349 | - |
170
- | 0.2008 | 100 | 0.047 | - |
171
- | 0.3012 | 150 | 0.0172 | - |
172
- | 0.4016 | 200 | 0.0023 | - |
173
- | 0.5020 | 250 | 0.0002 | - |
174
- | 0.6024 | 300 | 0.0002 | - |
175
- | 0.7028 | 350 | 0.0003 | - |
176
- | 0.8032 | 400 | 0.0001 | - |
177
- | 0.9036 | 450 | 0.0001 | - |
178
- | 0.0020 | 1 | 0.3684 | - |
179
- | 0.1004 | 50 | 0.39 | - |
180
- | 0.2008 | 100 | 0.1277 | - |
181
- | 0.3012 | 150 | 0.0064 | - |
182
- | 0.4016 | 200 | 0.0006 | - |
183
- | 0.5020 | 250 | 0.0004 | - |
184
- | 0.6024 | 300 | 0.0003 | - |
185
- | 0.7028 | 350 | 0.0003 | - |
186
- | 0.8032 | 400 | 0.0002 | - |
187
- | 0.9036 | 450 | 0.0002 | - |
188
 
189
  ### Framework Versions
190
  - Python: 3.11.6
 
10
  - text-classification
11
  - generated_from_setfit_trainer
12
  widget:
 
 
 
13
  - text: If an acquirer of shares is not prepared to provide this declaration, the
14
  Board may refuse to register him as a shareholder with the right to vote.
15
  - text: The Company will also make every effort to improve the effectiveness of its
16
  sustainability reporting.
17
  - text: The Company maintains sufficient liquidity and has a variety of contingent
18
  liquidity resources to manage liquidity across a range of economic scenarios.
19
+ - text: If we are unable to continue as a going concern, we may have to liquidate
20
+ our assets and may receive less than the value at which those assets are carried
21
+ on our audited financial statements, and it is likely that investors will lose
22
+ all or a part of their investment.
23
+ - text: In addition, factors such as failing to meet the expectations of or provide
24
+ quality medical care for our participants, adverse cyber or data security events,
25
+ adverse publicity or litigation involving or surrounding us, one of our centers
26
+ or our management, such as news articles and market rumors with respect to audits,
27
+ litigation and other processes described in these risk factors, have diminished
28
+ and may in the future diminish our reputation or that of our management and have
29
+ harmed and may in the future harm our brand, making it substantially more difficult
30
+ for us to attract new participants.
31
  inference: true
32
  model-index:
33
  - name: SetFit with sentence-transformers/paraphrase-mpnet-base-v2
 
41
  split: test
42
  metrics:
43
  - type: accuracy
44
+ value: 0.8261964735516373
45
  name: Accuracy
46
  ---
47
 
 
73
  - **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
74
 
75
  ### Model Labels
76
+ | Label | Examples |
77
+ |:------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
78
+ | 0.0 | <ul><li>'Our goal is for every employee to feel a strong sense of belonging and psychological safety.'</li><li>'Revenue from products labeled andor marketed to promote health and nutrition attributes is approximately 10.3 billion.'</li><li>'Assess climate change scenarios of key material risks.'</li></ul> |
79
+ | 1.0 | <ul><li>'We assessed accounting estimates for bias and evaluated whether the circumstances producing the bias, if any, represent a risk of material misstatement due to fraud.'</li><li>'Board to review and make recommendations to shareholders concerning the composition of the Board of Directors, with particular focus on issues of independence.'</li><li>'Our group audit mainly focused on significant group entities in terms of size and financial interest or where significant risks or complex activities were present, leading to full scope audits performed for including 2 nonconsolidated components.'</li></ul> |
80
 
81
  ## Evaluation
82
 
83
  ### Metrics
84
  | Label | Accuracy |
85
  |:--------|:---------|
86
+ | **all** | 0.8262 |
87
 
88
  ## Uses
89
 
 
101
  from setfit import SetFitModel
102
 
103
  # Download from the 🤗 Hub
104
+ model = SetFitModel.from_pretrained("mitra-mir/setfit-model-ESG-governance")
105
  # Run inference
106
+ preds = model("The Company will also make every effort to improve the effectiveness of its sustainability reporting.")
107
  ```
108
 
109
  <!--
 
133
  ## Training Details
134
 
135
  ### Training Set Metrics
136
+ | Training set | Min | Median | Max |
137
+ |:-------------|:----|:-------|:----|
138
+ | Word count | 2 | 24.51 | 74 |
139
 
140
  | Label | Training Sample Count |
141
  |:------|:----------------------|
142
+ | 0.0 | 146 |
143
+ | 1.0 | 54 |
144
 
145
  ### Training Hyperparameters
146
  - batch_size: (16, 16)
 
162
  - load_best_model_at_end: False
163
 
164
  ### Training Results
165
+ | Epoch | Step | Training Loss | Validation Loss |
166
+ |:-----:|:----:|:-------------:|:---------------:|
167
+ | 0.002 | 1 | 0.479 | - |
168
+ | 0.1 | 50 | 0.2577 | - |
169
+ | 0.2 | 100 | 0.0589 | - |
170
+ | 0.3 | 150 | 0.0008 | - |
171
+ | 0.4 | 200 | 0.0004 | - |
172
+ | 0.5 | 250 | 0.0003 | - |
173
+ | 0.6 | 300 | 0.0002 | - |
174
+ | 0.7 | 350 | 0.0002 | - |
175
+ | 0.8 | 400 | 0.0002 | - |
176
+ | 0.9 | 450 | 0.0002 | - |
177
+ | 1.0 | 500 | 0.0002 | - |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
178
 
179
  ### Framework Versions
180
  - Python: 3.11.6
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aedcd9b1b711338c94874e7f407a9d55500617f993c1e7ab5d4aacd6ba0944e8
3
  size 437967672
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7de3a947e784171b5e89eee0d557402a71ae451864dc00099eb4935827e91be
3
  size 437967672
model_head.pkl CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b88b7ee7c63cdc0f6333a7e1992528a279acc6b57dc6cf3299ff8ac00137bb68
3
  size 6959
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11bc6c4d67f44046c5198270a0d434d663b94d788be512f4e2c4edeac132a36c
3
  size 6959