Add SetFit model
Browse files- README.md +15 -15
- config_setfit.json +2 -2
- model.safetensors +1 -1
- model_head.pkl +1 -1
README.md
CHANGED
@@ -32,7 +32,7 @@ model-index:
|
|
32 |
split: test
|
33 |
metrics:
|
34 |
- type: accuracy
|
35 |
-
value: 0.
|
36 |
name: Accuracy
|
37 |
---
|
38 |
|
@@ -64,20 +64,20 @@ The model has been trained using an efficient few-shot learning technique that i
|
|
64 |
- **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
|
65 |
|
66 |
### Model Labels
|
67 |
-
| Label | Examples
|
68 |
-
|
69 |
-
| 2 | <ul><li>"
|
70 |
-
| 4 | <ul><li>
|
71 |
-
|
|
72 |
-
|
|
73 |
-
|
|
74 |
|
75 |
## Evaluation
|
76 |
|
77 |
### Metrics
|
78 |
| Label | Accuracy |
|
79 |
|:--------|:---------|
|
80 |
-
| **all** | 0.
|
81 |
|
82 |
## Uses
|
83 |
|
@@ -129,7 +129,7 @@ preds = model("my response to the film is best described as lukewarm .")
|
|
129 |
### Training Set Metrics
|
130 |
| Training set | Min | Median | Max |
|
131 |
|:-------------|:----|:-------|:----|
|
132 |
-
| Word count |
|
133 |
|
134 |
| Label | Training Sample Count |
|
135 |
|:------|:----------------------|
|
@@ -160,11 +160,11 @@ preds = model("my response to the film is best described as lukewarm .")
|
|
160 |
### Training Results
|
161 |
| Epoch | Step | Training Loss | Validation Loss |
|
162 |
|:-----:|:----:|:-------------:|:---------------:|
|
163 |
-
| 0.005 | 1 | 0.
|
164 |
-
| 0.25 | 50 | 0.
|
165 |
-
| 0.5 | 100 | 0.
|
166 |
-
| 0.75 | 150 | 0.
|
167 |
-
| 1.0 | 200 | 0.
|
168 |
|
169 |
### Framework Versions
|
170 |
- Python: 3.8.10
|
|
|
32 |
split: test
|
33 |
metrics:
|
34 |
- type: accuracy
|
35 |
+
value: 0.4447963800904977
|
36 |
name: Accuracy
|
37 |
---
|
38 |
|
|
|
64 |
- **Blogpost:** [SetFit: Efficient Few-Shot Learning Without Prompts](https://huggingface.co/blog/setfit)
|
65 |
|
66 |
### Model Labels
|
67 |
+
| Label | Examples |
|
68 |
+
|:------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
69 |
+
| 2 | <ul><li>"a farce of a parody of a comedy of a premise , it is n't a comparison to reality so much as it is a commentary about our knowledge of films ."</li><li>'mild , meandering teen flick .'</li><li>'wanker goths are on the loose !'</li></ul> |
|
70 |
+
| 4 | <ul><li>"the first tunisian film i have ever seen , and it 's also probably the most good-hearted yet sensual entertainment i 'm likely to see all year ."</li><li>"the film 's intimate camera work and searing performances pull us deep into the girls ' confusion and pain as they struggle tragically to comprehend the chasm of knowledge that 's opened between them ."</li><li>'the film is small in scope , yet perfectly formed .'</li></ul> |
|
71 |
+
| 0 | <ul><li>'priggish , lethargically paced parable of renewal .'</li><li>"not at all clear what it 's trying to say and even if it were -- i doubt it would be all that interesting ."</li><li>'an unfortunate title for a film that has nothing endearing about it .'</li></ul> |
|
72 |
+
| 3 | <ul><li>"you may leave the theater with more questions than answers , but darned if your toes wo n't still be tapping ."</li><li>'an alternately fascinating and frustrating documentary .'</li><li>'instead of hitting the audience over the head with a moral , schrader relies on subtle ironies and visual devices to convey point of view .'</li></ul> |
|
73 |
+
| 1 | <ul><li>"it 's not so much a movie as a joint promotion for the national basketball association and teenaged rap and adolescent poster-boy lil ' bow wow ."</li><li>'just the sort of lazy tearjerker that gives movies about ordinary folk a bad name .'</li><li>'well , this movie proves you wrong on both counts .'</li></ul> |
|
74 |
|
75 |
## Evaluation
|
76 |
|
77 |
### Metrics
|
78 |
| Label | Accuracy |
|
79 |
|:--------|:---------|
|
80 |
+
| **all** | 0.4448 |
|
81 |
|
82 |
## Uses
|
83 |
|
|
|
129 |
### Training Set Metrics
|
130 |
| Training set | Min | Median | Max |
|
131 |
|:-------------|:----|:-------|:----|
|
132 |
+
| Word count | 2 | 20.45 | 43 |
|
133 |
|
134 |
| Label | Training Sample Count |
|
135 |
|:------|:----------------------|
|
|
|
160 |
### Training Results
|
161 |
| Epoch | Step | Training Loss | Validation Loss |
|
162 |
|:-----:|:----:|:-------------:|:---------------:|
|
163 |
+
| 0.005 | 1 | 0.1967 | - |
|
164 |
+
| 0.25 | 50 | 0.0658 | - |
|
165 |
+
| 0.5 | 100 | 0.0883 | - |
|
166 |
+
| 0.75 | 150 | 0.0385 | - |
|
167 |
+
| 1.0 | 200 | 0.0112 | - |
|
168 |
|
169 |
### Framework Versions
|
170 |
- Python: 3.8.10
|
config_setfit.json
CHANGED
@@ -1,4 +1,4 @@
|
|
1 |
{
|
2 |
-
"
|
3 |
-
"
|
4 |
}
|
|
|
1 |
{
|
2 |
+
"labels": null,
|
3 |
+
"normalize_embeddings": false
|
4 |
}
|
model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 437967672
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:95e416560e074dc17e9fbee59c703068574823f439b0737c703c45ca5eb7bf06
|
3 |
size 437967672
|
model_head.pkl
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 31631
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0cb5f3766813b6ee0814984253a139cc3b1aa25d2737c1d30147d4602320ac6e
|
3 |
size 31631
|