Update README.md
Browse files
README.md
CHANGED
@@ -60,6 +60,8 @@ Use it to tag non-furry images. It might not work terribly well but it might al
|
|
60 |
|
61 |
This model may contain biases. Tags that are poorly tagged in the original data may be weakly predicted by the classifier, for instance. Tags that are very commonly present alongside other tags may be hallucinated.
|
62 |
|
|
|
|
|
63 |
### Recommendations
|
64 |
|
65 |
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
@@ -86,6 +88,8 @@ Loss weighting was informed by a Bayesian prior model trained on a set of tags f
|
|
86 |
|
87 |
Images go in, logits come out. You can't explain that.
|
88 |
|
|
|
|
|
89 |
#### Preprocessing [optional]
|
90 |
|
91 |
Image preprocessing should be done in the following order:
|
@@ -116,19 +120,13 @@ Image preprocessing should be done in the following order:
|
|
116 |
|
117 |
<!-- This should link to a Dataset Card if possible. -->
|
118 |
|
119 |
-
|
120 |
-
|
121 |
-
#### Factors
|
122 |
-
|
123 |
-
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
|
124 |
-
|
125 |
-
[More Information Needed]
|
126 |
|
127 |
#### Metrics
|
128 |
|
129 |
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
|
130 |
|
131 |
-
|
132 |
|
133 |
### Results
|
134 |
|
|
|
60 |
|
61 |
This model may contain biases. Tags that are poorly tagged in the original data may be weakly predicted by the classifier, for instance. Tags that are very commonly present alongside other tags may be hallucinated.
|
62 |
|
63 |
+
The model has been known to show biases towards English defaultness, specifically outputting the tag `english_text` on text that does not belong to any specific language, for example Arabic numerals and onomatopoeia.
|
64 |
+
|
65 |
### Recommendations
|
66 |
|
67 |
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
|
|
88 |
|
89 |
Images go in, logits come out. You can't explain that.
|
90 |
|
91 |
+
Loss objective is `F.binary_cross_entropy_with_logits(output, target, torch.maximum(target, 1.0 - prior_output))`.
|
92 |
+
|
93 |
#### Preprocessing [optional]
|
94 |
|
95 |
Image preprocessing should be done in the following order:
|
|
|
120 |
|
121 |
<!-- This should link to a Dataset Card if possible. -->
|
122 |
|
123 |
+
A validation set of approximately 128,000 images was reserved for validation testing.
|
|
|
|
|
|
|
|
|
|
|
|
|
124 |
|
125 |
#### Metrics
|
126 |
|
127 |
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
|
128 |
|
129 |
+
Bookmaker's Informedness at thresholds of 0.2, 0.3, and 0.5, as well as loss on the validation set were monitored throughout training. Training was terminated at 5 epochs, and the checkpoint with the lowest validation loss (end of 4th epoch) was taken.
|
130 |
|
131 |
### Results
|
132 |
|