Update README.md
Browse files
README.md
CHANGED
@@ -18,29 +18,12 @@ should probably proofread and complete it, then remove this comment. -->
|
|
18 |
|
19 |
# fine-tuned-distilbert-autofill
|
20 |
|
21 |
-
This model is a fine-tuned version of [
|
22 |
It achieves the following results on the evaluation set:
|
23 |
- Loss: 0.2367
|
24 |
- Precision: 0.9484
|
25 |
- Recall: 0.9473
|
26 |
- F1: 0.9473
|
27 |
-
- Confusion Matrix: [[ 94 5 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0]
|
28 |
-
[ 14 44 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]
|
29 |
-
[ 0 0 130 0 0 0 0 0 0 0 0 0 0 0 0 0 9]
|
30 |
-
[ 0 0 0 33 0 0 0 0 0 0 0 0 0 0 2 0 0]
|
31 |
-
[ 0 0 2 0 64 0 0 0 0 0 3 0 0 0 0 0 7]
|
32 |
-
[ 0 0 0 0 0 53 0 0 0 0 0 0 0 0 2 0 0]
|
33 |
-
[ 0 0 0 0 0 0 37 1 0 0 0 0 0 0 0 0 3]
|
34 |
-
[ 0 0 0 0 0 0 4 35 0 0 0 0 0 0 0 0 2]
|
35 |
-
[ 1 0 0 0 0 1 0 0 43 0 0 0 0 0 2 0 0]
|
36 |
-
[ 0 0 0 0 0 0 0 0 0 31 0 0 0 0 1 0 0]
|
37 |
-
[ 0 0 0 0 2 0 0 2 0 0 10 0 0 0 0 0 0]
|
38 |
-
[ 0 0 0 0 0 0 0 1 0 0 1 16 0 0 0 0 0]
|
39 |
-
[ 0 0 0 0 0 0 0 0 0 1 0 0 5 0 0 0 0]
|
40 |
-
[ 0 0 0 0 0 0 0 0 0 0 0 0 0 6 0 0 0]
|
41 |
-
[ 0 0 0 1 0 0 1 0 0 0 0 0 0 0 73 0 0]
|
42 |
-
[ 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 0]
|
43 |
-
[ 1 0 9 1 4 0 0 0 2 0 2 0 1 2 1 0 977]]
|
44 |
|
45 |
## Model description
|
46 |
|
@@ -69,94 +52,6 @@ The following hyperparameters were used during training:
|
|
69 |
|
70 |
### Training results
|
71 |
|
72 |
-
| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Confusion Matrix |
|
73 |
-
|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|
|
74 |
-
| 0.7726 | 1.0 | 987 | 0.3096 | 0.8920 | 0.9141 | 0.8988 | [[100 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]
|
75 |
-
[ 58 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]
|
76 |
-
[ 0 0 129 0 0 0 0 0 0 0 0 0 0 0 0 0 10]
|
77 |
-
[ 0 0 0 32 0 0 0 0 1 1 0 0 0 0 0 0 1]
|
78 |
-
[ 0 0 4 0 63 0 0 0 0 0 0 0 0 0 0 0 9]
|
79 |
-
[ 0 0 0 0 0 52 0 0 0 2 0 0 0 0 0 0 1]
|
80 |
-
[ 0 0 0 0 0 0 36 0 0 0 2 0 0 0 0 0 3]
|
81 |
-
[ 0 0 0 0 0 0 2 33 0 0 4 0 0 0 0 0 2]
|
82 |
-
[ 1 0 0 0 0 1 0 0 43 2 0 0 0 0 0 0 0]
|
83 |
-
[ 0 0 0 0 0 0 0 0 0 32 0 0 0 0 0 0 0]
|
84 |
-
[ 0 0 0 0 2 0 0 0 0 0 12 0 0 0 0 0 0]
|
85 |
-
[ 0 0 0 0 0 0 4 0 0 0 1 13 0 0 0 0 0]
|
86 |
-
[ 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0]
|
87 |
-
[ 0 0 0 0 0 0 0 0 0 6 0 0 0 0 0 0 0]
|
88 |
-
[ 0 0 0 0 0 0 1 0 1 2 0 0 0 0 71 0 0]
|
89 |
-
[ 0 0 0 0 2 0 0 0 0 1 0 0 0 0 0 0 0]
|
90 |
-
[ 1 0 7 1 5 0 0 0 1 3 1 0 0 0 1 0 980]] |
|
91 |
-
| 0.2616 | 2.0 | 1974 | 0.2645 | 0.9356 | 0.9273 | 0.9179 | [[ 99 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0]
|
92 |
-
[ 43 7 5 0 0 0 0 0 0 0 0 0 0 0 0 0 3]
|
93 |
-
[ 0 0 128 0 0 0 0 0 0 0 0 0 0 0 0 0 11]
|
94 |
-
[ 0 0 0 33 0 0 0 0 1 0 0 0 0 0 0 0 1]
|
95 |
-
[ 0 0 0 0 64 0 0 0 0 0 0 0 0 0 0 0 12]
|
96 |
-
[ 0 0 0 1 0 53 0 0 0 0 0 0 0 0 0 0 1]
|
97 |
-
[ 0 0 0 0 0 0 36 2 0 0 0 0 0 0 0 0 3]
|
98 |
-
[ 0 0 0 0 0 0 3 36 0 0 0 0 0 0 0 0 2]
|
99 |
-
[ 1 0 0 0 0 2 0 0 43 0 0 0 0 0 0 0 1]
|
100 |
-
[ 0 0 0 1 0 0 0 0 0 31 0 0 0 0 0 0 0]
|
101 |
-
[ 0 0 0 0 2 0 0 3 0 0 9 0 0 0 0 0 0]
|
102 |
-
[ 0 0 0 0 0 0 1 3 0 0 1 13 0 0 0 0 0]
|
103 |
-
[ 0 0 0 0 0 0 0 0 0 1 0 0 5 0 0 0 0]
|
104 |
-
[ 0 0 0 0 0 0 0 0 0 0 0 0 0 6 0 0 0]
|
105 |
-
[ 0 0 0 1 0 0 1 0 1 1 0 0 0 0 71 0 0]
|
106 |
-
[ 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 0]
|
107 |
-
[ 1 0 6 1 3 0 0 0 1 0 2 0 1 2 1 0 982]] |
|
108 |
-
| 0.1814 | 3.0 | 2961 | 0.2332 | 0.9437 | 0.9422 | 0.9420 | [[ 94 5 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0]
|
109 |
-
[ 15 43 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]
|
110 |
-
[ 0 0 127 0 1 0 0 0 0 0 0 0 0 0 0 0 11]
|
111 |
-
[ 0 0 0 34 0 0 0 0 0 0 0 0 0 0 0 0 1]
|
112 |
-
[ 0 0 1 0 63 0 0 0 0 0 2 0 0 0 0 0 10]
|
113 |
-
[ 0 0 0 1 0 52 0 0 0 1 1 0 0 0 0 0 0]
|
114 |
-
[ 0 0 0 0 0 0 37 1 0 0 0 0 0 0 0 0 3]
|
115 |
-
[ 0 0 0 0 0 0 4 35 0 0 0 0 0 0 0 0 2]
|
116 |
-
[ 1 0 0 0 0 1 0 0 43 2 0 0 0 0 0 0 0]
|
117 |
-
[ 0 0 0 1 0 0 0 0 0 31 0 0 0 0 0 0 0]
|
118 |
-
[ 0 0 0 0 2 0 0 2 0 0 10 0 0 0 0 0 0]
|
119 |
-
[ 0 0 0 0 0 0 2 2 0 0 1 13 0 0 0 0 0]
|
120 |
-
[ 0 0 0 0 0 0 0 0 0 1 0 0 5 0 0 0 0]
|
121 |
-
[ 0 0 0 0 0 0 0 0 0 0 0 0 0 6 0 0 0]
|
122 |
-
[ 0 0 0 1 0 0 1 0 0 1 0 0 1 0 71 0 0]
|
123 |
-
[ 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 0]
|
124 |
-
[ 1 0 8 1 4 0 0 1 1 0 2 0 1 2 1 0 978]] |
|
125 |
-
| 0.1248 | 4.0 | 3948 | 0.2255 | 0.9501 | 0.9479 | 0.9482 | [[ 95 4 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0]
|
126 |
-
[ 13 45 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]
|
127 |
-
[ 0 0 130 0 0 0 0 0 0 0 0 0 0 0 0 0 9]
|
128 |
-
[ 0 0 0 33 0 0 0 0 0 0 0 0 0 0 2 0 0]
|
129 |
-
[ 0 0 2 0 65 0 0 0 0 0 4 0 0 0 0 0 5]
|
130 |
-
[ 0 0 0 0 0 52 0 0 0 0 1 0 0 0 2 0 0]
|
131 |
-
[ 0 0 0 0 0 0 38 0 0 0 0 0 0 0 0 0 3]
|
132 |
-
[ 0 0 0 0 0 0 5 34 0 0 0 0 0 0 0 0 2]
|
133 |
-
[ 1 0 0 0 0 1 0 0 43 0 0 0 0 0 2 0 0]
|
134 |
-
[ 0 0 0 0 0 0 0 0 1 30 0 0 0 0 1 0 0]
|
135 |
-
[ 0 0 0 0 2 0 2 0 0 0 10 0 0 0 0 0 0]
|
136 |
-
[ 0 0 0 0 0 0 0 1 0 0 1 16 0 0 0 0 0]
|
137 |
-
[ 0 0 0 0 0 0 0 0 0 1 0 0 5 0 0 0 0]
|
138 |
-
[ 0 0 0 0 0 0 0 0 0 0 0 0 0 6 0 0 0]
|
139 |
-
[ 0 0 0 1 0 0 1 0 0 0 0 0 0 0 73 0 0]
|
140 |
-
[ 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 0]
|
141 |
-
[ 1 0 9 1 4 0 0 0 2 0 2 0 1 2 1 0 977]] |
|
142 |
-
| 0.1032 | 5.0 | 4935 | 0.2367 | 0.9484 | 0.9473 | 0.9473 | [[ 94 5 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0]
|
143 |
-
[ 14 44 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0]
|
144 |
-
[ 0 0 130 0 0 0 0 0 0 0 0 0 0 0 0 0 9]
|
145 |
-
[ 0 0 0 33 0 0 0 0 0 0 0 0 0 0 2 0 0]
|
146 |
-
[ 0 0 2 0 64 0 0 0 0 0 3 0 0 0 0 0 7]
|
147 |
-
[ 0 0 0 0 0 53 0 0 0 0 0 0 0 0 2 0 0]
|
148 |
-
[ 0 0 0 0 0 0 37 1 0 0 0 0 0 0 0 0 3]
|
149 |
-
[ 0 0 0 0 0 0 4 35 0 0 0 0 0 0 0 0 2]
|
150 |
-
[ 1 0 0 0 0 1 0 0 43 0 0 0 0 0 2 0 0]
|
151 |
-
[ 0 0 0 0 0 0 0 0 0 31 0 0 0 0 1 0 0]
|
152 |
-
[ 0 0 0 0 2 0 0 2 0 0 10 0 0 0 0 0 0]
|
153 |
-
[ 0 0 0 0 0 0 0 1 0 0 1 16 0 0 0 0 0]
|
154 |
-
[ 0 0 0 0 0 0 0 0 0 1 0 0 5 0 0 0 0]
|
155 |
-
[ 0 0 0 0 0 0 0 0 0 0 0 0 0 6 0 0 0]
|
156 |
-
[ 0 0 0 1 0 0 1 0 0 0 0 0 0 0 73 0 0]
|
157 |
-
[ 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 3 0]
|
158 |
-
[ 1 0 9 1 4 0 0 0 2 0 2 0 1 2 1 0 977]] |
|
159 |
-
|
160 |
|
161 |
### Framework versions
|
162 |
|
|
|
18 |
|
19 |
# fine-tuned-distilbert-autofill
|
20 |
|
21 |
+
This model is a fine-tuned version of [distilbert/distilbert-base-multilingual-cased](https://huggingface.co/distilbert/distilbert-base-multilingual-cased) on the None dataset.
|
22 |
It achieves the following results on the evaluation set:
|
23 |
- Loss: 0.2367
|
24 |
- Precision: 0.9484
|
25 |
- Recall: 0.9473
|
26 |
- F1: 0.9473
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
27 |
|
28 |
## Model description
|
29 |
|
|
|
52 |
|
53 |
### Training results
|
54 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
55 |
|
56 |
### Framework versions
|
57 |
|