Update README.md
Browse files
README.md
CHANGED
@@ -54,3 +54,13 @@ Code output is:
|
|
54 |
|
55 |
As the probability of 1 (=It's a paraphrase) is 0.77 and the probability of 0 (=It is not a paraphrase) is 0.22, we can conclude, for our previous example, that "se deberá obtener el acuerdo" is a paraphrase of "se buscarán acuerdos".
|
56 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
54 |
|
55 |
As the probability of 1 (=It's a paraphrase) is 0.77 and the probability of 0 (=It is not a paraphrase) is 0.22, we can conclude, for our previous example, that "se deberá obtener el acuerdo" is a paraphrase of "se buscarán acuerdos".
|
56 |
|
57 |
+
|
58 |
+
# Evaluation results
|
59 |
+
|
60 |
+
We have used as test dataset 16500 pairs of phrases human tagged.
|
61 |
+
Metrics obtained are:
|
62 |
+
|
63 |
+
```
|
64 |
+
metrics={'test_loss': 0.4869941473007202, 'test_accuracy': 0.8003636363636364, 'test_precision': 0.6692456479690522, 'test_recall': 0.5896889646357052, 'test_f1': 0.6269535673839184, 'test_matthews_correlation': 0.49324489316659575, 'test_runtime': 27.1537, 'test_samples_per_second': 607.652, 'test_steps_per_second': 19.003})
|
65 |
+
|
66 |
+
```
|