mplaza commited on
Commit
d8e1d40
1 Parent(s): af64518

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -54,3 +54,13 @@ Code output is:
54
 
55
  As the probability of 1 (=It's a paraphrase) is 0.77 and the probability of 0 (=It is not a paraphrase) is 0.22, we can conclude, for our previous example, that "se deberá obtener el acuerdo" is a paraphrase of "se buscarán acuerdos".
56
 
 
 
 
 
 
 
 
 
 
 
 
54
 
55
  As the probability of 1 (=It's a paraphrase) is 0.77 and the probability of 0 (=It is not a paraphrase) is 0.22, we can conclude, for our previous example, that "se deberá obtener el acuerdo" is a paraphrase of "se buscarán acuerdos".
56
 
57
+
58
+ # Evaluation results
59
+
60
+ We have used as test dataset 16500 pairs of phrases human tagged.
61
+ Metrics obtained are:
62
+
63
+ ```
64
+ metrics={'test_loss': 0.4869941473007202, 'test_accuracy': 0.8003636363636364, 'test_precision': 0.6692456479690522, 'test_recall': 0.5896889646357052, 'test_f1': 0.6269535673839184, 'test_matthews_correlation': 0.49324489316659575, 'test_runtime': 27.1537, 'test_samples_per_second': 607.652, 'test_steps_per_second': 19.003})
65
+
66
+ ```