Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
---
|
5 |
+
The base model is the [GPT-2 Updown](https://huggingface.co/microsoft/DialogRPT-updown) model
|
6 |
+
|
7 |
+
The training, validaiton test data come from the [financial phrasebank](https://huggingface.co/datasets/financial_phrasebank) dataset.
|
8 |
+
The training data is a data subset in which [all annotators agreed](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_allagree) on the label.
|
9 |
+
The validation data is a data subset in which [75% annotators agreed](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_75agree) on the label.
|
10 |
+
The testing data is a data subset in which [66% annotators agreed](https://huggingface.co/datasets/financial_phrasebank/viewer/sentences_66agree) on the label.
|
11 |
+
|
12 |
+
|
13 |
+
The reported macro F1 score for this model on the validation set is: 0.9046
|
14 |
+
|
15 |
+
The reported macro F1 score for this model on the test set is: 0.83.
|
16 |
+
|
17 |
+
|
18 |
+
|
19 |
+
|