Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,12 @@ metrics:
|
|
9 |
pipeline_tag: zero-shot-classification
|
10 |
---
|
11 |
|
12 |
-
This model has been referred to the following link : https://github.com/Huffon/klue-transformers-tutorial.git
|
|
|
|
|
|
|
|
|
|
|
13 |
|
14 |
|
15 |
RoBERTa์ ๊ฐ์ด token_type_ids๋ฅผ ์ฌ์ฉํ์ง ์๋ ๋ชจ๋ธ์ ๊ฒฝ์ฐ, zero-shot pipeline์ ๋ฐ๋ก ์ ์ฉํ ์ ์์ต๋๋ค(transformers==4.7.0 ๊ธฐ์ค)
|
@@ -67,4 +72,24 @@ classifier = pipeline(
|
|
67 |
args_parser=CustomZeroShotClassificationArgumentHandler(),
|
68 |
model="pongjin/roberta_with_kornli"
|
69 |
)
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
70 |
```
|
|
|
9 |
pipeline_tag: zero-shot-classification
|
10 |
---
|
11 |
|
12 |
+
**This model has been referred to the following link : https://github.com/Huffon/klue-transformers-tutorial.git**
|
13 |
+
|
14 |
+
ํด๋น ๋ชจ๋ธ์ ์ ๊นํ๋ธ๋ฅผ ์ฐธ๊ณ ํ์ฌ klue/roberta-base ๋ชจ๋ธ์ kor_nli ์ mnli, xnli๋ก ํ์ธํ๋ํ ๋ชจ๋ธ์
๋๋ค.
|
15 |
+
| train_loss | val_loss | acc | epoch | batch | lr |
|
16 |
+
| --- | --- | --- | --- | --- | --- |
|
17 |
+
| 0.326 | 0.538 | 0.811 | 3 | 32 | 2e-5 |
|
18 |
|
19 |
|
20 |
RoBERTa์ ๊ฐ์ด token_type_ids๋ฅผ ์ฌ์ฉํ์ง ์๋ ๋ชจ๋ธ์ ๊ฒฝ์ฐ, zero-shot pipeline์ ๋ฐ๋ก ์ ์ฉํ ์ ์์ต๋๋ค(transformers==4.7.0 ๊ธฐ์ค)
|
|
|
72 |
args_parser=CustomZeroShotClassificationArgumentHandler(),
|
73 |
model="pongjin/roberta_with_kornli"
|
74 |
)
|
75 |
+
```
|
76 |
+
#### results
|
77 |
+
```python
|
78 |
+
sequence = "๋ฐฐ๋น๋ฝ D-1 ์ฝ์คํผ, 2330์ ์์น์ธ...์ธ์ธยท๊ธฐ๊ด ์ฌ์"
|
79 |
+
candidate_labels =["์ธํ",'ํ์จ', "๊ฒฝ์ ", "๊ธ์ต", "๋ถ๋์ฐ","์ฃผ์"]
|
80 |
+
|
81 |
+
classifier(
|
82 |
+
sequence,
|
83 |
+
candidate_labels,
|
84 |
+
hypothesis_template='์ด๋ {}์ ๊ดํ ๊ฒ์ด๋ค.',
|
85 |
+
)
|
86 |
+
|
87 |
+
>>{'sequence': '๋ฐฐ๋น๋ฝ D-1 ์ฝ์คํผ, 2330์ ์์น์ธ...์ธ์ธยท๊ธฐ๊ด ์ฌ์',
|
88 |
+
'labels': ['์ฃผ์', '๊ธ์ต', '๊ฒฝ์ ', '์ธํ', 'ํ์จ', '๋ถ๋์ฐ'],
|
89 |
+
'scores': [0.5052872896194458,
|
90 |
+
0.17972524464130402,
|
91 |
+
0.13852974772453308,
|
92 |
+
0.09460823982954025,
|
93 |
+
0.042949128895998,
|
94 |
+
0.038900360465049744]}
|
95 |
```
|