heegyu commited on
Commit
edf871a
โ€ข
1 Parent(s): 2035a40

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -13
README.md CHANGED
@@ -213,16 +213,17 @@ def moderate(instruction, response):
213
  - [heegyu/PKU-SafeRLHF-ko](https://huggingface.co/datasets/heegyu/PKU-SafeRLHF-ko)
214
  - [MrBananaHuman/kor_ethical_question_answer](https://huggingface.co/datasets/MrBananaHuman/kor_ethical_question_answer)
215
 
216
- | **Dataset** | **Training Steps** | **Accuracy** | **F1 Score** | **Precision** | **Recall** |
217
- |----------------|--------------------|--------------|--------------|---------------|--------------|
218
- | kor-ethical-qa | **142947 (main)** | **0.944** | **0.942029** | 0.976395 | **0.91** |
219
- | kor-ethical-qa | 285894 | 0.888 | 0.874157 | 0.997436 | 0.778 |
220
- | kor-ethical-qa | 428841 | 0.907 | 0.898361 | 0.990361 | 0.822 |
221
- | kor-ethical-qa | 571788 | 0.751 | 0.668442 | **1** | 0.502 |
222
- | pku-safe-rlhf | **142947 (main)** | 0.833 | 0.841706 | 0.825279 | **0.858801** |
223
- | pku-safe-rlhf | 285894 | 0.845 | 0.837356 | **0.915138** | 0.77176 |
224
- | pku-safe-rlhf | 428841 | **0.848** | **0.849206** | 0.87169 | 0.827853 |
225
- | pku-safe-rlhf | 571788 | 0.798 | 0.773543 | 0.92 | 0.667311 |
226
-
227
-
228
- 0.25์—ํญ ๋‹จ์œ„๋กœ ํ‰๊ฐ€ ๋ฐ ์ €์žฅํ–ˆ์œผ๋ฉฐ, ๊ฐ ํ•™์Šต ์Šคํ…๋ณ„๋กœ revision์— ๋ชจ๋ธ์ด ์ €์žฅ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค. ์—ฌ๋Ÿฌ ์ง€ํ‘œ๋ฅผ ๊ณ ๋ คํ•ด์„œ, 142947 steps๋ฅผ main์œผ๋กœ ์„ ์ •ํ–ˆ์Šต๋‹ˆ๋‹ค.
 
 
213
  - [heegyu/PKU-SafeRLHF-ko](https://huggingface.co/datasets/heegyu/PKU-SafeRLHF-ko)
214
  - [MrBananaHuman/kor_ethical_question_answer](https://huggingface.co/datasets/MrBananaHuman/kor_ethical_question_answer)
215
 
216
+ | **Dataset** | **Training Steps** | **Accuracy** | **F1 Score** | **Precision** | **Recall** |
217
+ |-------------------|--------------------|--------------|--------------|---------------|--------------|
218
+ | OpenAI Moderation | - | 0.5 | 0.07 | 0.76 | 0.04 |
219
+ | kor-ethical-qa | **142947 (main)** | **0.944** | **0.942029** | 0.976395 | **0.91** |
220
+ | kor-ethical-qa | 285894 | 0.888 | 0.874157 | 0.997436 | 0.778 |
221
+ | kor-ethical-qa | 428841 | 0.907 | 0.898361 | 0.990361 | 0.822 |
222
+ | kor-ethical-qa | 571788 | 0.751 | 0.668442 | **1** | 0.502 |
223
+ | OpenAI Moderation | - | 0.5 | 0.07 | 0.76 | 0.04 |
224
+ | pku-safe-rlhf | **142947 (main)** | 0.833 | 0.841706 | 0.825279 | **0.858801** |
225
+ | pku-safe-rlhf | 285894 | 0.845 | 0.837356 | **0.915138** | 0.77176 |
226
+ | pku-safe-rlhf | 428841 | **0.848** | **0.849206** | 0.87169 | 0.827853 |
227
+ | pku-safe-rlhf | 571788 | 0.798 | 0.773543 | 0.92 | 0.667311 |
228
+
229
+ OpenAI Moderation API๋Š” ํ•œ๊ธ€์„ ๋ฏธ์ง€์›ํ•˜๋Š”์ง€ ๋Œ€๋ถ€๋ถ„ safeํ•˜๋‹ค๊ณ  ํŒ๋ณ„์„ ํ•ฉ๋‹ˆ๋‹ค. 0.25์—ํญ ๋‹จ์œ„๋กœ ํ‰๊ฐ€ ๋ฐ ์ €์žฅํ–ˆ์œผ๋ฉฐ, ๊ฐ ํ•™์Šต ์Šคํ…๋ณ„๋กœ revision์— ๋ชจ๋ธ์ด ์ €์žฅ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค. ์—ฌ๋Ÿฌ ์ง€ํ‘œ๋ฅผ ๊ณ ๋ คํ•ด์„œ, 142947 steps๋ฅผ main์œผ๋กœ ์„ ์ •ํ–ˆ์Šต๋‹ˆ๋‹ค.