heegyu commited on
Commit
e7f4844
โ€ข
1 Parent(s): cc907ab

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -10,8 +10,9 @@ language:
10
 
11
  # ํ•œ๊ตญ์–ด Prometheus ๋ชจ๋ธ (beta)
12
 
13
- LoRA ํ•™์Šตํ•œ ๋’ค, [LogicKor](https://github.com/instructkr/LogicKor)์— ๊ณต๊ฐœ๋œ GPT-4 evaluation๊ณผ ๋น„๊ตํ•ด๋ณด์•˜์Šต๋‹ˆ๋‹ค.
14
- ์˜ˆ์ œ์— ์žˆ๋Š” ํ”„๋กฌํ”„ํŠธ๋กœ ์ƒ๊ด€๊ณ„์ˆ˜๋ฅผ ๋ถ„์„ํ•˜์˜€์œผ๋‚˜ (Spearman), ์ƒ๊ด€๊ณ„์ˆ˜๋Š” 0.3647๋กœ ๋†’์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค.
 
15
 
16
  ์นดํ…Œ๊ณ ๋ฆฌ๋ณ„ ์ƒ๊ด€๊ณ„์ˆ˜
17
 
@@ -22,7 +23,7 @@ LoRA ํ•™์Šตํ•œ ๋’ค, [LogicKor](https://github.com/instructkr/LogicKor)์— ๊ณต๊ฐœ
22
  - ์ดํ•ด: 0.436034
23
  - ์ฝ”๋”ฉ: 0.290976
24
 
25
- ๋ฌธ๋ฒ•๊ณผ ์ฝ”๋”ฉ ๋ถ€๋ถ„์ด ๋น„๊ต์  ์•ฝํ•œ ๊ฒƒ์„ ์•Œ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
26
 
27
  ### ์‚ฌ์šฉ ์˜ˆ์ œ
28
 
 
10
 
11
  # ํ•œ๊ตญ์–ด Prometheus ๋ชจ๋ธ (beta)
12
 
13
+ LoRA ํ•™์Šตํ•œ ๋’ค, [LogicKor](https://github.com/instructkr/LogicKor)์— ๊ณต๊ฐœ๋œ GPT-4์˜ judgement์™€ ๋น„๊ตํ•ด๋ณด์•˜์Šต๋‹ˆ๋‹ค.
14
+ ์˜ˆ์ œ์— ์žˆ๋Š” ํ”„๋กฌํ”„ํŠธ๋กœ ํ‰๊ฐ€ ํ›„ ์ƒ๊ด€๊ณ„์ˆ˜๋ฅผ ๋ถ„์„ํ•˜์˜€์œผ๋‚˜ (Spearman), ์ƒ๊ด€๊ณ„์ˆ˜๋Š” 0.3647๋กœ ๋†’์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค.
15
+ ์‹ฑ๊ธ€ํ„ด ์งˆ๋ฌธ์˜ ๋Œ€๋‹ต๋งŒ ํ‰๊ฐ€ํ–ˆ์œผ๋ฉฐ, reference๊ฐ€ ์—†๋Š” ์งˆ๋ฌธ์€ GPT-4์˜ ๋Œ€๋‹ต์„ 5์  reference๋กœ ์ฃผ์—ˆ์Šต๋‹ˆ๋‹ค.
16
 
17
  ์นดํ…Œ๊ณ ๋ฆฌ๋ณ„ ์ƒ๊ด€๊ณ„์ˆ˜
18
 
 
23
  - ์ดํ•ด: 0.436034
24
  - ์ฝ”๋”ฉ: 0.290976
25
 
26
+ ๋ฌธ๋ฒ•๊ณผ ์ฝ”๋”ฉ ๋ถ€๋ถ„์ด ๋น„๊ต์  ๋‚ฎ์€ ๊ฒƒ์„ ์•Œ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
27
 
28
  ### ์‚ฌ์šฉ ์˜ˆ์ œ
29