kuotient commited on
Commit
73a59a2
β€’
1 Parent(s): fc8d748

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -2
README.md CHANGED
@@ -15,9 +15,15 @@ model-index:
15
  base_model: yanolja/EEVE-Korean-10.8B-v1.0
16
  ---
17
  # EEVE-Math-10.8B-SFT
18
- *WIP*
19
 
20
- 이 λͺ¨λΈμ€ [Orca-Math: Unlocking the potential of SLMs in Grade School Math](https://arxiv.org/pdf/2402.14830.pdf) 및 [DARE](https://arxiv.org/abs/2311.03099)의 κ°œλ…κ³Ό 이λ₯Ό ν™œμš©ν•œ λ‚΄μš©μ„ ν¬ν•¨ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€.
 
 
 
 
 
 
 
21
 
22
  | Model | gsm8k-ko(pass@1) |
23
  |---|---|
 
15
  base_model: yanolja/EEVE-Korean-10.8B-v1.0
16
  ---
17
  # EEVE-Math-10.8B-SFT
 
18
 
19
+ `EEVE-Math` ν”„λ‘œμ νŠΈλŠ”
20
+ - Orca-Math-200k λ²ˆμ—­ ([Orca-Math: Unlocking the potential of SLMs in Grade School Math](https://arxiv.org/pdf/2402.14830.pdf))
21
+ - gsm8k λ²ˆμ—­, lm_eval ν™œμš©
22
+ - Mergekit을 μ΄μš©ν•œ dare-ties μ‚¬μš© ([DARE](https://arxiv.org/abs/2311.03099))
23
+
24
+ 에 λŒ€ν•œ λ‚΄μš©μ„ ν¬κ΄„ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€.
25
+
26
+ > 이 λͺ¨λΈμ€ orca-math-word-problems-193k-korean 데이터셋을 μ΄μš©ν•˜μ—¬ ν•™μŠ΅λ˜μ—ˆμŠ΅λ‹ˆλ‹€. 응닡 쀑 μΌλΆ€λŠ” LaTeX ν˜•μ‹μ„ μ΄μš©ν•˜μ—¬ κ²°κ³Όλ₯Ό λ°˜ν™˜ν•˜μ§€λ§Œ, μ™„μ„±λœ ν˜•μ‹μ΄ 아닐 수 μžˆμŠ΅λ‹ˆλ‹€. ν˜„μž¬ M1 stageκΉŒμ§€ μ§„ν–‰λ˜μ—ˆμŠ΅λ‹ˆλ‹€.
27
 
28
  | Model | gsm8k-ko(pass@1) |
29
  |---|---|