davidkim205 commited on
Commit
5bdaebe
·
1 Parent(s): 2bd5f8d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -1
README.md CHANGED
@@ -38,7 +38,24 @@ korean multi-task instruction dataset
38
  - PEFT 0.4.0
39
 
40
  ## Training
41
- Refer github
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
42
 
43
  ------------------------------------------------
44
  # Original model card: Meta's Llama 2 13B-chat
 
38
  - PEFT 0.4.0
39
 
40
  ## Training
41
+ Refer https://github.com/davidkim205/komt
42
+
43
+ ## Evaluation
44
+
45
+ | model | score | average(0~5) | percentage |
46
+ | --------------------------------------- | ------- | ------------ | ---------- |
47
+ | gpt-3.5-turbo(close) | 147 | 3.97 | 79.45% |
48
+ | naver Cue(close) | 140 | 3.78 | 75.67% |
49
+ | clova X(close) | 136 | 3.67 | 73.51% |
50
+ | WizardLM-13B-V1.2(open) | 96 | 2.59 | 51.89% |
51
+ | Llama-2-7b-chat-hf(open) | 67 | 1.81 | 36.21% |
52
+ | Llama-2-13b-chat-hf(open) | 73 | 1.91 | 38.37% |
53
+ | nlpai-lab/kullm-polyglot-12.8b-v2(open) | 70 | 1.89 | 37.83% |
54
+ | kfkas/Llama-2-ko-7b-Chat(open) | 96 | 2.59 | 51.89% |
55
+ | beomi/KoAlpaca-Polyglot-12.8B(open) | 100 | 2.70 | 54.05% |
56
+ | **komt-llama2-7b-v1 (open)(ours)** | **117** | **3.16** | **63.24%** |
57
+ | **komt-llama2-13b-v1 (open)(ours)** | **129** | **3.48** | **69.72%** |
58
+
59
 
60
  ------------------------------------------------
61
  # Original model card: Meta's Llama 2 13B-chat