aixsatoshi commited on
Commit
63681ca
1 Parent(s): 0481718

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md CHANGED
@@ -16,6 +16,27 @@ While its core strength lies in English-Japanese translation, it also partially
16
 
17
  An XML-like instruction template has been adopted.
18
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  ---
20
  ### 概要
21
  Swallow-hf-13bの高い日本語力を利用した翻訳モデルです
 
16
 
17
  An XML-like instruction template has been adopted.
18
 
19
+ ---
20
+ WMT23(EN->JA)
21
+
22
+ | Model | BLEU |
23
+ |--------------------------------------------------|------|
24
+ | GPT4-turbo | 22.4 |
25
+ | Command R+ | 22.2 |
26
+ | Claude 3 Sonnet | 20.9 |
27
+ | aixsatoshi-Honyaku-13b-Q6_K.gguf | 20.8 |
28
+ | aixsatoshi-Honyaku-13b-Q8_0.gguf | 20.7 |
29
+ | aixsatoshi-Honyaku-13b-IQ4_NL.gguf | 20.6 |
30
+ | aixsatoshi-Honyaku-13b-IQ4_XS.gguf | 20.6 |
31
+ | aixsatoshi-Honyaku-13b-Q4_0.gguf | 20.4 |
32
+ | aixsatoshi-Honyaku-13b-IQ3_M.gguf | 19.8 |
33
+ | Command R | 18.4 |
34
+ | fugumt-en-ja(bs:5) | 18.0 |
35
+ | C3TR-Adapter.Q5_1.gguf | 16.0 |
36
+ | Mistral-Large | 11.3 |
37
+
38
+ [引用 @aorblue](https://x.com/aorblue/status/1792951460088685047)
39
+
40
  ---
41
  ### 概要
42
  Swallow-hf-13bの高い日本語力を利用した翻訳モデルです