Update README.md
Browse files
README.md
CHANGED
|
@@ -27,51 +27,51 @@ and is comparable with Mistral-7B-v0.1 on MMLU and MT-Bench in English.
|
|
| 27 |
|
| 28 |
## Performance
|
| 29 |
|
| 30 |
-
| **[Traditional Chinese Benchmarks]**
|
| 31 |
-
|
| 32 |
-
| MediaTek-Research/Breeze-7B-Base-v0.1
|
| 33 |
-
| MediaTek-Research/Breeze-7B-Instruct-v0.1
|
| 34 |
-
| mistralai/Mistral-7B-v0.1
|
| 35 |
-
| mistralai/Mistral-7B-Instruct-v0.1
|
| 36 |
-
| yentinglin/Taiwan-LLM-7B-v2.1-base
|
| 37 |
-
| yentinglin/Taiwan-LLM-7B-v2.1-chat
|
| 38 |
-
| yentinglin/Taiwan-LLM-13B-v2.0-base
|
| 39 |
-
| yentinglin/Taiwan-LLM-13B-v2.0-chat
|
| 40 |
-
| 01-ai/Yi-6B-Base
|
| 41 |
-
| 01-ai/Yi-6B-Chat
|
| 42 |
-
| 01-ai/Yi-34B-Base
|
| 43 |
-
| 01-ai/Yi-34B-Chat
|
| 44 |
-
| Qwen/Qwen-7B
|
| 45 |
-
| Qwen/Qwen-7B-Chat
|
| 46 |
-
| Qwen/Qwen-14B
|
| 47 |
-
| Qwen/Qwen-14B-Chat
|
| 48 |
-
| gpt-3.5-turbo-0613
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
| **[English Benchmarks]**
|
| 52 |
-
|
| 53 |
-
| MediaTek-Research/Breeze-7B-Base-v0.1
|
| 54 |
-
| MediaTek-Research/Breeze-7B-Instruct-v0.1
|
| 55 |
-
| mistralai/Mistral-7B-v0.1
|
| 56 |
-
| mistralai/Mistral-7B-Instruct-v0.1
|
| 57 |
-
| yentinglin/Taiwan-LLM-7B-v2.1-base
|
| 58 |
-
| yentinglin/Taiwan-LLM-7B-v2.1-chat
|
| 59 |
-
| yentinglin/Taiwan-LLM-13B-v2.0-base
|
| 60 |
-
| yentinglin/Taiwan-LLM-13B-v2.0-chat
|
| 61 |
-
| 01-ai/Yi-6B-Base
|
| 62 |
-
| 01-ai/Yi-6B-Chat
|
| 63 |
-
| 01-ai/Yi-34B-Base
|
| 64 |
-
| 01-ai/Yi-34B-Chat
|
| 65 |
-
| Qwen/Qwen-7B
|
| 66 |
-
| Qwen/Qwen-7B-Chat
|
| 67 |
-
| Qwen/Qwen-14B
|
| 68 |
-
| Qwen/Qwen-14B-Chat
|
| 69 |
-
| gpt-3.5-turbo-0613
|
| 70 |
|
| 71 |
|
| 72 |
| **[Inference Metrics on Traditional Chinese]** | Speed (char/sec) | Compression Ratio | Max Character Size |
|
| 73 |
|--------------------------------------------------------------------|-------------------|-------------------|--------------------|
|
| 74 |
-
| MediaTek-Research/Breeze-7B-Base-v0.1
|
| 75 |
| mistralai/Mistral-7B-v0.1 | | | |
|
| 76 |
| yentinglin/Taiwan-LLM-7B-v2.1-base | | | |
|
| 77 |
| yentinglin/Taiwan-LLM-13B-v2.0-base | | | |
|
|
|
|
| 27 |
|
| 28 |
## Performance
|
| 29 |
|
| 30 |
+
| **[Traditional Chinese Benchmarks]** | TMMLU+ 5-shot (ACC) | DRCD 5-shot (EM) | MT-Bench-tw (Score) |
|
| 31 |
+
|-----------------------------------------------------|---------------------|------------------|---------------------|
|
| 32 |
+
| MediaTek-Research/Breeze-7B-Base-v0.1 | | | - |
|
| 33 |
+
| MediaTek-Research/Breeze-7B-Instruct-v0.1 | | | |
|
| 34 |
+
| mistralai/Mistral-7B-v0.1 | | | - |
|
| 35 |
+
| mistralai/Mistral-7B-Instruct-v0.1 | | | |
|
| 36 |
+
| yentinglin/Taiwan-LLM-7B-v2.1-base | | | - |
|
| 37 |
+
| yentinglin/Taiwan-LLM-7B-v2.1-chat | | | |
|
| 38 |
+
| yentinglin/Taiwan-LLM-13B-v2.0-base | | | - |
|
| 39 |
+
| yentinglin/Taiwan-LLM-13B-v2.0-chat | | | |
|
| 40 |
+
| 01-ai/Yi-6B-Base | | | - |
|
| 41 |
+
| 01-ai/Yi-6B-Chat | | | |
|
| 42 |
+
| 01-ai/Yi-34B-Base | | | - |
|
| 43 |
+
| 01-ai/Yi-34B-Chat | | | |
|
| 44 |
+
| Qwen/Qwen-7B | | | - |
|
| 45 |
+
| Qwen/Qwen-7B-Chat | | | |
|
| 46 |
+
| Qwen/Qwen-14B | | | - |
|
| 47 |
+
| Qwen/Qwen-14B-Chat | | | |
|
| 48 |
+
| gpt-3.5-turbo-0613 | | | |
|
| 49 |
+
|
| 50 |
+
|
| 51 |
+
| **[English Benchmarks]** | MMLU 5-shot (ACC) | MT-Bench (Score) |
|
| 52 |
+
|-----------------------------------------------------|---------------------|------------------|
|
| 53 |
+
| MediaTek-Research/Breeze-7B-Base-v0.1 | | - |
|
| 54 |
+
| MediaTek-Research/Breeze-7B-Instruct-v0.1 | | |
|
| 55 |
+
| mistralai/Mistral-7B-v0.1 | | - |
|
| 56 |
+
| mistralai/Mistral-7B-Instruct-v0.1 | | |
|
| 57 |
+
| yentinglin/Taiwan-LLM-7B-v2.1-base | | - |
|
| 58 |
+
| yentinglin/Taiwan-LLM-7B-v2.1-chat | | |
|
| 59 |
+
| yentinglin/Taiwan-LLM-13B-v2.0-base | | - |
|
| 60 |
+
| yentinglin/Taiwan-LLM-13B-v2.0-chat | | - |
|
| 61 |
+
| 01-ai/Yi-6B-Base | | - |
|
| 62 |
+
| 01-ai/Yi-6B-Chat | | |
|
| 63 |
+
| 01-ai/Yi-34B-Base | | - |
|
| 64 |
+
| 01-ai/Yi-34B-Chat | | |
|
| 65 |
+
| Qwen/Qwen-7B | | - |
|
| 66 |
+
| Qwen/Qwen-7B-Chat | | |
|
| 67 |
+
| Qwen/Qwen-14B | | - |
|
| 68 |
+
| Qwen/Qwen-14B-Chat | | |
|
| 69 |
+
| gpt-3.5-turbo-0613 | | |
|
| 70 |
|
| 71 |
|
| 72 |
| **[Inference Metrics on Traditional Chinese]** | Speed (char/sec) | Compression Ratio | Max Character Size |
|
| 73 |
|--------------------------------------------------------------------|-------------------|-------------------|--------------------|
|
| 74 |
+
| MediaTek-Research/Breeze-7B-Base-v0.1 | | | | |
|
| 75 |
| mistralai/Mistral-7B-v0.1 | | | |
|
| 76 |
| yentinglin/Taiwan-LLM-7B-v2.1-base | | | |
|
| 77 |
| yentinglin/Taiwan-LLM-13B-v2.0-base | | | |
|