Update README.md
Browse files
README.md
CHANGED
@@ -6,12 +6,6 @@ See https://huggingface.co/shisa-ai/shisa-v1-llama3-70b for the working model
|
|
6 |
|
7 |
First turn seems to work well (eg, benchmarks fine) but after about turn three, the model starts to output random tokens...
|
8 |
|
9 |
-
## Performance
|
10 |
-
Measured using a [fork](https://github.com/shisa-ai/shaberi) of [Lightblue's Shaberi benchmark framework](https://github.com/lightblue-tech/japanese_llm_eval):
|
11 |
-
|
12 |
-
## Performance
|
13 |
-
Measured using a [fork](https://github.com/shisa-ai/shaberi) of [Lightblue's Shaberi benchmark framework](https://github.com/lightblue-tech/japanese_llm_eval):
|
14 |
-
|
15 |
| Model | Average | ELYZA-tasks-100 | MT-Bench | Rakuda | Tengu-Bench |
|
16 |
|----------------------------------------|---------|-----------------|----------|--------|-------------|
|
17 |
| **shisa-ai/shisa-v1-llama3-70b** | **7.30**| **7.34** | **7.67** | **8.15** | **6.04** |
|
|
|
6 |
|
7 |
First turn seems to work well (eg, benchmarks fine) but after about turn three, the model starts to output random tokens...
|
8 |
|
|
|
|
|
|
|
|
|
|
|
|
|
9 |
| Model | Average | ELYZA-tasks-100 | MT-Bench | Rakuda | Tengu-Bench |
|
10 |
|----------------------------------------|---------|-----------------|----------|--------|-------------|
|
11 |
| **shisa-ai/shisa-v1-llama3-70b** | **7.30**| **7.34** | **7.67** | **8.15** | **6.04** |
|