leonardlin commited on
Commit
07a24b6
·
verified ·
1 Parent(s): 7e34145

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -6
README.md CHANGED
@@ -6,12 +6,6 @@ See https://huggingface.co/shisa-ai/shisa-v1-llama3-70b for the working model
6
 
7
  First turn seems to work well (eg, benchmarks fine) but after about turn three, the model starts to output random tokens...
8
 
9
- ## Performance
10
- Measured using a [fork](https://github.com/shisa-ai/shaberi) of [Lightblue's Shaberi benchmark framework](https://github.com/lightblue-tech/japanese_llm_eval):
11
-
12
- ## Performance
13
- Measured using a [fork](https://github.com/shisa-ai/shaberi) of [Lightblue's Shaberi benchmark framework](https://github.com/lightblue-tech/japanese_llm_eval):
14
-
15
  | Model | Average | ELYZA-tasks-100 | MT-Bench | Rakuda | Tengu-Bench |
16
  |----------------------------------------|---------|-----------------|----------|--------|-------------|
17
  | **shisa-ai/shisa-v1-llama3-70b** | **7.30**| **7.34** | **7.67** | **8.15** | **6.04** |
 
6
 
7
  First turn seems to work well (eg, benchmarks fine) but after about turn three, the model starts to output random tokens...
8
 
 
 
 
 
 
 
9
  | Model | Average | ELYZA-tasks-100 | MT-Bench | Rakuda | Tengu-Bench |
10
  |----------------------------------------|---------|-----------------|----------|--------|-------------|
11
  | **shisa-ai/shisa-v1-llama3-70b** | **7.30**| **7.34** | **7.67** | **8.15** | **6.04** |