hfl
/

hfl-rc commited on
Commit
cc7fe76
1 Parent(s): d45a7b9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -1
README.md CHANGED
@@ -4,4 +4,34 @@ language:
4
  - zh
5
  - en
6
  ---
7
- Work-in-progress (WIP)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  - zh
5
  - en
6
  ---
7
+
8
+ # Chinese-Mixtral-Instruct-GGUF
9
+
10
+ This repository contains the GGUF-v3 models (llama.cpp compatible) for **Chinese-Mixtral-Instruct** (chat/instruction model).
11
+
12
+ ## Performance
13
+
14
+ Metric: PPL, lower is better
15
+
16
+ | Quant | PPL |
17
+ | ----- | ---- |
18
+ | IQ2_XXS | - |
19
+ | IQ2_XS | - |
20
+ | Q2_K | - |
21
+ | Q3_K | - |
22
+ | Q4_0 | - |
23
+ | Q4_K | - |
24
+ | Q5_0 | - |
25
+ | Q5_K | - |
26
+ | Q6_K | - |
27
+ | Q8_0 | - |
28
+ | F16 | x |
29
+
30
+ Due to the file size limitation, for F16 model, please use `cat` command to concatenate all parts into a single file. **You must concatenate these parts in order.**
31
+
32
+
33
+ ## Others
34
+
35
+ For Hugging Face version, please see: https://huggingface.co/hfl/chinese-mixtral-instruct
36
+
37
+ Please refer to [https://github.com/ymcui/Chinese-Mixtral/](https://github.com/ymcui/Chinese-Mixtral/) for more details.