GreenBitAI
/

yi-34b-w4a16g32

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

NicoNico commited on Dec 25, 2023

Commit

b55fe0b

•

1 Parent(s): e8fff0b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -23,7 +23,7 @@ Please refer to our [Github page](https://github.com/GreenBitAI/low_bit_llama/tr
 ## Few Shot Evaluation (officially evaluated by 01-Yi)
 | Model          | Yi-34B FP16| [Yi-34B 4 bit](https://huggingface.co/GreenBitAI/yi-34b-w4a16g32) | Yi-6B FP16 | [Yi-6B 4 bit](https://huggingface.co/GreenBitAI/yi-6b-w4a16g32) |
 |----------------|-----------|----------|----------|---------|
-| GroupSize      | -         | 32       | -        | 8       |
 | Model Size (GB)| 68.79     | 19.89    | 12.12    | 4.04    |
 | AVG            | 70.64     | 69.7     | 60.11    | 59.14   |
 | **Detailed Evaluation** | | | | |

 ## Few Shot Evaluation (officially evaluated by 01-Yi)
 | Model          | Yi-34B FP16| [Yi-34B 4 bit](https://huggingface.co/GreenBitAI/yi-34b-w4a16g32) | Yi-6B FP16 | [Yi-6B 4 bit](https://huggingface.co/GreenBitAI/yi-6b-w4a16g32) |
 |----------------|-----------|----------|----------|---------|
+| GroupSize      | -         | 32       | -        | 32      |
 | Model Size (GB)| 68.79     | 19.89    | 12.12    | 4.04    |
 | AVG            | 70.64     | 69.7     | 60.11    | 59.14   |
 | **Detailed Evaluation** | | | | |