Thireus
/

Vicuna13B-v1.1-8bit-128g

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Thireus commited on Apr 16, 2023

Commit

8036f5c

·

1 Parent(s): e0d32b5

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -22,7 +22,7 @@ Refs:
 - wbits: 8
 - true-sequential: yes
 - act-order: yes
-- 8-bit quantized - Read more about this here: https://github.com/ggerganov/llama.cpp/pull/951
 - Conversion process: LLaMa 13B -> LLaMa 13B HF -> Vicuna13B-v1.1 HF -> Vicuna13B-v1.1-8bit-128g
 <br>

 - wbits: 8
 - true-sequential: yes
 - act-order: yes
+- 8-bit quantized
 - Conversion process: LLaMa 13B -> LLaMa 13B HF -> Vicuna13B-v1.1 HF -> Vicuna13B-v1.1-8bit-128g
 <br>