Hugging Face's logo

elinas
/
vicuna-13b-4bit

Text Generation
Transformers
llama
vicuna
gptq
Inference Endpoints
Model card Files Community
3
elinas commited on
Commit
97d7325
•
1 Parent(s): 93690c1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -6,7 +6,7 @@ tags:
6
  ---
7
 
8
  # vicuna-13b-4bit
9
- Converted `vicuna-13b` to GPTQ 4bit using `true-sequentual` and `groupsize 128` for best possible model performance.
10
 
11
  https://github.com/qwopqwop200/GPTQ-for-LLaMa
12
 
 
6
  ---
7
 
8
  # vicuna-13b-4bit
9
+ Converted `vicuna-13b` to GPTQ 4bit using `true-sequentual` and `groupsize 128` in `safetensors` for best possible model performance.
10
 
11
  https://github.com/qwopqwop200/GPTQ-for-LLaMa
12