tsumeone commited on
Commit
0b03ae2
·
1 Parent(s): 03ce227

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -1,6 +1,6 @@
1
- Quantized from https://huggingface.co/ausboss/llama-30b-supercot
2
 
3
- Quantized with https://github.com/0cc4m/GPTQ-for-LLaMa for compatibility with 0cc4m's fork of KoboldAI
4
 
5
  Command used to quantize:
6
  ```python llama.py c:\llama-30b-supercot c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors 4bit-128g.safetensors```
 
1
+ Quantized version of this: https://huggingface.co/ausboss/llama-30b-supercot
2
 
3
+ GPTQ quantization using https://github.com/0cc4m/GPTQ-for-LLaMa for compatibility with 0cc4m's fork of KoboldAI
4
 
5
  Command used to quantize:
6
  ```python llama.py c:\llama-30b-supercot c4 --wbits 4 --true-sequential --groupsize 128 --save_safetensors 4bit-128g.safetensors```