benjicolby's picture
Update README.md
92d0767

This is a GPTQ 4-bit version of WizardLM-30B-Uncensored-Guanaco-SuperCOT-30b

Quanitized using commit df77083 of GPTA-for-LLaMa with the following settings: wikitext2 --wbits 4 --true-sequential --act-order --save_safetensors

Tested in oobabooga using the GPTQ triton branch. No guarantees on compatibility.


license: other