Upload README.md

Upload README.md

Upload README.md

Upload README.md

Update for Transformers GPTQ support

Update README.md

Update README.md

Update README.md

Delete stablebeluga2.ggmlv3.q3_K_S.bin

Delete stablebeluga2.ggmlv3.q2_K.bin

Initial GGML model commit

Initial GGML model commit

Update README.md

fix documentation for loading the model, since the fused attention module doesnt work here either. (#4)

Delete gptq_model-4bit-128g.safetensors

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Update README.md

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit

Initial GPTQ model commit