Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
4-bit precision
gptq
Platypus2-70B-Instruct-GPTQ / quantize_config.json

Commit History

Update for Transformers GPTQ support
9b07d06

TheBloke commited on

Initial GPTQ model commit
34c41f4

TheBloke commited on