Text Generation
Transformers
Safetensors
llama
Not-For-All-Audiences
nsfw
text-generation-inference
4-bit precision
awq
File size: 126 Bytes
fda00b1 |
1 2 3 4 5 6 7 |
{
"zero_point": true,
"q_group_size": 128,
"w_bit": 4,
"version": "GEMM",
"modules_to_not_convert": null
} |