Text Generation
Transformers
Safetensors
6 languages
llama
text-generation-inference
4-bit precision
awq
Orca-2-13B-SFT_v5-AWQ / added_tokens.json
TheBloke's picture
AWQ model commit
2231c1a
{
"<|ASSISTANT|>": 32000,
"<|USER|>": 32001,
"[PAD]": 32002
}