Glavin001
/

tiny-puffed-llama-GPTQ

Text Generation

Inference Endpoints

Model card Files Files and versions Community

tiny-puffed-llama-GPTQ

1 contributor

History: 3 commits

Glavin001's picture

AutoGPTQ model for PY007/TinyLlama-1.1B-step-50K-105b: 4bits, gr128, desc_act=False

a13b72d over 1 year ago

.gitattributes

1.52 kB

initial commit over 1 year ago
config.json

636 Bytes

AutoGPTQ model for PY007/TinyLlama-1.1B-step-50K-105b: 4bits, gr128, desc_act=False over 1 year ago
gptq_model-4bit-128g.safetensors

768 MB
LFS

AutoGPTQ model for PY007/TinyLlama-1.1B-step-50K-105b: 4bits, gr128, desc_act=False over 1 year ago
quantize_config.json

211 Bytes

AutoGPTQ model for PY007/TinyLlama-1.1B-step-50K-105b: 4bits, gr128, desc_act=False over 1 year ago
special_tokens_map.json

95 Bytes

AutoGPTQ model for PY007/TinyLlama-1.1B-step-50K-105b: 4bits, gr128, desc_act=False over 1 year ago
tokenizer.model

500 kB
LFS

AutoGPTQ model for PY007/TinyLlama-1.1B-step-50K-105b: 4bits, gr128, desc_act=False over 1 year ago
tokenizer_config.json

905 Bytes

AutoGPTQ model for PY007/TinyLlama-1.1B-step-50K-105b: 4bits, gr128, desc_act=False over 1 year ago