shuyuej
/

Qwen2-72B-Instruct-GPTQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Qwen2-72B-Instruct-GPTQ

1 contributor

History: 3 commits

shuyuej's picture

Update config.json

69de012 verified 4 months ago

.gitattributes

1.52 kB

initial commit 4 months ago
README.md

31 Bytes

initial commit 4 months ago
config.json

1.03 kB

Update config.json 4 months ago
model-00001-of-00008.safetensors

5.37 GB
LFS

Upload folder using huggingface_hub 4 months ago
model-00002-of-00008.safetensors

5.35 GB
LFS

Upload folder using huggingface_hub 4 months ago
model-00003-of-00008.safetensors

5.35 GB
LFS

Upload folder using huggingface_hub 4 months ago
model-00004-of-00008.safetensors

5.35 GB
LFS

Upload folder using huggingface_hub 4 months ago
model-00005-of-00008.safetensors

5.27 GB
LFS

Upload folder using huggingface_hub 4 months ago
model-00006-of-00008.safetensors

5.35 GB
LFS

Upload folder using huggingface_hub 4 months ago
model-00007-of-00008.safetensors

5.35 GB
LFS

Upload folder using huggingface_hub 4 months ago
model-00008-of-00008.safetensors

4.11 GB
LFS

Upload folder using huggingface_hub 4 months ago
model.safetensors.index.json

216 kB

Upload folder using huggingface_hub 4 months ago
quantize_config.json

267 Bytes

Upload folder using huggingface_hub 4 months ago