Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
AightBits
/
Qwen2.5-32B-Instruct-8.0bpw-h8-exl2
like
0
Text Generation
Transformers
Safetensors
English
qwen2
chat
conversational
text-generation-inference
Inference Endpoints
8-bit precision
exl2
arxiv:
2309.00071
arxiv:
2407.10671
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
d0d9a84
Qwen2.5-32B-Instruct-8.0bpw-h8-exl2
1 contributor
History:
2 commits
AightBits
Upload 13 files
d0d9a84
verified
18 days ago
.gitattributes
Safe
1.52 kB
initial commit
18 days ago
README.md
Safe
6.01 kB
Upload 13 files
18 days ago
config.json
978 Bytes
Upload 13 files
18 days ago
generation_config.json
Safe
242 Bytes
Upload 13 files
18 days ago
huggingface-metadata.txt
1.85 kB
Upload 13 files
18 days ago
merges.txt
Safe
1.67 MB
Upload 13 files
18 days ago
model.safetensors.index.json
Safe
63.2 kB
Upload 13 files
18 days ago
output-00001-of-00004.safetensors
8.55 GB
LFS
Upload 13 files
18 days ago
output-00002-of-00004.safetensors
8.58 GB
LFS
Upload 13 files
18 days ago
output-00003-of-00004.safetensors
8.49 GB
LFS
Upload 13 files
18 days ago
output-00004-of-00004.safetensors
7.92 GB
LFS
Upload 13 files
18 days ago
tokenizer.json
Safe
7.03 MB
Upload 13 files
18 days ago
tokenizer_config.json
Safe
7.31 kB
Upload 13 files
18 days ago
vocab.json
Safe
2.78 MB
Upload 13 files
18 days ago