Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
neuralmagic
/
granite-3.1-8b-instruct-quantized.w8a8
like
0
Follow
Neural Magic
291
Text Generation
Transformers
Safetensors
English
granite
w8a8
int8
vllm
conversational
Inference Endpoints
8-bit precision
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
granite-3.1-8b-instruct-quantized.w8a8
2 contributors
History:
15 commits
nm-research
Update README.md
1b5a84f
verified
2 days ago
.gitattributes
Safe
1.52 kB
initial commit
20 days ago
README.md
Safe
15.9 kB
Update README.md
2 days ago
added_tokens.json
Safe
87 Bytes
Add model files
20 days ago
config.json
Safe
1.91 kB
Add model files
20 days ago
generation_config.json
Safe
132 Bytes
Add model files
20 days ago
merges.txt
Safe
442 kB
Add model files
20 days ago
model-00001-of-00002.safetensors
Safe
4.99 GB
LFS
Add model files
20 days ago
model-00002-of-00002.safetensors
Safe
3.79 GB
LFS
Add model files
20 days ago
model.safetensors.index.json
Safe
54.3 kB
Add model files
20 days ago
recipe.yaml
Safe
723 Bytes
Add model files
20 days ago
special_tokens_map.json
Safe
701 Bytes
Add model files
20 days ago
tokenizer.json
Safe
3.48 MB
Add model files
20 days ago
tokenizer_config.json
Safe
8.07 kB
Add model files
20 days ago
vocab.json
Safe
777 kB
Add model files
20 days ago