Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Tanvir1337
/
quantized-models
like
0
Text Generation
Transformers
GGUF
English
exl2
large language model
text-generation-inference
Inference Endpoints
conversational
License:
mit
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
4c99798
quantized-models
/
3B
3 contributors
History:
7 commits
Tanvir1337
Upload Llama-3.2-3B-Instruct-SpinQuant_INT4_EO8.pth
4c99798
verified
29 days ago
Llama-3.2-3B-Instruct-SpinQuant_INT4_EO8.pth
Safe
pickle
Detected Pickle imports (5)
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.CharStorage"
,
"torch.BFloat16Storage"
,
"torch.FloatStorage"
What is a pickle import?
3.96 GB
LFS
Upload Llama-3.2-3B-Instruct-SpinQuant_INT4_EO8.pth
29 days ago
bitnet_b1_58-3B.Q2_K.gguf
Safe
1.92 GB
LFS
Upload 5 files
30 days ago
bitnet_b1_58-3B.Q4_0.gguf
Safe
1.92 GB
LFS
Upload 5 files
30 days ago
bitnet_b1_58-3B.Q4_K_M.gguf
Safe
2.51 GB
LFS
Upload 5 files
30 days ago
bitnet_b1_58-3B.Q5_K_M.gguf
Safe
2.68 GB
LFS
Upload 5 files
30 days ago
bitnet_b1_58-3B.Q8_0.gguf
Safe
3.53 GB
LFS
Upload 5 files
30 days ago
bling-stable-lm-3b-4e1t-v0.Q8_0.gguf
Safe
2.97 GB
LFS
add bling-stable-lm-3b-4e1t-v0.Q8_0.gguf
11 months ago
lmcocktail-phi-2-v1.Q8_0.gguf
Safe
2.96 GB
LFS
add lmcocktail-phi-2-v1.Q8_0.gguf
11 months ago
stable-code-3b.Q8_0.gguf
Safe
2.97 GB
LFS
add stable-code-3b.Q8_0.gguf
11 months ago
stablelm-zephyr-3b.Q8_0.gguf
Safe
2.97 GB
LFS
add stablelm-zephyr-3b.Q8_0.gguf
11 months ago
zephyr-quiklang-3b-4k.Q8_0.gguf
Safe
2.97 GB
LFS
add zephyr-quiklang-3b-4k.Q8_0.gguf
11 months ago
