Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Tanvir1337
/
quantized-models
like
0
Text Generation
Transformers
GGUF
English
exl2
large language model
text-generation-inference
Inference Endpoints
conversational
License:
mit
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
quantized-models
/
8B
3 contributors
History:
4 commits
Tanvir1337
Upload 4 files
c1423bd
verified
23 days ago
Llama-3.1-8b-instruct_4bitgs64_hqq_calib_qmodel.pt
pickle
Detected Pickle imports (8)
"torch.bfloat16"
,
"torch.BFloat16Storage"
,
"torch.ByteStorage"
,
"torch._utils._rebuild_parameter"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.uint8"
,
"collections.OrderedDict"
,
"torch.Size"
How to fix it?
6.03 GB
LFS
Upload 2 files
3 months ago
Llama-3.1-8b-instruct_4bitgs64_hqq_qmodel.pt
pickle
Detected Pickle imports (8)
"torch.HalfStorage"
,
"torch.ByteStorage"
,
"torch.uint8"
,
"torch.float16"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.Size"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_parameter"
How to fix it?
6.03 GB
LFS
Upload 2 files
3 months ago
Llama3-8B-1.58-100B-tokens-TQ1_0-F16.gguf
Safe
3.58 GB
LFS
Upload 4 files
23 days ago
Llama3-8B-1.58-100B-tokens-TQ1_0.gguf
Safe
2.21 GB
LFS
Upload 4 files
23 days ago
Llama3-8B-1.58-100B-tokens-TQ2_0.gguf
Safe
2.53 GB
LFS
Upload 4 files
23 days ago
Meta-Llama-3.1-8B-Instruct-3.0bpw-h6-exl2.safetensors
Safe
4.08 GB
LFS
Upload 3 files
3 months ago
Meta-Llama-3.1-8B-Instruct-4.0bpw-h6-exl2.safetensors
Safe
4.96 GB
LFS
Upload 3 files
3 months ago
Meta-Llama-3.1-8B-Instruct-5.0bpw-h6-exl2.safetensors
Safe
5.83 GB
LFS
Upload 3 files
3 months ago
llama-pro-8b-instruct.Q5_K_M.gguf
Safe
5.93 GB
LFS
add llama-pro-8b-instruct.Q5_K_M.gguf
10 months ago
llama3-8b-1.58bit-gguf-unsloth.F16.gguf
Safe
6.02 GB
LFS
Upload 4 files
23 days ago