Tanvir1337
/

quantized-models

Text Generation

large language model

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

quantized-models / 1B

3 contributors

History: 6 commits

Tanvir1337's picture

Upload Llama-3.2-1B.F16.gguf

341c510 verified 23 days ago

Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8.pth
Detected Pickle imports (5)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.CharStorage",
- "torch.BFloat16Storage",
- "torch.FloatStorage"
What is a pickle import?
1.62 GB
LFS

Upload Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8.pth 23 days ago
Llama-3.2-1B.F16.gguf

2.48 GB
LFS

Upload Llama-3.2-1B.F16.gguf 23 days ago
Qwen2-1.5B-Instruct-3.0bpw-h6-exl2.safetensors

1.14 GB
LFS

Upload 5 files 3 months ago
Qwen2-1.5B-Instruct-4.0bpw-h6-exl2.safetensors

1.31 GB
LFS

Upload 5 files 3 months ago
Qwen2-1.5B-Instruct-5.0bpw-h6-exl2.safetensors

1.47 GB
LFS

Upload 5 files 3 months ago
Qwen2-1.5B-Instruct-6.0bpw-h6-exl2.safetensors

1.63 GB
LFS

Upload 5 files 3 months ago
Qwen2-1.5B-Instruct-8.0bpw-h8-exl2.safetensors

2.01 GB
LFS

Upload 5 files 3 months ago
smollm-1.7b-instruct-add-basics-q8_0.gguf

1.82 GB
LFS

Upload smollm-1.7b-instruct-add-basics-q8_0.gguf 23 days ago
smollm2-1.7b-instruct-q4_k_m.gguf

1.06 GB
LFS

Upload smollm2-1.7b-instruct-q4_k_m.gguf 23 days ago
tinyllama-1.1b-chat-v1.0.Q8_0.gguf

1.17 GB
LFS

add tinyllama-1.1b-chat-v1.0.Q8_0.gguf 10 months ago