Tanvir1337
/

quantized-models

Text Generation

large language model

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

quantized-models / 8B

3 contributors

History: 4 commits

Tanvir1337's picture

Upload 4 files

c1423bd verified 27 days ago

Llama-3.1-8b-instruct_4bitgs64_hqq_calib_qmodel.pt
Detected Pickle imports (8)
- "torch.bfloat16",
- "torch.BFloat16Storage",
- "torch.ByteStorage",
- "torch._utils._rebuild_parameter",
- "torch._utils._rebuild_tensor_v2",
- "torch.uint8",
- "collections.OrderedDict",
- "torch.Size"
How to fix it?
6.03 GB
LFS

Upload 2 files 4 months ago
Llama-3.1-8b-instruct_4bitgs64_hqq_qmodel.pt
Detected Pickle imports (8)
- "torch.HalfStorage",
- "torch.ByteStorage",
- "torch.uint8",
- "torch.float16",
- "torch._utils._rebuild_tensor_v2",
- "torch.Size",
- "collections.OrderedDict",
- "torch._utils._rebuild_parameter"
How to fix it?
6.03 GB
LFS

Upload 2 files 4 months ago
Llama3-8B-1.58-100B-tokens-TQ1_0-F16.gguf

3.58 GB
LFS

Upload 4 files 27 days ago
Llama3-8B-1.58-100B-tokens-TQ1_0.gguf

2.21 GB
LFS

Upload 4 files 27 days ago
Llama3-8B-1.58-100B-tokens-TQ2_0.gguf

2.53 GB
LFS

Upload 4 files 27 days ago
Meta-Llama-3.1-8B-Instruct-3.0bpw-h6-exl2.safetensors

4.08 GB
LFS

Upload 3 files 4 months ago
Meta-Llama-3.1-8B-Instruct-4.0bpw-h6-exl2.safetensors

4.96 GB
LFS

Upload 3 files 4 months ago
Meta-Llama-3.1-8B-Instruct-5.0bpw-h6-exl2.safetensors

5.83 GB
LFS

Upload 3 files 4 months ago
llama-pro-8b-instruct.Q5_K_M.gguf

5.93 GB
LFS

add llama-pro-8b-instruct.Q5_K_M.gguf 10 months ago
llama3-8b-1.58bit-gguf-unsloth.F16.gguf

6.02 GB
LFS

Upload 4 files 27 days ago