AI-Engine
/

Llama-3.2-3B-Instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

Llama-3.2-3B-Instruct-GGUF

1 contributor

History: 6 commits

AI-Engine's picture

Upload 2 files

4b625ef verified 3 months ago

.gitattributes

1.82 kB

Upload Llama-3.2-3B-Instruct-F32.gguf with huggingface_hub 3 months ago
LICENSE.txt

7.71 kB

Upload 2 files 3 months ago
Llama-3.2-3B-Instruct-F32.gguf

12.9 GB
LFS

Upload Llama-3.2-3B-Instruct-F32.gguf with huggingface_hub 3 months ago
Llama-3.2-3B-Instruct-imatrix.q2_k.gguf

1.36 GB
LFS

Upload Llama-3.2-3B-Instruct-imatrix.q2_k.gguf with huggingface_hub 3 months ago
Llama-3.2-3B-Instruct-imatrix.q5_k_m.gguf

2.32 GB
LFS

Upload Llama-3.2-3B-Instruct-imatrix.q5_k_m.gguf with huggingface_hub 3 months ago
Llama-3.2-3B-Instruct-imatrix.q8_0.gguf

3.42 GB
LFS

Upload Llama-3.2-3B-Instruct-imatrix.q8_0.gguf with huggingface_hub 3 months ago
README.md

29 Bytes

initial commit 3 months ago
USE_POLICY.md

6.02 kB

Upload 2 files 3 months ago