tiiuae
/

Falcon3-7B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Falcon3-7B-Instruct-GGUF

3 contributors

History: 2 commits

slimfrikha-tii's picture

ybelkada's picture

(fix): Aligning quantized models tokenizer with base models ones (#1)

549423c verified about 2 months ago

.gitattributes

2.12 kB

falcon3 release 3 months ago
Falcon3-7B-Instruct-f16.gguf

14.9 GB
LFS

(fix): Aligning quantized models tokenizer with base models ones (#1) about 2 months ago
Falcon3-7B-Instruct-q2_k.gguf

2.89 GB
LFS

(fix): Aligning quantized models tokenizer with base models ones (#1) about 2 months ago
Falcon3-7B-Instruct-q3_k_m.gguf

3.69 GB
LFS

(fix): Aligning quantized models tokenizer with base models ones (#1) about 2 months ago
Falcon3-7B-Instruct-q4_0.gguf

4.3 GB
LFS

(fix): Aligning quantized models tokenizer with base models ones (#1) about 2 months ago
Falcon3-7B-Instruct-q4_k_m.gguf

4.57 GB
LFS

(fix): Aligning quantized models tokenizer with base models ones (#1) about 2 months ago
Falcon3-7B-Instruct-q5_0.gguf

5.18 GB
LFS

(fix): Aligning quantized models tokenizer with base models ones (#1) about 2 months ago
Falcon3-7B-Instruct-q5_k_m.gguf

5.32 GB
LFS

(fix): Aligning quantized models tokenizer with base models ones (#1) about 2 months ago
Falcon3-7B-Instruct-q6_k.gguf

6.12 GB
LFS

(fix): Aligning quantized models tokenizer with base models ones (#1) about 2 months ago
Falcon3-7B-Instruct-q8_0.gguf

7.93 GB
LFS

(fix): Aligning quantized models tokenizer with base models ones (#1) about 2 months ago
README.md

4.12 kB

falcon3 release 3 months ago