Note FalconMamba technical report

tiiuae/falcon-mamba-7b

Text Generation • Updated 5 days ago • 12.3k • 221

Note First strong attention free model for general purpose usage, based on Mamba1 architecture

tiiuae/falcon-mamba-7b-instruct

Text Generation • Updated 5 days ago • 12.6k • 67

Note FalconMamba-7B fine-tuned on instruction data, for chat-like interaction with the model

tiiuae/falcon-mamba-7b-4bit

Text Generation • Updated Oct 10 • 57 • 11

Note FalconMamba-7B quantized in 4bit precision using `bitsandbytes` library for lighter memory requirements and smaller GPU hardwares

tiiuae/falcon-mamba-7b-instruct-4bit

Updated Oct 10 • 148 • 12

Note FalconMamba-7B-instruct quantized in 4bit precision using `bitsandbytes` library for lighter memory requirements and smaller GPU hardwares

tiiuae/falcon-mamba-7b-instruct-BF16-GGUF

Updated Oct 10 • 49 • 1

Note Falcon Mamba 7b-instruct in GGUF format (compatible with llama.cpp) in BF16 format

tiiuae/falcon-mamba-7b-instruct-F16-GGUF

Updated Oct 10 • 60 • 1

Note Falcon Mamba 7b-instruct in GGUF format (compatible with llama.cpp) in F16 format

tiiuae/falcon-mamba-7b-instruct-Q8_0-GGUF

Updated Oct 10 • 45 • 5

Note Falcon Mamba 7b-instruct in GGUF format (compatible with llama.cpp) in quantized Q8_0 format

tiiuae/falcon-mamba-7b-instruct-Q4_K_M-GGUF

Updated Oct 10 • 119 • 5

Note Falcon Mamba 7b-instruct in GGUF format (compatible with llama.cpp) in quantized Q4_K_M format

tiiuae/falcon-mamba-7b-BF16-GGUF

Updated Oct 10 • 109 • 2

Note Falcon Mamba 7b in GGUF format (compatible with llama.cpp) in BF16 format

tiiuae/falcon-mamba-7b-F16-GGUF

Updated Oct 10 • 51 • 1

Note Falcon Mamba 7b in GGUF format (compatible with llama.cpp) in F16 format

tiiuae/falcon-mamba-7b-Q8_0-GGUF

Updated Oct 10 • 25 • 2

Note Falcon Mamba 7b in GGUF format (compatible with llama.cpp) in quantized Q8_0 format

tiiuae/falcon-mamba-7b-Q4_K_M-GGUF

Updated Oct 10 • 13 • 1

Note Falcon Mamba 7b in GGUF format (compatible with llama.cpp) in quantized Q4_K_M format

tiiuae/falcon-mamba-7b-pre-decay

Updated Oct 10 • 89 • 3

Note Pre-decay stage checkpoint useful for continuous pretraining