tiiuae
/

falcon-mamba-7b-instruct-Q4_K_M-GGUF

Inference Endpoints

Model card Files Files and versions Community

ybelkada commited on Aug 19, 2024

Commit

94ed67f

·

verified ·

1 Parent(s): a3bd1c3

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -11,7 +11,7 @@ datasets:
 <img src="https://huggingface.co/datasets/tiiuae/documentation-images/resolve/main/falcon_mamba/thumbnail.png" alt="drawing" width="800"/>
-**GGUF quantization of [`falcon-mamba-7b-instruct`](https://huggingface.co/tiiuae/falcon-mamba-7b-instruct) in the format `BF16`**
 #  Table of Contents

 <img src="https://huggingface.co/datasets/tiiuae/documentation-images/resolve/main/falcon_mamba/thumbnail.png" alt="drawing" width="800"/>
+**GGUF quantization of [`falcon-mamba-7b-instruct`](https://huggingface.co/tiiuae/falcon-mamba-7b-instruct) in the format `Q4_K_M`**
 #  Table of Contents