Safetensors
English
falcon_mamba
4-bit precision
bitsandbytes

The checkpoint you are trying to load has model type `falcon_mamba`

#1
by loong - opened

The checkpoint you are trying to load has model type falcon_mamba but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.

Technology Innovation Institute org

Hi @loong
Please follow the instructions in https://huggingface.co/tiiuae/falcon-mamba-7b/discussions/5#66bb5f2e79a6e4e35166c381 for running this model

@loong install transformers from source , worked for me .
pip install -U git+https://github.com/huggingface/transformers.git

Sign up or log in to comment