Falcon 3 10B broken?

#5
by suprjami - opened

I find Falcon 3 10B provides no response or extremely short responses, like a dozen tokens.

Falcon 1B and 7B work fine (I even got a battle between 7B and 10B) just the 10B is misbehaving.

I am aware of the problem and have only had time to test the Falcon 3 10B directly through Ollama, and it is misbehaving in the same way that you described. I tried different temperatures, top_p, and top_k, but nothing seemed to change.

I am looking into it, but so far I have not found a solution.

Sign up or log in to comment