Spaces:
Running
Running
Falcon 3 10B broken?
#5
by
suprjami
- opened
I find Falcon 3 10B provides no response or extremely short responses, like a dozen tokens.
Falcon 1B and 7B work fine (I even got a battle between 7B and 10B) just the 10B is misbehaving.
I am aware of the problem and have only had time to test the Falcon 3 10B directly through Ollama, and it is misbehaving in the same way that you described. I tried different temperatures, top_p, and top_k, but nothing seemed to change.
I am looking into it, but so far I have not found a solution.