<thinking> tags with every model?

#7
by nerdigent - opened

It seems that every model I try is using the thinking and reflection tags now, not just Reflection 70B. Is anybody else experiencing this?

Featherless Serverless LLM org

@nerdigent
Yeah, we applied the reflection system prompt across all models.

We shouldn't have even needed to apply the system prompt at this layer - it should be baked in the chat template of that model, but :shrug:

I've reverted that now and these tags should disappear.

For unadultered model experience, and to control your own system prompts, try the model on https://featherless.ai!

wxgeorge changed discussion status to closed

Okay, thanks for the quick response! :) Other models working as expected now.

Sign up or log in to comment