Wrong details

#1
by Sam3DX - opened

Hey! It's a mistral model but somehow it's marked as a llama in a model card.

Where do you see Llama? It's definitely configured as being a Mistral model on my side - note the value in the config.json file I create for ctransformers.

I can't see any reference to it being Llama in the README?

it's marked as lama when I browse it with LMStudio
https://gyazo.com/6c35b781720d728da67b9f06d9bbc5b3

if you check the gguf file directly in a text editor it will also be marked as llama:

GGUF #   general.architecture  llama general.name  calderaai_naberius-7b

Ah I see what you mean, it does have the llama tag in addition to the mistral tag. That's copied through from the base model - I use the tags they use. I don't know why they tagged it llama as well, but I always respect the tags they use.

Those GGUF tags are set by llama.cpp and I have no control over that. But that's correct, Mistral does use the Llama architecture. It's architecturally identical to the Llama models, just with some added features.

That's not why it's showing up as Llama in LMStudio though, I believe that's down to the tags in the README - otherwise all Mistral models would show up as Llama.

Sign up or log in to comment