Should BioMistral run on Ollama?
#2
by
jansaasman
- opened
The regular Mistral and other versions of Mistral all work fine on my Ollama locally, but what is the magic invocation to get this Bio version to work?
The regular Mistral and other versions of Mistral all work fine on my Ollama locally, but what is the magic invocation to get this Bio version to work?
It should be the same. This seems to be a direct fine-tune of Mistral-7b without changing anything else. What's the issue?
Original model: https://huggingface.co/BioMistral/BioMistral-7B
A colleague pointed me to run it by using:
ollama run cniongolo/biomistral
so my mistake for not looking good enough in the pages for biomistral :-)
You can also download GGUFs from here and use it offline via Modelfile in Ollama