Submit to the leaderboard and remove the gate
#3
by
kno10
- opened
https://huggingface.co/spaces/occiglot/euro-llm-leaderboard
But I think you cannot submit it currently, because it is gated access.
Hello, it would be interesting if this model could be used in Ollama. Any clue about that ? thank you
@GIOVANITH2 As Ollama is using GGUF Quants, yes. You should be able to use it in Ollama. There 5 GGUF versions listed for this model:
https://huggingface.co/models?other=base_model:quantized:utter-project/EuroLLM-9B-Instruct
https://huggingface.co/bartowski/EuroLLM-9B-Instruct-GGUF for example. If follow the "Use this model" button in the upper right corner you are also able to launch it directly in LM Studio or Msty as an alternative to Ollama.
And for Ollama: https://huggingface.co/docs/hub/en/ollama
ollama run hf.co/bartowski/EuroLLM-9B-Instruct-GGUF
phmartins
changed discussion status to
closed