vllm

i am trying hf to gguf but there is no config

#15
by Batubatu - opened

Does anyone have a config file?

This is what you are looking for: https://huggingface.co/mistral-community/pixtral-12b

It still won't work because there's no llamacpp support yet

This comment has been hidden

Sign up or log in to comment