bartowski

/

Meta-Llama-3.1-70B-Instruct-GGUF

like 55

correct, these will be broken until LM Studio gets an update to support the new rope method, for now use the models on the lmstudio-community:

https://huggingface.co/lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF

Yes, I came to that conclusion few minutes ago and I'm using it with llama.cpp server now. Thanks

Can someone remind me when this issue is resolved?

@Doiiars @JWDzGulh LM Studio has a new version pushed as of yesterday evening, 0.2.29, so it should work now :)

It does !:)

@Doiiars @JWDzGulh LM Studio has a new version pushed as of yesterday evening, 0.2.29, so it should work now :)

I'm using Ollama, it looks like I still need to wait for a while.

Fixed, thank you. I solved it using the pre-released ollama.