help please
llama.cpp/main -m Meta-Llama-3-8B-Instruct.Q2_K.gguf -p "Building a website can be done in 10 simple steps:\nStep 1:" -n 1024 -e
zsh: no such file or directory: llama.cpp/main
did I miss something? I am totally newbie
fix it. but still no idea how to interact on Mac terminal
If you are going to use the Llama.cpp library itself and not others on top (Ollama, LM Studio, etc.), then you need to clone it, build it, then use the main file for prediction. I personally recommend using lmstudio or ollama, or at least llama.cpp-python which is much easier for everyday use.
If you are going to use the Llama.cpp library itself and not others on top (Ollama, LM Studio, etc.), then you need to clone it, build it, then use the
mainfile for prediction. I personally recommend using lmstudio or ollama, or at least llama.cpp-python which is much easier for everyday use.
yes,I just clone the repository and I can run the example now. but still no idea how to chat with
Meta-Llama-3-8B on my Mac terminal. thanks for your reply!
You are welcome. The fastest way to get up and running is https://lmstudio.ai - user friendly and optimized for macOS GPUs.
You are welcome. The fastest way to get up and running is https://lmstudio.ai - user friendly and optimized for macOS GPUs.
will try it!