Hugging Face's logo

pcuenq
/
TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF

GGUF
English
llama-cpp
Inference Endpoints
conversational
Model card Files Community
pcuenq HF staff commited on
Commit
6286acf
•
1 Parent(s): 1440d88

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -31,3 +31,7 @@ brew install ggerganov/ggerganov/llama.cpp
31
  ```bash
32
  llama-cli --hf-repo pcuenq/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF --model tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf -p "The meaning to life and the universe is "
33
  ```
 
 
 
 
 
31
  ```bash
32
  llama-cli --hf-repo pcuenq/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF --model tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf -p "The meaning to life and the universe is "
33
  ```
34
+
35
+ ```bash
36
+ llama-server --hf-repo pcuenq/TinyLlama-1.1B-Chat-v1.0-Q4_K_M-GGUF --model tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf -c 2048
37
+ ```