GGUF
English
Inference Endpoints
conversational
ybelkada commited on
Commit
c3a22a5
1 Parent(s): 721af8d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -3
README.md CHANGED
@@ -43,10 +43,12 @@ Refer to the documentation of [`llama.cpp`](https://github.com/ggerganov/llama.c
43
  Download the GGUF weights with the command below:
44
 
45
  ```bash
46
- huggingface-cli download tiiuae/falcon-mamba-7b-instruct-GGUF --include FILENAME --local-dir ./
 
 
 
 
47
  ```
48
-
49
- with `FILENAME` being the filename you want to download locally.
50
 
51
  # Training Details
52
 
 
43
  Download the GGUF weights with the command below:
44
 
45
  ```bash
46
+ huggingface-cli download tiiuae/falcon-mamba-7b-instruct-Q8_0-GGUF --include falcon-mamba-instruct-Q8_0.gguf --local-dir ./
47
+ ```
48
+ Then you can run it with:
49
+ ```bash
50
+ ./llama-cli -m falcon-mamba-instruct-Q8_0.gguf -p "Hello how are you?"
51
  ```
 
 
52
 
53
  # Training Details
54