GGUF
English
Inference Endpoints
ybelkada commited on
Commit
1a94d21
1 Parent(s): df1758a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -43,13 +43,13 @@ Refer to the documentation of [`llama.cpp`](https://github.com/ggerganov/llama.c
43
  Download the GGUF weights with the command below:
44
 
45
  ```bash
46
- huggingface-cli download tiiuae/falcon-mamba-7b-Q4_K_M-GGUF --include falcon-mamba-Q4_K_M.gguf --local-dir ./
47
  ```
48
 
49
  Once downloaded, you can quickly chat with it:
50
 
51
  ```bash
52
- ./llama-cli -m falcon-mamba-Q4_K_M.gguf -p "Hello how are you?"
53
  ```
54
 
55
  # Training Details
 
43
  Download the GGUF weights with the command below:
44
 
45
  ```bash
46
+ huggingface-cli download tiiuae/falcon-mamba-7b-Q4_K_M-GGUF --include falcon-mamba-7B-Q4_K_M.gguf --local-dir ./
47
  ```
48
 
49
  Once downloaded, you can quickly chat with it:
50
 
51
  ```bash
52
+ ./llama-cli -m falcon-mamba-7b-Q4_K_M-GGUF -p "Hello how are you?"
53
  ```
54
 
55
  # Training Details