Update README.md
Browse files
README.md
CHANGED
@@ -43,10 +43,12 @@ Refer to the documentation of [`llama.cpp`](https://github.com/ggerganov/llama.c
|
|
43 |
Download the GGUF weights with the command below:
|
44 |
|
45 |
```bash
|
46 |
-
huggingface-cli download tiiuae/falcon-mamba-7b-instruct-GGUF --include
|
|
|
|
|
|
|
|
|
47 |
```
|
48 |
-
|
49 |
-
with `FILENAME` being the filename you want to download locally.
|
50 |
|
51 |
# Training Details
|
52 |
|
|
|
43 |
Download the GGUF weights with the command below:
|
44 |
|
45 |
```bash
|
46 |
+
huggingface-cli download tiiuae/falcon-mamba-7b-instruct-Q8_0-GGUF --include falcon-mamba-instruct-Q8_0.gguf --local-dir ./
|
47 |
+
```
|
48 |
+
Then you can run it with:
|
49 |
+
```bash
|
50 |
+
./llama-cli -m falcon-mamba-instruct-Q8_0.gguf -p "Hello how are you?"
|
51 |
```
|
|
|
|
|
52 |
|
53 |
# Training Details
|
54 |
|