Update README.md
Browse files
README.md
CHANGED
|
@@ -52,6 +52,9 @@ If you want to use a particular model, you can pass the model name as an argumen
|
|
| 52 |
python relaylm.py danlou/relay-v0.1-Mistral-Nemo-2407-4bit
|
| 53 |
```
|
| 54 |
|
|
|
|
|
|
|
|
|
|
| 55 |
Alternatively, if you do not have a CUDA GPU (e.g., on a Mac), you can use the [GGUF versions](https://huggingface.co/danlou/relay-v0.1-Mistral-Nemo-2407-GGUF) through LM Studio.
|
| 56 |
|
| 57 |
With [relaylm.py](https://github.com/danlou/relay/blob/main/relaylm.py), you can also use the model declaratively, outside of an interactive chat session:
|
|
|
|
| 52 |
python relaylm.py danlou/relay-v0.1-Mistral-Nemo-2407-4bit
|
| 53 |
```
|
| 54 |
|
| 55 |
+
You should see something similar to this demo:
|
| 56 |
+
<a href="https://asciinema.org/a/MrPFq2mgIRPruKygYehCbeqwc" target="_blank"><img src="https://asciinema.org/a/MrPFq2mgIRPruKygYehCbeqwc.svg" /></a>
|
| 57 |
+
|
| 58 |
Alternatively, if you do not have a CUDA GPU (e.g., on a Mac), you can use the [GGUF versions](https://huggingface.co/danlou/relay-v0.1-Mistral-Nemo-2407-GGUF) through LM Studio.
|
| 59 |
|
| 60 |
With [relaylm.py](https://github.com/danlou/relay/blob/main/relaylm.py), you can also use the model declaratively, outside of an interactive chat session:
|