BramVanroy
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -25,6 +25,10 @@ This is a `Q5_K_M` GGUF version of [BramVanroy/GEITje-7B-ultra](https://huggingf
|
|
25 |
|
26 |
## Usage
|
27 |
|
|
|
|
|
|
|
|
|
28 |
### Ollama
|
29 |
|
30 |
The model is available on `ollama` and can be easily run as follows:
|
@@ -33,7 +37,7 @@ The model is available on `ollama` and can be easily run as follows:
|
|
33 |
ollama run bramvanroy/geitje-7b-ultra-gguf
|
34 |
```
|
35 |
|
36 |
-
To reproduce, follow the next steps.
|
37 |
|
38 |
First download the [GGUF file](https://huggingface.co/BramVanroy/GEITje-7B-ultra-GGUF/resolve/main/GEITje-7B-ultra-Q5_K_M.gguf?download=true) and [Modelfile](https://huggingface.co/BramVanroy/GEITje-7B-ultra-GGUF/resolve/main/Modelfile?download=true) to your computer. You can adapt the Modelfile as you wish.
|
39 |
|
|
|
25 |
|
26 |
## Usage
|
27 |
|
28 |
+
### LM Studio
|
29 |
+
|
30 |
+
You can use this model in [LM Studio](https://lmstudio.ai/), an easy-to-use interface to locally run optimized models. Simply search for `BramVanroy/GEITje-7B-ultra-GGUF`, and download the available file.
|
31 |
+
|
32 |
### Ollama
|
33 |
|
34 |
The model is available on `ollama` and can be easily run as follows:
|
|
|
37 |
ollama run bramvanroy/geitje-7b-ultra-gguf
|
38 |
```
|
39 |
|
40 |
+
To reproduce, i.e. to create the ollama files manually instead of downloading them via ollama, follow the next steps.
|
41 |
|
42 |
First download the [GGUF file](https://huggingface.co/BramVanroy/GEITje-7B-ultra-GGUF/resolve/main/GEITje-7B-ultra-Q5_K_M.gguf?download=true) and [Modelfile](https://huggingface.co/BramVanroy/GEITje-7B-ultra-GGUF/resolve/main/Modelfile?download=true) to your computer. You can adapt the Modelfile as you wish.
|
43 |
|