Update README.md
Browse files
README.md
CHANGED
@@ -2,7 +2,8 @@
|
|
2 |
license: mit
|
3 |
---
|
4 |
|
5 |
-
# NousResearch - Obsidian-3B-V0.5
|
|
|
6 |
To run the server inside /llama.cpp/ folder IN YOUR TERMINAL
|
7 |
|
8 |
## ./server -m obsidian-q6.gguf --mmproj mmproj-obsidian-f16.gguf -ngl 42
|
|
|
2 |
license: mit
|
3 |
---
|
4 |
|
5 |
+
# Original model: [NousResearch - Obsidian-3B-V0.5](https://huggingface.co/NousResearch/Obsidian-3B-V0.5)
|
6 |
+
## gguf q6 quantised version by Nisten
|
7 |
To run the server inside /llama.cpp/ folder IN YOUR TERMINAL
|
8 |
|
9 |
## ./server -m obsidian-q6.gguf --mmproj mmproj-obsidian-f16.gguf -ngl 42
|