Update README.md
Browse files
README.md
CHANGED
|
@@ -18,6 +18,13 @@ Big thanks to [@jartine](https://huggingface.co/jartine) and [@vikhyat](https://
|
|
| 18 |
2. `chmod +x moondream2.llamafile` - make it executable
|
| 19 |
3. `./moondream2.llamafile` - run the llama.cpp server
|
| 20 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 21 |
# ORIGINAL MODEL CARD
|
| 22 |
|
| 23 |
moondream2 is a small vision language model designed to run efficiently on edge devices. Check out the [GitHub repository](https://github.com/vikhyat/moondream) for details, or try it out on the [Hugging Face Space](https://huggingface.co/spaces/vikhyatk/moondream2)!
|
|
|
|
| 18 |
2. `chmod +x moondream2.llamafile` - make it executable
|
| 19 |
3. `./moondream2.llamafile` - run the llama.cpp server
|
| 20 |
|
| 21 |
+
## Versions
|
| 22 |
+
|
| 23 |
+
1. [Q5_M](https://huggingface.co/cjpais/moondream2-llamafile/resolve/main/moondream2-q5_k.llamafile?download=true)
|
| 24 |
+
2. [Q8_0](https://huggingface.co/cjpais/moondream2-llamafile/resolve/main/moondream2-q8.llamafile?download=true)
|
| 25 |
+
|
| 26 |
+
From my short testing the Q8 is noticeably better.
|
| 27 |
+
|
| 28 |
# ORIGINAL MODEL CARD
|
| 29 |
|
| 30 |
moondream2 is a small vision language model designed to run efficiently on edge devices. Check out the [GitHub repository](https://github.com/vikhyat/moondream) for details, or try it out on the [Hugging Face Space](https://huggingface.co/spaces/vikhyatk/moondream2)!
|