Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,12 @@
|
|
| 1 |
---
|
| 2 |
license: llama2
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: llama2
|
| 3 |
---
|
| 4 |
+
GGUF quantisation of https://huggingface.co/Lin-Chen/ShareGPT4V-13B
|
| 5 |
+
|
| 6 |
+
You can run the model with llama.cpp server, then visit the server webpage to upload an image. Example:
|
| 7 |
+
|
| 8 |
+
```
|
| 9 |
+
.\server.exe -m ".\models\ShareGPT4V-13B-Q4_K_M.gguf" -t 6 -c 4096 -ngl 26 --mmproj ".\models\mmproj-model-f16.gguf"
|
| 10 |
+
```
|
| 11 |
+
|
| 12 |
+
A low temperature is recommended.
|