File size: 357 Bytes
9b79e98 b7c4aa7 |
1 2 3 4 5 6 7 8 9 10 11 12 |
---
license: llama2
---
GGUF quantisation of https://huggingface.co/Lin-Chen/ShareGPT4V-13B
You can run the model with llama.cpp server, then visit the server webpage to upload an image. Example:
```
.\server.exe -m ".\models\ShareGPT4V-13B-Q4_K_M.gguf" -t 6 -c 4096 -ngl 26 --mmproj ".\models\mmproj-model-f16.gguf"
```
A low temperature is recommended. |