Update README.md
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ pipeline_tag: image-to-text
|
|
17 |
|
18 |
llava-phi-3-mini is a LLaVA model fine-tuned from [microsoft/Phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) and [CLIP-ViT-Large-patch14-336](https://huggingface.co/openai/clip-vit-large-patch14-336) with [ShareGPT4V-PT](https://huggingface.co/datasets/Lin-Chen/ShareGPT4V) and [InternVL-SFT](https://github.com/OpenGVLab/InternVL/tree/main/internvl_chat#prepare-training-datasets) by [XTuner](https://github.com/InternLM/xtuner).
|
19 |
|
20 |
-
**Note: This model is in GGUF format
|
21 |
|
22 |
Resources:
|
23 |
|
@@ -58,6 +58,9 @@ Resources:
|
|
58 |
# mmproj
|
59 |
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/mmproj-model-f16.gguf
|
60 |
|
|
|
|
|
|
|
61 |
# int4 llm
|
62 |
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/ggml-model-int4.gguf
|
63 |
```
|
@@ -71,6 +74,9 @@ wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/ggml-model
|
|
71 |
|
72 |
|
73 |
```bash
|
|
|
|
|
|
|
74 |
# int4
|
75 |
./llava-cli -m ./ggml-model-int4.gguf --mmproj ./mmproj-model-f16.gguf --image YOUR_IMAGE.jpg -c 4096
|
76 |
```
|
|
|
17 |
|
18 |
llava-phi-3-mini is a LLaVA model fine-tuned from [microsoft/Phi-3-mini-4k-instruct](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) and [CLIP-ViT-Large-patch14-336](https://huggingface.co/openai/clip-vit-large-patch14-336) with [ShareGPT4V-PT](https://huggingface.co/datasets/Lin-Chen/ShareGPT4V) and [InternVL-SFT](https://github.com/OpenGVLab/InternVL/tree/main/internvl_chat#prepare-training-datasets) by [XTuner](https://github.com/InternLM/xtuner).
|
19 |
|
20 |
+
**Note: This model is in GGUF format.**
|
21 |
|
22 |
Resources:
|
23 |
|
|
|
58 |
# mmproj
|
59 |
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/mmproj-model-f16.gguf
|
60 |
|
61 |
+
# fp16 llm
|
62 |
+
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/ggml-model-f16.gguf
|
63 |
+
|
64 |
# int4 llm
|
65 |
wget https://huggingface.co/xtuner/llava-phi-3-mini-gguf/resolve/main/ggml-model-int4.gguf
|
66 |
```
|
|
|
74 |
|
75 |
|
76 |
```bash
|
77 |
+
# fp16
|
78 |
+
./llava-cli -m ./ggml-model-f16.gguf --mmproj ./mmproj-model-f16.gguf --image YOUR_IMAGE.jpg -c 4096
|
79 |
+
|
80 |
# int4
|
81 |
./llava-cli -m ./ggml-model-int4.gguf --mmproj ./mmproj-model-f16.gguf --image YOUR_IMAGE.jpg -c 4096
|
82 |
```
|