model specific

#14
by cezzzz - opened

hi,
first of all, thanks for your contributions.
secondly, please, help me understand if im using your model in comfyui.
i installed comfyui custom node for joycaption2 "https://github.com/EvilBT/ComfyUI_SLK_joy_caption_two/blob/main/readme_us.md"
and i was able to run it, however im not sure if it used your latests model, because it did not download any of these big files 3-5gb (00001-00004 safetensors)
the downloads for this custom node reffered to "https://huggingface.co/spaces/fancyfeast/joy-caption-alpha-two/tree/main/cgrkzexw-599808" on top of lama3.1 model "https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct/tree/main"
the files and weights look similar. but im newbie, so decided to ask for clarification.

aha, when i said these big files im talking about those from "https://huggingface.co/fancyfeast/llama-joycaption-alpha-two-hf-llava/tree/main"

Sorry for the late response. The model from https://huggingface.co/spaces/fancyfeast/joy-caption-alpha-two/tree/main/cgrkzexw-599808 and this repo are the same. I just packaged the model up in a format compatible with HuggingFace's Llava models, so that it is easier to use, and uploaded that to this repo. I can't speak for the accuracy of implementation for that particular ComfyUI node since I haven't taken a look, but if it's using the weights from this repo or that repo it is using the correct model.

I'll try to get an official ComfyUI node out at some point.

fancyfeast changed discussion status to closed

Sign up or log in to comment