Some weights of JinaCLIPModel were not initialized from the model checkpoint at jinaai/jina-clip-v1 and are newly initialized:
When I run the example:
I'm having some problems.
Some weights of JinaCLIPModel were not initialized from the model checkpoint at jinaai/jina-clip-v1 and are newly initialized: ['vision_model.blocks.7.attn.rope.freqs_cos', 'vision_model.blocks.2.attn.rope.freqs_sin', 'vision_model.blocks.5.attn.rope.freqs_sin', 'vision_model.blocks.8.attn.rope.freqs_cos', 'vision_model.blocks.10.attn.rope.freqs_cos', 'vision_model.blocks.6.attn.rope.freqs_cos', 'vision_model.blocks.1.attn.rope.freqs_sin', 'vision_model.blocks.7.attn.rope.freqs_sin', 'vision_model.blocks.4.attn.rope.freqs_sin', 'vision_model.blocks.9.attn.rope.freqs_cos', 'vision_model.blocks.1.attn.rope.freqs_cos', 'vision_model.blocks.3.attn.rope.freqs_cos', 'vision_model.blocks.9.attn.rope.freqs_sin', 'vision_model.blocks.6.attn.rope.freqs_sin', 'vision_model.blocks.2.attn.rope.freqs_cos', 'vision_model.blocks.0.attn.rope.freqs_sin', 'vision_model.blocks.8.attn.rope.freqs_sin', 'vision_model.blocks.10.attn.rope.freqs_sin', 'vision_model.blocks.3.attn.rope.freqs_sin', 'vision_model.blocks.4.attn.rope.freqs_cos', 'vision_model.blocks.11.attn.rope.freqs_cos', 'vision_model.blocks.11.attn.rope.freqs_sin', 'vision_model.blocks.0.attn.rope.freqs_cos', 'vision_model.blocks.5.attn.rope.freqs_cos']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
please make sure trust_remote_codebeing set to true
please make sure
trust_remote_codebeing set to true
In fact, I set it to true, but it doesn't seem to do anything.
