Missing 1_Pooling/config.json and tokenizer.json

#9
by vickunwu - opened

Amazing work!
Looking forward to see the coming large-en variant.
Just one small problem here:
I am trying to use huggingface/text-embedding-inference to test it out. But it seems to need 1_Pooling/config.json and tokenizer.json to function correctly.

Thanks! The team has really been enjoying all the feedback and we are excited for our large-en release too!

Anyways, regarding your issue:
I am not familiar with huggingface/text-embedding-inference. It might not support trust_remote_code, in which case, the model will not be loaded correctly (you will get a bunch of warnings like this).
More details in this PR:
https://huggingface.co/jinaai/jina-embeddings-v2-base-en/discussions/11

huggingface/text-embeddings-inference released their v0.3.0 which supports jina-bert model.

vickunwu changed discussion status to closed

Sign up or log in to comment