Missing 1_Pooling/config.json and tokenizer.json
Amazing work!
Looking forward to see the coming large-en variant.
Just one small problem here:
I am trying to use huggingface/text-embedding-inference
to test it out. But it seems to need 1_Pooling/config.json
and tokenizer.json
to function correctly.
Thanks! The team has really been enjoying all the feedback and we are excited for our large-en release too!
Anyways, regarding your issue:
I am not familiar with huggingface/text-embedding-inference
. It might not support trust_remote_code
, in which case, the model will not be loaded correctly (you will get a bunch of warnings like this).
More details in this PR:
https://huggingface.co/jinaai/jina-embeddings-v2-base-en/discussions/11
huggingface/text-embeddings-inference
released their v0.3.0 which supports jina-bert model.