Easy evaluation of the zero-shot capabilities of pubmedclip

#3
by fhvilshoj - opened

Hi!
Thanks for your big efforts in training this model. It's truly helping push forward the field of AI!

I wanted to show how we've evaluated the model against a bunch of others on a handful of medical datasets. It's super easy to add other datasets from HF as well.

medical-linear-probe-accuracy.png

We did it with this repo: https://github.com/encord-team/text-to-image-eval

Would be curious to hear how this stacks up against your findings!

Sign up or log in to comment