update transformers also for this ?
#1
by
talrid
- opened
do i must update transformers also for this model ?
currently you state that only https://huggingface.co/ibm-granite/granite-8b-code-instruct needs an updated verison
no, only 3 and 8b need an update.
20 and 34b can run with any release version of transformers.
the 3 and 8b should also be fixed with the next transformers release when it comes out.
mayank-mishra
changed discussion status to
closed
@mayank-mishra
Thanks for the answer.
i was able to load and fine-tune both the 8B and the 34B models (the 8B model indeed needed new versions of transformers and vllm)
I am building a benchmark of fine-tuning models for code tasks. will report results soon
sounds great