Problem with transformers version
in
model = AutoModelForCausalLM.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/anaconda3/envs/dir/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 521, in from_pretrained
config, kwargs = AutoConfig.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/anaconda3/envs/dir/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1130, in from_pretrained
raise ValueError(
ValueError: The checkpoint you are trying to load has model type starcoder2 but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
Can u provide a solution to this problem? I'm using 4.38.2 transformer version.
@MRNH you should install transformers from the repo (instead of released versions).
pip install git+https://github.com/huggingface/transformers.git
thank you for the quick answer it works now
When I install the version from the repo, I get the next error:
ImportError: cannot import name 'top_k_top_p_filtering' from 'transformers' (/home/user/miniconda3/envs/genai/lib/python3.10/site-packages/transformers/init.py)
When I install the version from the repo, I get the next error:
ImportError: cannot import name 'top_k_top_p_filtering' from 'transformers' (/home/user/miniconda3/envs/genai/lib/python3.10/site-packages/transformers/init.py)
I solved this by cloning the repo, checking out to commit b27aa20 and using pip install -e .
I am also facing the error cannot import name 'top_k_top_p_filtering' from 'transformers'. I tried with your suggestion to check out b27aa20, but not working.
Could you please give the full pip install command to try with