RecurrentGemmaForCausalLM.forward() got an unexpected keyword argument 'position_ids'
This error happens when running the model on a HuggingFace dedicated endpoint (AWS US-East-1, A100), for any input including the provided examples.
Is the configuration not using the latest Huggingface version?
@FreeHugsForRobots
, It seems the Transformers version is not updated to this HF endpoint. Please try again by installing the latest Transformers version and let us know if the issue still persists. You can upgrade the Transformers version using !pip install --upgrade transformers or !pip install -U transformers.
If you add a requirements.txt file to the repo with an updated version of transformers, it should work. I created a PR that has this file. When deploying to inference endpoints, you can specify
revision=37ad739d64675c6cbd90f9e9897d8aa85a35b814 in the advanced configuration