What is the context size for Gemma? I get error when asking for it in the config file e.g., AttributeError("'GemmaConfig' object has no attribute 'context_length'")
#32
by
brando
- opened
What is the context size for Gemma? I get error when asking for it in the config file e.g., AttributeError("'GemmaConfig' object has no attribute 'context_length'")
Hi ! I think it should be 8192: https://huggingface.co/google/gemma-2b/blob/main/config.json#L14
This has been confirmed by the author here: https://huggingface.co/google/gemma-7b-it/discussions/73#65e9678c0cda621164a95bad