rope_scaling AWQ version
#2
by
QuantumState745837
- opened
ValueError: rope_scaling must be a dictionary with with two fields, type and factor, got {'factor': 2.5, 'finetuned': False, 'original_max_position_embeddings': 4096, 'type': 'yarn'}
I am getting the same error still. I am using TheBloke's AWQ version of this model and have seen that the configuration_llama.py rope_scaling has changed to None. I tried rope_scaling as None and "yarn" already but it still gives me that error. Any ideas on fixes?
hi, i'm sorry, i'm not sure. i only ever use GGUF as i'm on a mac. if you want you can contact me on discord "mfunlimited" and i can add you to TheBloke's discord (if you're not there already). there's a lot of people smarter than me there that would know how to fix it
QuantumState745837
changed discussion status to
closed