casperhansen

/

mistral-nemo-instruct-2407-awq

like 7

Looking through the code it looks like it's looking for a specific config file name but now it's merged into config.json

https://github.com/vllm-project/vllm/blob/bb2fc08072db2d96e547407b4301fb6ba141d9d6/vllm/model_executor/layers/quantization/awq.py#L54