Default to eager attention
pinned
2
#1 opened 2 months ago
by
lysandre
![](https://cdn-avatars.huggingface.co/v1/production/uploads/5e3aec01f55e2b62848a5217/PMKS0NNB4MJQlTSFzh918.jpeg)
Can anyone provider gptq-4bit or awq version for this model?
#4 opened 4 days ago
by
esoterikx
vllm load model error
#3 opened about 2 months ago
by
Dharma0818
How much GPU memory is required to run this model?
#2 opened about 2 months ago
by
Dharma0818