Hugging Face's logo

kaitchup
/
Qwen2.5-7B-Instruct-AutoRound-GPTQ-asym-4bit

Text Generation
Transformers
Safetensors
English
qwen2
auto-gptq
AutoRound
conversational
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
bnjmnmarie commited on
Commit
7a41f03
•
1 Parent(s): 202e1f5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -28,7 +28,7 @@ output_dir = "./tmp_autoround"
28
  autoround.save_quantized(output_dir, format='auto_gptq', inplace=True)
29
  ```
30
 
31
- Evaluation results:
32
 
33
  ![arc_challenge, musr, gpqa, mmlu_pro, mmlu….png](https://cdn-uploads.huggingface.co/production/uploads/64b93e6bd6c468ac7536607e/ExiQHtJf981JcUsHcbZW9.png)
34
 
 
28
  autoround.save_quantized(output_dir, format='auto_gptq', inplace=True)
29
  ```
30
 
31
+ Evaluation results (zero-shot evaluation with lm_eval):
32
 
33
  ![arc_challenge, musr, gpqa, mmlu_pro, mmlu….png](https://cdn-uploads.huggingface.co/production/uploads/64b93e6bd6c468ac7536607e/ExiQHtJf981JcUsHcbZW9.png)
34