| license: apache-2.0 | |
| license_link: https://huggingface.co/Qwen/QWQ-32B/blob/main/LICENSE | |
| language: | |
| - en | |
| pipeline_tag: text-generation | |
| base_model: Qwen/QwQ-32B | |
| tags: | |
| - chat | |
| - exl2 | |
| library_name: transformers | |
| # QwQ-32B - EXL2 8.0bpw | |
| This is a 8.0bpw EXL2 quant of [Qwen/QwQ-32B](https://huggingface.co/Qwen/QwQ-32B) | |
| Details about the model can be found at the above model page. | |
| ## Perplexity Scoring | |
| Below are the perplexity scores for the EXL2 models. A lower score is better. | |
| | Quant Level | Perplexity Score | | |
| |-------------|------------------| | |
| | 8.0 | 6.4393 | | |
| | 7.0 | 6.4452 | | |
| | 6.0 | 6.4693 | | |
| | 5.0 | 6.4732 | | |
| | 4.5 | 6.5417 | | |
| | 4.0 | 6.6190 | | |