YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
GPTQ quantisation of https://huggingface.co/ai-forever/ruGPT-3.5-13B
Small perplexity test: before quantization - 'mean_perplexity': 10.241 after quantization - 'mean_perplexity': 10.379
Data - RussianSuperGlue > DaNetQA/train.jsonl['passage']
As this is a hastily thrown together quant with no prior experience in quants, use https://huggingface.co/TheBloke version if he releases a quant for this model.
- Downloads last month
- 153
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.