Hugging Face's logo

speakleash
/
Bielik-11B-v2.2-Instruct-HQQ-4bit-128gs

Text Generation
Transformers
GGUF
Polish
mistral
finetuned
conversational
Model card Files Community
Bielik-11B-v2.2-Instruct-HQQ-4bit-128gs / README.md
Remek's picture
Remek
Update README.md
e5a1913 verified
preview code
|
raw
history blame
1.6 kB
metadata
language:
  - pl
license: apache-2.0
library_name: transformers
tags:
  - finetuned
  - gguf
inference: false
pipeline_tag: text-generation

Bielik-11B-v2.2-Instruct-HQQ-4bit-128gs

This repo contains HQQ (4-bit, 128 group size) format model files for SpeakLeash's Bielik-11B-v.2.2-Instruct.

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

Simple Colab notebook for testing: https://colab.research.google.com/drive/1Al9glPVCuOXbtDsks8cMcuzkuu8YDzpg?usp=sharing

Model description:

Responsible for model quantization

  • Remigiusz KinasSpeakLeash - team leadership, conceptualizing, calibration data preparation, process creation and quantized model delivery.

Contact Us

If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.