Remek's picture
Update README.md
332f90a verified
|
raw
history blame
1.35 kB
metadata
language:
  - pl
license: apache-2.0
library_name: transformers
tags:
  - finetuned
  - gguf
inference: false
pipeline_tag: text-generation

Bielik-11B-v2.2-Instruct-HQQ-4bit-128gs

This repo contains HQQ (4-bit, 128 group size) format model files for SpeakLeash's Bielik-11B-v.2.2-Instruct.

DISCLAIMER: Be aware that quantised models show reduced response quality and possible hallucinations!

Simple Colab notebook for testing: https://colab.research.google.com/drive/1Al9glPVCuOXbtDsks8cMcuzkuu8YDzpg?usp=sharing

Model description:

Contact Us

If you have any questions or suggestions, please use the discussion tab. If you want to contact us directly, join our Discord SpeakLeash.