About

Thanks Redmond.AI for GPU Sponsor!

How to use

If you are unsure how to use GGUF files, look at the TheBloke READMEs for more details, including on how to concatenate multi-part files.

GGUF

Model size

1.78B params

Architecture

qwen2

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Base model

Qwen/Qwen2-1.5B

Finetuned

Quantized

(1)

this model