README.md

Synthia-13B EXL2

Weights of Synthia-13B converted to EXL2 format.

Each separate quant is in a different branch, like in The Bloke's GPTQ repos.

export BRANCH=6_0-bpw-h6
git clone --single-branch --branch ${BRANCH} https://huggingface.co/latimar/Synthia-13B-exl2

There are the following branches:

4_625-bpw-h6
6_0-bpw-h6