bitnet-5B-v1 / README.md
Ttimofeyka's picture
Update README.md
a23eb55 verified
metadata
license: mit
base_model:
  - 1bitLLM/bitnet_b1_58-3B
library_name: transformers
tags:
  - mergekit
  - merge
  - bitnet

bitnet-5B-v1

I redesigned mergekit so that I could merge the bitnet 3B model (unlike version v0, where I did merge via PyTorch).

In theory, this is compatible with quantization via llama.cpp , but tests are needed.