kaitchup
/

Yi-6B-bnb-4bit

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

bnjmnmarie commited on Mar 21, 2024

Commit

7ed3b25

·

verified ·

1 Parent(s): e99bb38

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -10,7 +10,7 @@ tags:
 ## Model Details
-This is 01-ai/Yi-6B quantized with AutoGPTQ in 4-bit.
 - **Developed by:** [The Kaitchup](https://kaitchup.substack.com/)
 - **Language(s) (NLP):** English

 ## Model Details
+This is 01-ai/Yi-6B quantized and serialized with bitsandbytes in 4-bit.
 - **Developed by:** [The Kaitchup](https://kaitchup.substack.com/)
 - **Language(s) (NLP):** English