Hugging Face's logo

DrNicefellow
/
ChatAllInOne-Yi-34B-200K-V1-6.0bpw-exl2

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
Model card Files Community
1
DrNicefellow commited on
Commit
e32a14f
•
1 Parent(s): fec0852

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -3,3 +3,5 @@ license: other
3
  license_name: yi-license
4
  license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
5
  ---
 
 
 
3
  license_name: yi-license
4
  license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
5
  ---
6
+
7
+ This is a 6.0bpw quantized version of [DrNicefellow/ChatAllInOne-Yi-34B-200K-V1](https://huggingface.co/DrNicefellow/ChatAllInOne-Yi-34B-200K-V1) made with [exllamav2](https://github.com/turboderp/exllamav2).