|
--- |
|
license: other |
|
license_name: yi-34b |
|
license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE |
|
tags: |
|
- merge |
|
- roleplay |
|
- not-for-all-audiences |
|
--- |
|
|
|
# Some GGUF quants of ParasiticRogue/Merged-Vicuna-RP-Stew-34B-GGUF |
|
|
|
See original model card for information. I generally don't go lower than 4-bit myself, but if you REALLY need one and can't get one any other way, let me know. |
|
|
|
19G Merged-Vicuna-RP-Stew-34B.IQ4_NL.gguf |
|
20G Merged-Vicuna-RP-Stew-34B.Q4_K_M.gguf |
|
23G Merged-Vicuna-RP-Stew-34B.Q5_K_M.gguf |
|
27G Merged-Vicuna-RP-Stew-34B.Q6_K.gguf |
|
35G Merged-Vicuna-RP-Stew-34B.Q8_0.gguf |
|
|
