| license: other | |
| license_name: yi-34b | |
| license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE | |
| tags: | |
| - merge | |
| - roleplay | |
| - not-for-all-audiences | |
| # Some GGUF quants of ParasiticRogue/Merged-Vicuna-RP-Stew-34B-GGUF | |
| See original model card for information. I generally don't go lower than 4-bit myself, but if you REALLY need one and can't get one any other way, let me know. | |
| 19G Merged-Vicuna-RP-Stew-34B.IQ4_NL.gguf | |
| 20G Merged-Vicuna-RP-Stew-34B.Q4_K_M.gguf | |
| 23G Merged-Vicuna-RP-Stew-34B.Q5_K_M.gguf | |
| 27G Merged-Vicuna-RP-Stew-34B.Q6_K.gguf | |
| 35G Merged-Vicuna-RP-Stew-34B.Q8_0.gguf | |