Add fp8 and GGUF if possible for us poor hw guys
#1
by
ryg81
- opened
Add fp8 and GGUF if possible for us poor hw guys
https://huggingface.co/Clybius/Flex.1-alpha-Q4_K_M-GGUF
I tested this and it works quite well - am positively surprised actually :)
adding Fp8 in safetensors format https://huggingface.co/gmonsoon/Flex.1-alpha-Fp8