TheDrummer
/

Gemmasutra-Pro-27B-v1-GGUF

Inference Endpoints

Model card Files Files and versions Community

TheDrummer commited on Aug 2

Commit

0b56efe

•

1 Parent(s): b5a0fc9

Update README.md

Files changed (1) hide show

README.md +1 -2

README.md CHANGED Viewed

@@ -24,9 +24,8 @@ license_link: LICENSE
 - Original: https://huggingface.co/TheDrummer/Gemmasutra-Pro-27B-v1
 - GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Pro-27B-v1-GGUF
-  - Q5KM + 8K Context works on 24GB!
 - GGUF iMatrix (Better PPL): https://huggingface.co/MarsupialAI/Gemmasutra-Pro-27B-v1_iMatrix_GGUF
-- EXL2: WIP
 ## Usage

 - Original: https://huggingface.co/TheDrummer/Gemmasutra-Pro-27B-v1
 - GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Pro-27B-v1-GGUF
 - GGUF iMatrix (Better PPL): https://huggingface.co/MarsupialAI/Gemmasutra-Pro-27B-v1_iMatrix_GGUF
+- EXL2: https://huggingface.co/MarsupialAI/Gemmasutra-Pro-27B-v1_EXL2
 ## Usage