TheDrummer
/

Gemmasutra-Pro-27B-v1-GGUF

Inference Endpoints

Model card Files Files and versions Community

TheDrummer commited on Jul 28, 2024

Commit

b5a0fc9

•

1 Parent(s): a102f37

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -25,7 +25,7 @@ license_link: LICENSE
 - Original: https://huggingface.co/TheDrummer/Gemmasutra-Pro-27B-v1
 - GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Pro-27B-v1-GGUF
   - Q5KM + 8K Context works on 24GB!
-- GGUF iMatrix (Better PPL): WIP
 - EXL2: WIP
 ## Usage

 - Original: https://huggingface.co/TheDrummer/Gemmasutra-Pro-27B-v1
 - GGUF: https://huggingface.co/TheDrummer/Gemmasutra-Pro-27B-v1-GGUF
   - Q5KM + 8K Context works on 24GB!
+- GGUF iMatrix (Better PPL): https://huggingface.co/MarsupialAI/Gemmasutra-Pro-27B-v1_iMatrix_GGUF
 - EXL2: WIP
 ## Usage