Lewdiculous
/

Aura_v2_7B-GGUF-IQ-Imatrix

Model card Files Files and versions Community

Lewdiculous commited on Apr 16, 2024

Commit

661514e

•

1 Parent(s): ca10bf1

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -54,7 +54,7 @@ In this repository you can find **GGUF-IQ-Imatrix** quants for [ResplendentAI/Au
 ```python
     quantization_options = [
         "IQ3_M", "IQ3_XXS",
-        "Q4_K_M", "Q4_K_S", "IQ4_XS", "IQ4_NL",
         "Q5_K_M", "Q5_K_S",
         "Q6_K",
         "Q8_0"

 ```python
     quantization_options = [
         "IQ3_M", "IQ3_XXS",
+        "Q4_K_M", "Q4_K_S", "IQ4_NL", "IQ4_XS",
         "Q5_K_M", "Q5_K_S",
         "Q6_K",
         "Q8_0"