Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_K_S c25adf8 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q4_K_M 6ea5cfd verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q4_K_S 772aa92 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q3_K_L 900f45e verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q3_K_M e6d0ef0 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q3_K_S 75b5b5b verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q2_K ed4328d verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_1 74db578 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_0 ca51107 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q4_1 5ad0e36 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q4_0 fbb51d1 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q6_K 1479989 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 BF16 fc963e3 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 F16 047b115 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q8_0 4115c4d verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_K_M 3c579ef verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.3 Q5_K_M 63ccd8a verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.2 F16 87b0eae verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.2 Q8_0 a82dab0 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.2 Q5_K_M bbe8f2f verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q8_0 19c6940 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_M 79f4750 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_S ad8e3b6 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_K_M c922489 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_K_S 3ca8321 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_L 02d32ed verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_M 4fa4b27 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_S 006ee39 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q2_K 276646b verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_1 3d77221 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_0 2af1104 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_1 8ac62df verified jartine commited on Apr 24