Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q2_K ed4328d verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_1 74db578 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_0 ca51107 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q4_1 5ad0e36 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q4_0 fbb51d1 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q6_K 1479989 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 BF16 fc963e3 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 F16 047b115 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q8_0 4115c4d verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.4 Q5_K_M 3c579ef verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.3 Q5_K_M 63ccd8a verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.2 F16 87b0eae verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.2 Q8_0 a82dab0 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8.2 Q5_K_M bbe8f2f verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q8_0 19c6940 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_M 79f4750 verified jartine commited on May 10
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_S ad8e3b6 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_K_M c922489 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_K_S 3ca8321 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_L 02d32ed verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_M 4fa4b27 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q3_K_S 006ee39 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q2_K 276646b verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_1 3d77221 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_0 2af1104 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_1 8ac62df verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q6_K 4e7c685 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 BF16 8e26aea verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q8_0 3839d84 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q5_K_M c5fa3a5 verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.8 Q4_0 556284a verified jartine commited on Apr 24
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q6_K 72d92cc verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K_S 09f2ae9 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_K 1a09948 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K_M 2bcc43a verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K_S 8c9a271 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_K c255134 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_L 54179e5 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_M 9854006 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K_S 86ddc4e verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q3_K 57412fc verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q2_K 0c51908 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_1 7fdbcb3 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q5_0 f51d687 verified jartine commited on Apr 20
Quantize mistral-7b-instruct-v0.2 with llamafile-0.7.3 Q4_1 2f4ad9d verified jartine commited on Apr 20