Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 BF16 fcf33ff verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 BF16 090b668 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 F16 61666cf verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 F16 633b230 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q8_0 c2a1740 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q6_K 1293908 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q4_0 8f8d047 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q4_K_M 797f590 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q3_K_M c54f4fb verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q3_K_S f7a0637 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q2_K b4cac29 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.4 Q5_K_M d026ec7 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 BF16 3010772 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 BF16 5ee9445 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 F16 8c21d0b verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 F16 9f10d3e verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q8_0 28ed3f4 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q6_K b321c10 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q4_0 0191dbf verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q4_K_M 9b394eb verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q3_K_M 36cda63 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q3_K_S 5f8e853 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q2_K f10030f verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8.2 Q5_K_M cfaef25 verified jartine commited on May 10
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8 Q3_K_M 037ef6b verified jartine commited on Apr 25
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8 Q4_K_M a3f90ca verified jartine commited on Apr 25
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8 Q2_K 5011535 verified jartine commited on Apr 25
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8 Q4_0 08e9ed0 verified jartine commited on Apr 25
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8 Q8_0 5d66eb9 verified jartine commited on Apr 25
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.8 Q5_K_M 8e1afb3 verified jartine commited on Apr 25
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7.3 Q4_1 ad02117 verified jartine commited on Apr 20
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7.3 Q4_0 9839b2c verified jartine commited on Apr 20
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7.3 Q8_0 a148472 verified jartine commited on Apr 20
Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7.3 Q5_K_M e1327cb verified jartine commited on Apr 20