Mozilla
/

Mixtral-8x7B-Instruct-v0.1-llamafile

text-generation-inference

Model card Files Files and versions Community

Mixtral-8x7B-Instruct-v0.1-llamafile

Commit History

Quantize BF16 with llamafile-0.8.9

dde1baf
verified

jartine commited on 19 days ago

Quantize F16 with llamafile-0.8.9

989e135
verified

jartine commited on 19 days ago

Quantize F16 with llamafile-0.8.9

890f761
verified

jartine commited on 19 days ago

Quantize Q8_0 with llamafile-0.8.9

53420f6
verified

jartine commited on 19 days ago

Quantize Q6_K with llamafile-0.8.9

69c59d0
verified

jartine commited on 19 days ago

Quantize Q4_0 with llamafile-0.8.9

c3b3bf6
verified

jartine commited on 19 days ago

Quantize Q4_K_M with llamafile-0.8.9

3e97dd4
verified

jartine commited on 19 days ago

Quantize Q3_K_M with llamafile-0.8.9

d92dbb2
verified

jartine commited on 19 days ago

Quantize Q3_K_S with llamafile-0.8.9

e4b2f3b
verified

jartine commited on 19 days ago

Quantize Q2_K with llamafile-0.8.9

41ca69d
verified

jartine commited on 19 days ago

Quantize Q5_K_M with llamafile-0.8.9

942a678
verified

jartine commited on 19 days ago

Quantize Q5_K_S with llamafile-0.8.9

133d976
verified

jartine commited on 19 days ago

Quantize BF16 with llamafile-0.8.8

cf55162
verified

jartine commited on 21 days ago

Quantize BF16 with llamafile-0.8.8

ff8dc32
verified

jartine commited on 21 days ago

Quantize F16 with llamafile-0.8.8

afaf016
verified

jartine commited on 21 days ago

Quantize F16 with llamafile-0.8.8

5522f02
verified

jartine commited on 21 days ago

Quantize Q8_0 with llamafile-0.8.8

ce73fef
verified

jartine commited on 21 days ago

Quantize Q6_K with llamafile-0.8.8

3f749cc
verified

jartine commited on 21 days ago

Quantize Q4_0 with llamafile-0.8.8

ef623dc
verified

jartine commited on 21 days ago

Quantize Q4_K_M with llamafile-0.8.8

4c69502
verified

jartine commited on 21 days ago

Quantize Q3_K_M with llamafile-0.8.8

4cd819d
verified

jartine commited on 21 days ago

Quantize Q3_K_S with llamafile-0.8.8

9d7ebff
verified

jartine commited on 21 days ago

Quantize Q2_K with llamafile-0.8.8

0f47c13
verified

jartine commited on 21 days ago

Quantize Q5_K_M with llamafile-0.8.8

9838c4e
verified

jartine commited on 21 days ago

Quantize Q5_K_S with llamafile-0.8.8

af9b57c
verified

jartine commited on 21 days ago

Quantize BF16 with llamafile-0.8.7

c0e5318
verified

jartine commited on 26 days ago

Quantize BF16 with llamafile-0.8.7

d29cbbb
verified

jartine commited on 26 days ago

Quantize F16 with llamafile-0.8.7

d81ad17
verified

jartine commited on 26 days ago

Quantize F16 with llamafile-0.8.7

3e5992f
verified

jartine commited on 26 days ago

Quantize Q8_0 with llamafile-0.8.7

de058ca
verified

jartine commited on 26 days ago

Quantize Q6_K with llamafile-0.8.7

fa393ab
verified

jartine commited on 26 days ago

Quantize Q4_0 with llamafile-0.8.7

b581c66
verified

jartine commited on 26 days ago

Quantize Q4_K_M with llamafile-0.8.7

21c35bf
verified

jartine commited on 26 days ago

Quantize Q3_K_M with llamafile-0.8.7

c906004
verified

jartine commited on 26 days ago

Quantize Q3_K_S with llamafile-0.8.7

bddcf77
verified

jartine commited on 26 days ago

Quantize Q2_K with llamafile-0.8.7

76ec0f3
verified

jartine commited on 26 days ago

Quantize Q5_K_M with llamafile-0.8.7

58bdfac
verified

jartine commited on 26 days ago

Quantize Q5_K_S with llamafile-0.8.7

60b6235
verified

jartine commited on 26 days ago

Quantize BF16 with llamafile-0.8.5

02b3fce
verified

jartine commited on May 25

Quantize BF16 with llamafile-0.8.5

c8a9fbc
verified

jartine commited on May 25

Quantize F16 with llamafile-0.8.5

30547aa
verified

jartine commited on May 25

Quantize F16 with llamafile-0.8.5

1b8abe4
verified

jartine commited on May 25

Quantize Q8_0 with llamafile-0.8.5

15b5360
verified

jartine commited on May 25

Quantize Q6_K with llamafile-0.8.5

b5c1441
verified

jartine commited on May 25

Quantize Q4_0 with llamafile-0.8.5

46d7218
verified

jartine commited on May 25

Quantize Q4_K_M with llamafile-0.8.5

d67d18e
verified

jartine commited on May 25

Quantize Q3_K_M with llamafile-0.8.5

88e7243
verified

jartine commited on May 25

Quantize Q3_K_S with llamafile-0.8.5

e35da0f
verified

jartine commited on May 25

Quantize Q2_K with llamafile-0.8.5

eff7dc3
verified

jartine commited on May 25

Quantize Q5_K_M with llamafile-0.8.5

91f4f1b
verified

jartine commited on May 25