Transformers
llamafile
mixtral

Commit History

Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q4_0
728a067
verified

jartine commited on

Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q8_0
39e66f6
verified

jartine commited on

Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q5_K_M
824195f
verified

jartine commited on

Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q4_1
18d5826
verified

jartine commited on

Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q4_0
8f950e1
verified

jartine commited on

Quantize mixtral-8x7b-instruct-v0.1 with llamafile-0.7 Q8_0
ad4453f
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q8_0.gguf with llamafile v0.6.2
ae89c80
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q6_K.gguf with llamafile v0.6.2
c2dfafc
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf with llamafile v0.6.2
c73c6e5
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q5_0.gguf with llamafile v0.6.2
e62fadc
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf with llamafile v0.6.2
11f7dd5
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q4_0.gguf with llamafile v0.6.2
06455c1
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q3_K_M.gguf with llamafile v0.6.2
46397a1
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q2_K.gguf with llamafile v0.6.2
448da83
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q6_K.gguf with llamafile v0.6.1
ea1b3e5
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf with llamafile v0.6.1
83ba352
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q5_0.gguf with llamafile v0.6.1
1c2f9f4
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf with llamafile v0.6.1
2403686
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q4_0.gguf with llamafile v0.6.1
b6d908a
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q3_K_M.gguf with llamafile v0.6.1
46fa747
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q2_K.gguf with llamafile v0.6.1
b6eabb2
verified

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q8_0.gguf with llamafile v0.6.0
7385d4d

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q6_K.gguf with llamafile v0.6.0
dabc1b0

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf with llamafile v0.6.0
d664a38

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q5_0.gguf with llamafile v0.6.0
fef6a6c

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf with llamafile v0.6.0
e063edf

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q4_0.gguf with llamafile v0.6.0
6e93a1f

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q3_K_M.gguf with llamafile v0.6.0
4dcaf35

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q2_K.gguf with llamafile v0.6.0
a9a0c09

jartine commited on

Wrap mixtral-8x7b-instruct-v0.1.Q2_K.gguf with llamafile v0.6.0
f0494e2

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q8_0.gguf to repo using llamafile a6d041a3b59582d2a43c5837cf170cccaa511180
a0adfed

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q6_K.gguf to repo using llamafile a6d041a3b59582d2a43c5837cf170cccaa511180
2b888b3

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf to repo using llamafile a6d041a3b59582d2a43c5837cf170cccaa511180
f65067d

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q5_0.gguf to repo using llamafile a6d041a3b59582d2a43c5837cf170cccaa511180
40aaea5

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf to repo using llamafile a6d041a3b59582d2a43c5837cf170cccaa511180
a63195c

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q4_0.gguf to repo using llamafile a6d041a3b59582d2a43c5837cf170cccaa511180
0e07bad

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q3_K_M.gguf to repo using llamafile a6d041a3b59582d2a43c5837cf170cccaa511180
4845374

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q2_K.gguf to repo using llamafile a6d041a3b59582d2a43c5837cf170cccaa511180
cdaf4ba

jartine commited on

Update README.md
4a07f2b

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q8_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
437f800

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q6_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
40eb574

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
cec6a20

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q5_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
f7552a9

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q4_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
7638a3a

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q4_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
efb2ef6

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q3_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
36dcd62

jartine commited on

Add mixtral-8x7b-instruct-v0.1.Q2_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a
09c84bb

jartine commited on

Add README.md to repo
bdf9242

jartine commited on

Add config.json to repo
c8bbb2e

jartine commited on

Add README.md to repo
922792b

jartine commited on