Quantize Mistral using llama.cpp PR #6412

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 F16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 BF16

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q3_K

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q5_1

Quantize mistral-7b-instruct-v0.2 with llamafile-0.7 Q4_1

Add mistral-7b-instruct-v0.2.Q8_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add mistral-7b-instruct-v0.2.Q6_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add mistral-7b-instruct-v0.2.Q5_K_S.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add mistral-7b-instruct-v0.2.Q5_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add mistral-7b-instruct-v0.2.Q5_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add mistral-7b-instruct-v0.2.Q4_K_S.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add mistral-7b-instruct-v0.2.Q4_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add mistral-7b-instruct-v0.2.Q4_0.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add mistral-7b-instruct-v0.2.Q3_K_S.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add mistral-7b-instruct-v0.2.Q3_K_M.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add mistral-7b-instruct-v0.2.Q3_K_L.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add mistral-7b-instruct-v0.2.Q2_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add .gitattributes to repo

Add mistral-7b-instruct-v0.2.Q3_K_L.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add mistral-7b-instruct-v0.2.Q2_K.gguf to repo using llamafile 8f73d39cf3a767897b8ade6dda45e5744c62356a

Add .gitattributes to repo

Add mistral-7b-instruct-v0.2.Q8_0.gguf to repo using llamafile 3119f09e3d441b873a9949ead16d6ca70a06512f

Add mistral-7b-instruct-v0.2.Q6_K.gguf to repo using llamafile 3119f09e3d441b873a9949ead16d6ca70a06512f

Add mistral-7b-instruct-v0.2.Q5_K_S.gguf to repo using llamafile 3119f09e3d441b873a9949ead16d6ca70a06512f

Add mistral-7b-instruct-v0.2.Q5_K_M.gguf to repo using llamafile 3119f09e3d441b873a9949ead16d6ca70a06512f

Add mistral-7b-instruct-v0.2.Q5_0.gguf to repo using llamafile 3119f09e3d441b873a9949ead16d6ca70a06512f

Add mistral-7b-instruct-v0.2.Q4_K_S.gguf to repo using llamafile 3119f09e3d441b873a9949ead16d6ca70a06512f

Add mistral-7b-instruct-v0.2.Q4_K_M.gguf to repo using llamafile 3119f09e3d441b873a9949ead16d6ca70a06512f

Add mistral-7b-instruct-v0.2.Q4_0.gguf to repo using llamafile 3119f09e3d441b873a9949ead16d6ca70a06512f

Add mistral-7b-instruct-v0.2.Q3_K_S.gguf to repo using llamafile 3119f09e3d441b873a9949ead16d6ca70a06512f

Add mistral-7b-instruct-v0.2.Q3_K_M.gguf to repo using llamafile 3119f09e3d441b873a9949ead16d6ca70a06512f

Add mistral-7b-instruct-v0.2.Q3_K_L.gguf to repo using llamafile 3119f09e3d441b873a9949ead16d6ca70a06512f

Add mistral-7b-instruct-v0.2.Q2_K.gguf to repo using llamafile 3119f09e3d441b873a9949ead16d6ca70a06512f

Add .gitattributes to repo

initial commit