GGUF model commit (made with llama.cpp commit 947f64f)

2086168 8 months ago

.gitattributes

2.22 kB

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
config.json

32 Bytes

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
marx-3b-v3.Q2_K.gguf

1.2 GB
LFS

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
marx-3b-v3.Q3_K_L.gguf

1.51 GB
LFS

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
marx-3b-v3.Q3_K_M.gguf

1.39 GB
LFS

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
marx-3b-v3.Q3_K_S.gguf

1.25 GB
LFS

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
marx-3b-v3.Q4_0.gguf

1.61 GB
LFS

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
marx-3b-v3.Q4_K_M.gguf

1.71 GB
LFS

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
marx-3b-v3.Q4_K_S.gguf

1.62 GB
LFS

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
marx-3b-v3.Q5_0.gguf

1.94 GB
LFS

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
marx-3b-v3.Q5_K_M.gguf

1.99 GB
LFS

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
marx-3b-v3.Q5_K_S.gguf

1.94 GB
LFS

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
marx-3b-v3.Q6_K.gguf

2.3 GB
LFS

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago
marx-3b-v3.Q8_0.gguf

2.97 GB
LFS

GGUF model commit (made with llama.cpp commit 947f64f) 8 months ago