mradermacher
/

AstraLM-16B-MoE-GGUF

Mixture of Experts

NousResearch/Llama-2-7b-chat-hf

mistralai/Mistral-7B-Instruct-v0.2

codellama/CodeLlama-7b-Instruct-hf

Inference Endpoints

Model card Files Files and versions Community

mradermacher commited on Apr 2

Commit

e26003c

•

1 Parent(s): f0bf35b

uploaded from nethype/back

Files changed (2) hide show

.gitattributes +1 -0
AstraLM-16B-MoE.IQ3_S.gguf +3 -0

.gitattributes CHANGED Viewed

@@ -36,3 +36,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 AstraLM-16B-MoE.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 AstraLM-16B-MoE.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 AstraLM-16B-MoE.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

 AstraLM-16B-MoE.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
 AstraLM-16B-MoE.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
 AstraLM-16B-MoE.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+AstraLM-16B-MoE.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

AstraLM-16B-MoE.IQ3_S.gguf ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9b93e893fee853d7223bffef50776e25efc5d4037e6c23e97471e6b1c74fc279
+size 7057641856