Hugging Face's logo

Felladrin
/
gguf-OLMoE-1B-7B-0924-Instruct

GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community
Felladrin commited on
Commit
6772d35
•
1 Parent(s): dd7b78a

Upload folder using huggingface_hub

Browse files
Files changed (9) hide show
  1. .gitattributes +7 -0
  2. OLMoE-1B-7B-0924-Instruct.IQ4_XS.gguf +3 -0
  3. OLMoE-1B-7B-0924-Instruct.Q2_K.gguf +3 -0
  4. OLMoE-1B-7B-0924-Instruct.Q3_K.gguf +3 -0
  5. OLMoE-1B-7B-0924-Instruct.Q4_K.gguf +3 -0
  6. OLMoE-1B-7B-0924-Instruct.Q5_K.gguf +3 -0
  7. OLMoE-1B-7B-0924-Instruct.Q6_K.gguf +3 -0
  8. OLMoE-1B-7B-0924-Instruct.Q8_0.gguf +3 -0
  9. README.md +5 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ OLMoE-1B-7B-0924-Instruct.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
37
+ OLMoE-1B-7B-0924-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ OLMoE-1B-7B-0924-Instruct.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
39
+ OLMoE-1B-7B-0924-Instruct.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
40
+ OLMoE-1B-7B-0924-Instruct.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
41
+ OLMoE-1B-7B-0924-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
42
+ OLMoE-1B-7B-0924-Instruct.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
OLMoE-1B-7B-0924-Instruct.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7cb292e3c731a0d9a2e91d193bb133a63498596d297b4ce6a67f4550bcd8cc82
3
+ size 3794784864
OLMoE-1B-7B-0924-Instruct.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44697703f4c204c9ee85a3d6669bff8c06f17870ca8612d6dfa237239f6fcc95
3
+ size 2663371360
OLMoE-1B-7B-0924-Instruct.Q3_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:280d893174d9989b85d52ff32f23e6d4faeecac1e439e3fb69a74025571a413a
3
+ size 3434074720
OLMoE-1B-7B-0924-Instruct.Q4_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7b73ac8a6c2fe2f6de98df736f5f9efcd69455e1068ca70be511b1b5843090b
3
+ size 4289974880
OLMoE-1B-7B-0924-Instruct.Q5_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59806e34141a874257be9363a715bc92796b7e066f37d4338947137982464f5e
3
+ size 4990423648
OLMoE-1B-7B-0924-Instruct.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0fbbab7dd90bdaacdfe046385e74b07fcc31dc285da4369e358be09d88d5bc06
3
+ size 5734650464
OLMoE-1B-7B-0924-Instruct.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38b5732744e28995c8c6371d82bf446f5ac4b1a17a0cf6c5ef283b03846a631e
3
+ size 7359943264
README.md ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ ---
2
+ base_model: allenai/OLMoE-1B-7B-0924-Instruct
3
+ ---
4
+
5
+ GGUF version of [allenai/OLMoE-1B-7B-0924-Instruct](https://huggingface.co/allenai/OLMoE-1B-7B-0924-Instruct).