Hugging Face's logo

DanielClough
/
Candle_OpenHermes-2.5-Mistral-7B

GGUF
Model card Files Community
Ubuntu commited on
Commit
50d1b7d
•
1 Parent(s): 020b351

init

Browse files
Files changed (16) hide show
  1. .gitattributes +1 -0
  2. Candle_OpenHermes-2.5-Mistral-7B_f16.gguf +3 -0
  3. Candle_OpenHermes-2.5-Mistral-7B_q2k.gguf +3 -0
  4. Candle_OpenHermes-2.5-Mistral-7B_q3k.gguf +3 -0
  5. Candle_OpenHermes-2.5-Mistral-7B_q4_0.gguf +3 -0
  6. Candle_OpenHermes-2.5-Mistral-7B_q4_1.gguf +3 -0
  7. Candle_OpenHermes-2.5-Mistral-7B_q4k.gguf +3 -0
  8. Candle_OpenHermes-2.5-Mistral-7B_q5_0.gguf +3 -0
  9. Candle_OpenHermes-2.5-Mistral-7B_q5_1.gguf +3 -0
  10. Candle_OpenHermes-2.5-Mistral-7B_q5k.gguf +3 -0
  11. Candle_OpenHermes-2.5-Mistral-7B_q6k.gguf +3 -0
  12. Candle_OpenHermes-2.5-Mistral-7B_q8_0.gguf +3 -0
  13. Candle_OpenHermes-2.5-Mistral-7B_q8_1.gguf +3 -0
  14. Candle_OpenHermes-2.5-Mistral-7B_q8k.gguf +3 -0
  15. README.md +9 -0
  16. tokenizer.json +0 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
Candle_OpenHermes-2.5-Mistral-7B_f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fda5d292b8db1bc6f5a344fe78aec5698ec0794f7706b3928e03e2885375bfbb
3
+ size 14484051680
Candle_OpenHermes-2.5-Mistral-7B_q2k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8cba1f42c81b9a526a7bf23383356c84b0db05bc7922ec1712869810bc1a341c
3
+ size 2377198560
Candle_OpenHermes-2.5-Mistral-7B_q3k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abc95ef03b75173c7976d81f42bd6b7e25aa9d98eff2bab55113cbedfdb75cd5
3
+ size 3112661600
Candle_OpenHermes-2.5-Mistral-7B_q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34b158003c265f7028e4912d60fa13129d69eddc04fa9c3a7c3f248ca4d21eb6
3
+ size 4074420960
Candle_OpenHermes-2.5-Mistral-7B_q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3ef5ada0c4dbdfe22c5f05846af81b836ae3a8be5f0e367b1ea5987c4b026b0a
3
+ size 4527013600
Candle_OpenHermes-2.5-Mistral-7B_q4k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0a484c86b2ace01337a3b932876efda3bf4ba91a369ca7e16ff1b493e5a349d
3
+ size 4074420960
Candle_OpenHermes-2.5-Mistral-7B_q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:33227c61ad1556396b872ad68997f9aa5a1a06b3cb092f7a2f47c67c8cd03ad8
3
+ size 4979606240
Candle_OpenHermes-2.5-Mistral-7B_q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5614cc685ec572dd64af2c2dd6102b42c371cc81c2ae632e09929055995b9e9d
3
+ size 5432198880
Candle_OpenHermes-2.5-Mistral-7B_q5k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34995a59f3e2b3b2496ed940858792ea4978184fc5b8f6fe95119930a5c6999c
3
+ size 4979606240
Candle_OpenHermes-2.5-Mistral-7B_q6k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd20886a34179d353e5d7ecb05d548ec48896a83c7e3a7bc7d65c9c6efa2eb85
3
+ size 5941365600
Candle_OpenHermes-2.5-Mistral-7B_q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44e1d4a05645e9df2c94f8c3e89fb771ae303495a8193d6bd815cde5dee36bf3
3
+ size 7695162080
Candle_OpenHermes-2.5-Mistral-7B_q8_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f3ab615e66eb6e2c8280051a293f28b5e704b5d6d9848a2ae34e1e0dcf76e17
3
+ size 8147754720
Candle_OpenHermes-2.5-Mistral-7B_q8k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c50e2b2409efd546aa39d2193855e00e9ebe7beeb76284b315b9c4fd2185050a
3
+ size 8260902880
README.md ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ ---
4
+
5
+ Here we have `.gguf` and `.safetensors` of `teknium/OpenHermes-2.5-Mistral-7B` for use with `Huggingface/Candle`.
6
+
7
+ You can try the models with [Candle Chat](https://github.com/danielclough/candle_chat), or make similar models with [Candle Tensor Tools](https://github.com/danielclough/Candle_Tensor-Tools).
8
+
9
+ Refer to the main [model card](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) for more details.
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff