Hugging Face's logo

XelotX
/
CausalLM-35b-beta-long-XelotX-Quants

Text Generation
GGUF
Inference Endpoints
conversational
Model card Files Community
XelotX 0-hero commited on
Commit
a66ea8c
•
0 Parent(s):

Duplicate from QuantFactory/CausalLM-35b-beta-long-GGUF

Browse files

Co-authored-by: Ram <0-hero@users.noreply.huggingface.co>

Files changed (16) hide show
  1. .gitattributes +49 -0
  2. CausalLM-35b-beta-long.Q2_K.gguf +3 -0
  3. CausalLM-35b-beta-long.Q3_K_L.gguf +3 -0
  4. CausalLM-35b-beta-long.Q3_K_M.gguf +3 -0
  5. CausalLM-35b-beta-long.Q3_K_S.gguf +3 -0
  6. CausalLM-35b-beta-long.Q4_0.gguf +3 -0
  7. CausalLM-35b-beta-long.Q4_1.gguf +3 -0
  8. CausalLM-35b-beta-long.Q4_K_M.gguf +3 -0
  9. CausalLM-35b-beta-long.Q4_K_S.gguf +3 -0
  10. CausalLM-35b-beta-long.Q5_0.gguf +3 -0
  11. CausalLM-35b-beta-long.Q5_1.gguf +3 -0
  12. CausalLM-35b-beta-long.Q5_K_M.gguf +3 -0
  13. CausalLM-35b-beta-long.Q5_K_S.gguf +3 -0
  14. CausalLM-35b-beta-long.Q6_K.gguf +3 -0
  15. CausalLM-35b-beta-long.Q8_0.gguf +3 -0
  16. README.md +41 -0
.gitattributes ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ CausalLM-35b-beta-long.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ CausalLM-35b-beta-long.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
38
+ CausalLM-35b-beta-long.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ CausalLM-35b-beta-long.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
40
+ CausalLM-35b-beta-long.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
41
+ CausalLM-35b-beta-long.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
42
+ CausalLM-35b-beta-long.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ CausalLM-35b-beta-long.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
44
+ CausalLM-35b-beta-long.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
45
+ CausalLM-35b-beta-long.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
46
+ CausalLM-35b-beta-long.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
47
+ CausalLM-35b-beta-long.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
48
+ CausalLM-35b-beta-long.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
49
+ CausalLM-35b-beta-long.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
CausalLM-35b-beta-long.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8aaa97b87465be8182a3ac57b42234ff2026f9f9beda6b387528405ec194e2dd
3
+ size 13818384704
CausalLM-35b-beta-long.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7436033efefefd5bc83b82814d2fa6a1b1db9da3507350d0752b2fa085497dab
3
+ size 19150393664
CausalLM-35b-beta-long.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:462f75e7b9896b964f2b454ff0a42d187dca8af55a3bb2a4109d7db50ee2bf0e
3
+ size 17619472704
CausalLM-35b-beta-long.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:802c324378e6e2139e9175d9483587ba59e1e6345954703aa49af6cdb2cfd08f
3
+ size 15863107904
CausalLM-35b-beta-long.Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:92e2e3cd865c2f794ced791f856ca51551e39e1a9204d8c217f3e987c828cc2a
3
+ size 20230426944
CausalLM-35b-beta-long.Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e2a8ff2f42f96773b6f40afa27a79cc3719980dd171f187520215fd69a27b88
3
+ size 22285635904
CausalLM-35b-beta-long.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df726ae0ca77da2a3f8a699f7f36f5c00c0f38a4cf6b6b9bf6232d5d6ce14521
3
+ size 21528039744
CausalLM-35b-beta-long.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:171f2e5c0f52b47ad7f1e127266e5ed18f30c9d791874c311767f1f9421cebe8
3
+ size 20379324736
CausalLM-35b-beta-long.Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c3ede7a06c72aa09352cac0286bc01b781f2a559c44fba803cd44259d87e93a
3
+ size 24340844864
CausalLM-35b-beta-long.Q5_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f865c255a4b98f06f1ab8ec78fbfef96352063788cc169c4d5c5f2aecdec6b1
3
+ size 26396053824
CausalLM-35b-beta-long.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2266b0b639dc7174a9945917b0da2042add673ecc1da51ca8be2328b2314fbd5
3
+ size 25009312064
CausalLM-35b-beta-long.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:433f7a468786d9a659222fa6fa4053d95adca50603ca3a0c85e7f0823aeecca1
3
+ size 24340844864
CausalLM-35b-beta-long.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:950e461c03212721cb843dd253db760f2dd490705c4b5f2f441bfb4b062251e8
3
+ size 28708163904
CausalLM-35b-beta-long.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fda60f67c7b6780fd79aa7c53b7b3b66577cb58ef0523b1449375799b14dec81
3
+ size 37180002624
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: gpl-3.0
3
+ language:
4
+ - en
5
+ - zh
6
+ - ja
7
+ - de
8
+ datasets:
9
+ - JosephusCheung/GuanacoDataset
10
+ - meta-math/MetaMathQA
11
+ - jondurbin/airoboros-3.1
12
+ - WizardLM/WizardLM_evol_instruct_V2_196k
13
+ - RyokoAI/ShareGPT52K
14
+ - RyokoAI/Fandom23K
15
+ - milashkaarshif/MoeGirlPedia_wikitext_raw_archive
16
+ - wikipedia
17
+ - wiki_lingua
18
+ - garage-bAInd/Open-Platypus
19
+ - LDJnr/Puffin
20
+ - BAAI/COIG
21
+ - TigerResearch/tigerbot-zhihu-zh-10k
22
+ - liwu/MNBVC
23
+ - teknium/openhermes
24
+ - CausalLM/Refined-Anime-Text
25
+ - microsoft/orca-math-word-problems-200k
26
+ - m-a-p/CodeFeedback-Filtered-Instruction
27
+ pipeline_tag: text-generation
28
+ base_model: CausalLM/35b-beta-long
29
+ ---
30
+ ## CausalLM 35b beta long
31
+ - This is quantized version of CausalLM/35b-beta-long created using llama.cpp
32
+
33
+ ## TBA
34
+
35
+ Tokenizer is different from cohere - and chat template is ChatML - fully fine-tuned at 128K+
36
+
37
+ No loras, no quants, no tricks, 30M+ sft data.
38
+
39
+ Pressure Testing from: https://github.com/LeonEricsson/llmcontext
40
+
41
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63468a143ea42ee2cb49ddd1/2XbONpyTeMH1qWCtE9ziH.png)