mradermacher commited on
Commit
fd66c9f
1 Parent(s): 2de5f5e

auto-patch README.md

Browse files
Files changed (1) hide show
  1. README.md +126 -0
README.md CHANGED
@@ -1,6 +1,132 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  <!-- ### quantize_version: 2 -->
2
  <!-- ### output_tensor_quantised: 1 -->
3
  <!-- ### convert_type: hf -->
4
  <!-- ### vocab_type: -->
5
  <!-- ### tags: -->
6
  static quants of https://huggingface.co/LeroyDyer/SpydazWebAI_Human_AGI
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: LeroyDyer/SpydazWebAI_Human_AGI
3
+ datasets:
4
+ - neoneye/base64-decode-v2
5
+ - neoneye/base64-encode-v1
6
+ - VuongQuoc/Chemistry_text_to_image
7
+ - Kamizuru00/diagram_image_to_text
8
+ - LeroyDyer/Chemistry_text_to_image_BASE64
9
+ - LeroyDyer/AudioCaps-Spectrograms_to_Base64
10
+ - LeroyDyer/winogroud_text_to_imaget_BASE64
11
+ - LeroyDyer/chart_text_to_Base64
12
+ - LeroyDyer/diagram_image_to_text_BASE64
13
+ - mekaneeky/salt_m2e_15_3_instruction
14
+ - mekaneeky/SALT-languages-bible
15
+ language:
16
+ - en
17
+ - sw
18
+ - ig
19
+ - so
20
+ - es
21
+ - ca
22
+ - xh
23
+ - zu
24
+ - ha
25
+ - tw
26
+ - af
27
+ - hi
28
+ - bm
29
+ - su
30
+ library_name: transformers
31
+ license: apache-2.0
32
+ quantized_by: mradermacher
33
+ tags:
34
+ - mergekit
35
+ - merge
36
+ - Mistral_Star
37
+ - Mistral_Quiet
38
+ - Mistral
39
+ - Mixtral
40
+ - Question-Answer
41
+ - Token-Classification
42
+ - Sequence-Classification
43
+ - SpydazWeb-AI
44
+ - chemistry
45
+ - biology
46
+ - legal
47
+ - code
48
+ - climate
49
+ - medical
50
+ - LCARS_AI_StarTrek_Computer
51
+ - text-generation-inference
52
+ - chain-of-thought
53
+ - tree-of-knowledge
54
+ - forest-of-thoughts
55
+ - visual-spacial-sketchpad
56
+ - alpha-mind
57
+ - knowledge-graph
58
+ - entity-detection
59
+ - encyclopedia
60
+ - wikipedia
61
+ - stack-exchange
62
+ - Reddit
63
+ - Cyber-series
64
+ - MegaMind
65
+ - Cybertron
66
+ - SpydazWeb
67
+ - Spydaz
68
+ - LCARS
69
+ - star-trek
70
+ - mega-transformers
71
+ - Mulit-Mega-Merge
72
+ - Multi-Lingual
73
+ - Afro-Centric
74
+ - African-Model
75
+ - Ancient-One
76
+ ---
77
+ ## About
78
+
79
  <!-- ### quantize_version: 2 -->
80
  <!-- ### output_tensor_quantised: 1 -->
81
  <!-- ### convert_type: hf -->
82
  <!-- ### vocab_type: -->
83
  <!-- ### tags: -->
84
  static quants of https://huggingface.co/LeroyDyer/SpydazWebAI_Human_AGI
85
+
86
+ <!-- provided-files -->
87
+ weighted/imatrix quants are available at https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-i1-GGUF
88
+ ## Usage
89
+
90
+ If you are unsure how to use GGUF files, refer to one of [TheBloke's
91
+ READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
92
+ more details, including on how to concatenate multi-part files.
93
+
94
+ ## Provided Quants
95
+
96
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
97
+
98
+ | Link | Type | Size/GB | Notes |
99
+ |:-----|:-----|--------:|:------|
100
+ | [GGUF](https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-GGUF/resolve/main/SpydazWebAI_Human_AGI.Q2_K.gguf) | Q2_K | 2.8 | |
101
+ | [GGUF](https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-GGUF/resolve/main/SpydazWebAI_Human_AGI.Q3_K_S.gguf) | Q3_K_S | 3.3 | |
102
+ | [GGUF](https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-GGUF/resolve/main/SpydazWebAI_Human_AGI.Q3_K_M.gguf) | Q3_K_M | 3.6 | lower quality |
103
+ | [GGUF](https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-GGUF/resolve/main/SpydazWebAI_Human_AGI.Q3_K_L.gguf) | Q3_K_L | 3.9 | |
104
+ | [GGUF](https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-GGUF/resolve/main/SpydazWebAI_Human_AGI.IQ4_XS.gguf) | IQ4_XS | 4.0 | |
105
+ | [GGUF](https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-GGUF/resolve/main/SpydazWebAI_Human_AGI.Q4_K_S.gguf) | Q4_K_S | 4.2 | fast, recommended |
106
+ | [GGUF](https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-GGUF/resolve/main/SpydazWebAI_Human_AGI.Q4_K_M.gguf) | Q4_K_M | 4.5 | fast, recommended |
107
+ | [GGUF](https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-GGUF/resolve/main/SpydazWebAI_Human_AGI.Q5_K_S.gguf) | Q5_K_S | 5.1 | |
108
+ | [GGUF](https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-GGUF/resolve/main/SpydazWebAI_Human_AGI.Q5_K_M.gguf) | Q5_K_M | 5.2 | |
109
+ | [GGUF](https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-GGUF/resolve/main/SpydazWebAI_Human_AGI.Q6_K.gguf) | Q6_K | 6.0 | very good quality |
110
+ | [GGUF](https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-GGUF/resolve/main/SpydazWebAI_Human_AGI.Q8_0.gguf) | Q8_0 | 7.8 | fast, best quality |
111
+ | [GGUF](https://huggingface.co/mradermacher/SpydazWebAI_Human_AGI-GGUF/resolve/main/SpydazWebAI_Human_AGI.f16.gguf) | f16 | 14.6 | 16 bpw, overkill |
112
+
113
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
114
+ types (lower is better):
115
+
116
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
117
+
118
+ And here are Artefact2's thoughts on the matter:
119
+ https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
120
+
121
+ ## FAQ / Model Request
122
+
123
+ See https://huggingface.co/mradermacher/model_requests for some answers to
124
+ questions you might have and/or if you want some other model quantized.
125
+
126
+ ## Thanks
127
+
128
+ I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
129
+ me use its servers and providing upgrades to my workstation to enable
130
+ this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
131
+
132
+ <!-- end -->