Hugging Face's logo

XelotX
/
Tess-v2.5.2-Qwen2-72B-XelotX-iQuants

Transformers
GGUF
English
Inference Endpoints
imatrix
conversational
Model card Files Community
XelotX mradermacher commited on
Commit
60b630b
·
verified ·
0 Parent(s):

Duplicate from mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF

Browse files

Co-authored-by: Michael Radermacher <mradermacher@users.noreply.huggingface.co>

Files changed (27) hide show
  1. .gitattributes +60 -0
  2. README.md +75 -0
  3. Tess-v2.5.2-Qwen2-72B.i1-IQ1_M.gguf +3 -0
  4. Tess-v2.5.2-Qwen2-72B.i1-IQ1_S.gguf +3 -0
  5. Tess-v2.5.2-Qwen2-72B.i1-IQ2_M.gguf +3 -0
  6. Tess-v2.5.2-Qwen2-72B.i1-IQ2_S.gguf +3 -0
  7. Tess-v2.5.2-Qwen2-72B.i1-IQ2_XS.gguf +3 -0
  8. Tess-v2.5.2-Qwen2-72B.i1-IQ2_XXS.gguf +3 -0
  9. Tess-v2.5.2-Qwen2-72B.i1-IQ3_M.gguf +3 -0
  10. Tess-v2.5.2-Qwen2-72B.i1-IQ3_S.gguf +3 -0
  11. Tess-v2.5.2-Qwen2-72B.i1-IQ3_XS.gguf +3 -0
  12. Tess-v2.5.2-Qwen2-72B.i1-IQ3_XXS.gguf +3 -0
  13. Tess-v2.5.2-Qwen2-72B.i1-IQ4_XS.gguf +3 -0
  14. Tess-v2.5.2-Qwen2-72B.i1-Q2_K.gguf +3 -0
  15. Tess-v2.5.2-Qwen2-72B.i1-Q3_K_L.gguf +3 -0
  16. Tess-v2.5.2-Qwen2-72B.i1-Q3_K_M.gguf +3 -0
  17. Tess-v2.5.2-Qwen2-72B.i1-Q3_K_S.gguf +3 -0
  18. Tess-v2.5.2-Qwen2-72B.i1-Q4_0.gguf +3 -0
  19. Tess-v2.5.2-Qwen2-72B.i1-Q4_K_M.gguf +3 -0
  20. Tess-v2.5.2-Qwen2-72B.i1-Q4_K_S.gguf +3 -0
  21. Tess-v2.5.2-Qwen2-72B.i1-Q5_K_M.gguf.part1of2 +3 -0
  22. Tess-v2.5.2-Qwen2-72B.i1-Q5_K_M.gguf.part2of2 +3 -0
  23. Tess-v2.5.2-Qwen2-72B.i1-Q5_K_S.gguf.part1of2 +3 -0
  24. Tess-v2.5.2-Qwen2-72B.i1-Q5_K_S.gguf.part2of2 +3 -0
  25. Tess-v2.5.2-Qwen2-72B.i1-Q6_K.gguf.part1of2 +3 -0
  26. Tess-v2.5.2-Qwen2-72B.i1-Q6_K.gguf.part2of2 +3 -0
  27. imatrix.dat +3 -0
.gitattributes ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ Tess-v2.5.2-Qwen2-72B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Tess-v2.5.2-Qwen2-72B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Tess-v2.5.2-Qwen2-72B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Tess-v2.5.2-Qwen2-72B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Tess-v2.5.2-Qwen2-72B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Tess-v2.5.2-Qwen2-72B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Tess-v2.5.2-Qwen2-72B.i1-Q6_K.gguf.part1of2 filter=lfs diff=lfs merge=lfs -text
44
+ Tess-v2.5.2-Qwen2-72B.i1-Q6_K.gguf.part2of2 filter=lfs diff=lfs merge=lfs -text
45
+ Tess-v2.5.2-Qwen2-72B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Tess-v2.5.2-Qwen2-72B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Tess-v2.5.2-Qwen2-72B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Tess-v2.5.2-Qwen2-72B.i1-Q5_K_S.gguf.part1of2 filter=lfs diff=lfs merge=lfs -text
49
+ Tess-v2.5.2-Qwen2-72B.i1-Q5_K_S.gguf.part2of2 filter=lfs diff=lfs merge=lfs -text
50
+ Tess-v2.5.2-Qwen2-72B.i1-Q5_K_M.gguf.part1of2 filter=lfs diff=lfs merge=lfs -text
51
+ Tess-v2.5.2-Qwen2-72B.i1-Q5_K_M.gguf.part2of2 filter=lfs diff=lfs merge=lfs -text
52
+ Tess-v2.5.2-Qwen2-72B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
53
+ Tess-v2.5.2-Qwen2-72B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
54
+ Tess-v2.5.2-Qwen2-72B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
55
+ Tess-v2.5.2-Qwen2-72B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
56
+ Tess-v2.5.2-Qwen2-72B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
57
+ Tess-v2.5.2-Qwen2-72B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
58
+ Tess-v2.5.2-Qwen2-72B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Tess-v2.5.2-Qwen2-72B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
60
+ Tess-v2.5.2-Qwen2-72B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,75 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: migtissera/Tess-v2.5.2-Qwen2-72B
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ license: other
7
+ license_link: https://huggingface.co/Qwen/Qwen2-72B/blob/main/LICENSE
8
+ license_name: qwen2
9
+ quantized_by: mradermacher
10
+ ---
11
+ ## About
12
+
13
+ <!-- ### quantize_version: 2 -->
14
+ <!-- ### output_tensor_quantised: 1 -->
15
+ <!-- ### convert_type: hf -->
16
+ <!-- ### vocab_type: -->
17
+ <!-- ### tags: nicoboss -->
18
+ weighted/imatrix quants of https://huggingface.co/migtissera/Tess-v2.5.2-Qwen2-72B
19
+
20
+ <!-- provided-files -->
21
+ static quants are available at https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-GGUF
22
+ ## Usage
23
+
24
+ If you are unsure how to use GGUF files, refer to one of [TheBloke's
25
+ READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
26
+ more details, including on how to concatenate multi-part files.
27
+
28
+ ## Provided Quants
29
+
30
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
31
+
32
+ | Link | Type | Size/GB | Notes |
33
+ |:-----|:-----|--------:|:------|
34
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-IQ1_S.gguf) | i1-IQ1_S | 22.8 | for the desperate |
35
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-IQ1_M.gguf) | i1-IQ1_M | 23.8 | mostly desperate |
36
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 25.6 | |
37
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 27.2 | |
38
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-IQ2_S.gguf) | i1-IQ2_S | 28.0 | |
39
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-IQ2_M.gguf) | i1-IQ2_M | 29.4 | |
40
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q2_K.gguf) | i1-Q2_K | 29.9 | IQ3_XXS probably better |
41
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 31.9 | lower quality |
42
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 32.9 | |
43
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-IQ3_S.gguf) | i1-IQ3_S | 34.6 | beats Q3_K* |
44
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 34.6 | IQ3_XS probably better |
45
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-IQ3_M.gguf) | i1-IQ3_M | 35.6 | |
46
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 37.8 | IQ3_S probably better |
47
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 39.6 | IQ3_M probably better |
48
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 39.8 | |
49
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q4_0.gguf) | i1-Q4_0 | 41.5 | fast, low quality |
50
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 44.0 | optimal size/speed/quality |
51
+ | [GGUF](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 47.5 | fast, recommended |
52
+ | [PART 1](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q5_K_S.gguf.part1of2) [PART 2](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q5_K_S.gguf.part2of2) | i1-Q5_K_S | 51.5 | |
53
+ | [PART 1](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q5_K_M.gguf.part1of2) [PART 2](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q5_K_M.gguf.part2of2) | i1-Q5_K_M | 54.5 | |
54
+ | [PART 1](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q6_K.gguf.part1of2) [PART 2](https://huggingface.co/mradermacher/Tess-v2.5.2-Qwen2-72B-i1-GGUF/resolve/main/Tess-v2.5.2-Qwen2-72B.i1-Q6_K.gguf.part2of2) | i1-Q6_K | 64.4 | practically like static Q6_K |
55
+
56
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
57
+ types (lower is better):
58
+
59
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
60
+
61
+ And here are Artefact2's thoughts on the matter:
62
+ https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
63
+
64
+ ## FAQ / Model Request
65
+
66
+ See https://huggingface.co/mradermacher/model_requests for some answers to
67
+ questions you might have and/or if you want some other model quantized.
68
+
69
+ ## Thanks
70
+
71
+ I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
72
+ me use its servers and providing upgrades to my workstation to enable
73
+ this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his hardware for calculating the imatrix for these quants.
74
+
75
+ <!-- end -->
Tess-v2.5.2-Qwen2-72B.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e4bcf81152307b6801d4ac5e3f239e163eaac423fd5e2ec3ab5e6014fe530f0
3
+ size 23740210240
Tess-v2.5.2-Qwen2-72B.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efe87fdca6f3c1ec2dce4e537bdb9022964335be60e982cc872052ecf7489eca
3
+ size 22690323520
Tess-v2.5.2-Qwen2-72B.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0fd661f54432d890922bec94b1d28bd3f1e5ae8ab4aa4888f26a936098c5c32
3
+ size 29338983488
Tess-v2.5.2-Qwen2-72B.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8481e4a28a84e4d61fcb048d70751a749b9eba85882ea6323a187cacfad4890
3
+ size 27939134528
Tess-v2.5.2-Qwen2-72B.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd40d9d01cbc63f4e84ef7da012f8d6600f4bb9bf4261d5af893b8935d670a27
3
+ size 27057642560
Tess-v2.5.2-Qwen2-72B.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e826af90a5b8bc8652bd08b0d1b98a768ac3a58ca3be50717022734efe4822b
3
+ size 25490021440
Tess-v2.5.2-Qwen2-72B.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75c2fc44523e61ed2c53b430edb5d343d2141fd6a026017ad66248fc058ba8d0
3
+ size 35503594560
Tess-v2.5.2-Qwen2-72B.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9016ed47b94d96a28aca373752a4b0ea9393e8b337662c2c9ce6118c3cfdaafe
3
+ size 34487786560
Tess-v2.5.2-Qwen2-72B.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e0abac7459bd64472eae55c9f4335ba9dff30ebfb33183bff8e60d85cb20757
3
+ size 32842177600
Tess-v2.5.2-Qwen2-72B.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbccae6a42a01c637819879bb906ec7cecc597d6df02efe975950f20827e61a5
3
+ size 31845080128
Tess-v2.5.2-Qwen2-72B.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc31584d6372c4f0c22c729eec10bc419a16abcca9d4d69e458d01c141b16c4f
3
+ size 39709072448
Tess-v2.5.2-Qwen2-72B.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d48579080537657656e0eca7ed43d913af96154a7288b86909dfe653798d18d2
3
+ size 29811760192
Tess-v2.5.2-Qwen2-72B.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00e5f6614e7cf5ffbdc1fb19ab87deb670246ad27315cf6942b11499c6382983
3
+ size 39505222720
Tess-v2.5.2-Qwen2-72B.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b8ee97bd4580e2c7a8fecb577c516b0fe442b6d589a40a39aa66d0d1479a4ea9
3
+ size 37698722880
Tess-v2.5.2-Qwen2-72B.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:430b13d23ecd8df3cf8b4e0655bbf63e69217a2094fa094ed1a89b265cdfd6d6
3
+ size 34487786560
Tess-v2.5.2-Qwen2-72B.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abff79be09186e9d5c0021df8456184e56c12f8e9c7bb09ce3725af4e2ff91be
3
+ size 41383124032
Tess-v2.5.2-Qwen2-72B.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55b76e13a83e030b317e76125e7085f609fd92bd5dcf1ddd1d15673e6b4a27ee
3
+ size 47415712832
Tess-v2.5.2-Qwen2-72B.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90e13da4745e91f3382753786e6a349efb11483cd628abf640c5b6521cffd63e
3
+ size 43889220672
Tess-v2.5.2-Qwen2-72B.i1-Q5_K_M.gguf.part1of2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e27b6b34221811d164e656e36e02adea4b17b27668ea80bba9c92ba2e76a2545
3
+ size 27917287424
Tess-v2.5.2-Qwen2-72B.i1-Q5_K_M.gguf.part2of2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9d37ed7cd1fd822518f50af82c4413ec14ad1166d938cf790961b49ca4b4d30
3
+ size 26530176064
Tess-v2.5.2-Qwen2-72B.i1-Q5_K_S.gguf.part1of2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c277c70eefaad9499e20987428a4c8d2abeca73814a777d89871c045b6b635db
3
+ size 25769803776
Tess-v2.5.2-Qwen2-72B.i1-Q5_K_S.gguf.part2of2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9fc2dc970ebd1e31ce788f9d68e435ff6d0a7c03d0283d3594e8c75d621e3767
3
+ size 25605332032
Tess-v2.5.2-Qwen2-72B.i1-Q6_K.gguf.part1of2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89ea274db5d00e6457158ad49e849b5b3300e87300c0a616c81032c042774537
3
+ size 32212254720
Tess-v2.5.2-Qwen2-72B.i1-Q6_K.gguf.part2of2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50588ec0438f7dbccfa5b5520361eaffb77d9c05a026810796d4bcd41c7f9e81
3
+ size 32135371840
imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:355fc5ade9b9ed4be1e0ec6b0658f98e1f80403929903cbe812ae108f5b2bba6
3
+ size 25209002