Hugging Face's logo

tensorblock
/
SmolLM-360M-Instruct-GGUF

Transformers
GGUF
MLX
English
alignment-handbook
trl
sft
TensorBlock
GGUF
Inference Endpoints
conversational
Model card Files Community
morriszms commited on
Commit
208551a
•
1 Parent(s): 49290c9

Upload folder using huggingface_hub

Browse files
Files changed (13) hide show
  1. README.md +24 -23
  2. SmolLM-360M-Instruct-Q2_K.gguf +2 -2
  3. SmolLM-360M-Instruct-Q3_K_L.gguf +2 -2
  4. SmolLM-360M-Instruct-Q3_K_M.gguf +2 -2
  5. SmolLM-360M-Instruct-Q3_K_S.gguf +2 -2
  6. SmolLM-360M-Instruct-Q4_0.gguf +2 -2
  7. SmolLM-360M-Instruct-Q4_K_M.gguf +2 -2
  8. SmolLM-360M-Instruct-Q4_K_S.gguf +2 -2
  9. SmolLM-360M-Instruct-Q5_0.gguf +2 -2
  10. SmolLM-360M-Instruct-Q5_K_M.gguf +2 -2
  11. SmolLM-360M-Instruct-Q5_K_S.gguf +2 -2
  12. SmolLM-360M-Instruct-Q6_K.gguf +2 -2
  13. SmolLM-360M-Instruct-Q8_0.gguf +2 -2
README.md CHANGED
@@ -1,20 +1,21 @@
1
  ---
2
- license: apache-2.0
3
- base_model: unsloth/SmolLM-360M-Instruct
4
- tags:
5
- - alignment-handbook
6
- - trl
7
- - unsloth
8
- - TensorBlock
9
- - GGUF
10
  datasets:
11
  - Magpie-Align/Magpie-Pro-300K-Filtered
12
  - bigcode/self-oss-instruct-sc2-exec-filter-50k
13
  - teknium/OpenHermes-2.5
14
  - HuggingFaceTB/everyday-conversations-llama3.1-2k
15
- library_name: transformers
16
  language:
17
  - en
 
 
 
 
 
 
 
 
 
18
  ---
19
 
20
  <div style="width: auto; margin-left: auto; margin-right: auto">
@@ -28,9 +29,9 @@ language:
28
  </div>
29
  </div>
30
 
31
- ## unsloth/SmolLM-360M-Instruct - GGUF
32
 
33
- This repo contains GGUF format model files for [unsloth/SmolLM-360M-Instruct](https://huggingface.co/unsloth/SmolLM-360M-Instruct).
34
 
35
  The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
36
 
@@ -54,18 +55,18 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
54
 
55
  | Filename | Quant type | File Size | Description |
56
  | -------- | ---------- | --------- | ----------- |
57
- | [SmolLM-360M-Instruct-Q2_K.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q2_K.gguf) | Q2_K | 0.204 GB | smallest, significant quality loss - not recommended for most purposes |
58
- | [SmolLM-360M-Instruct-Q3_K_S.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q3_K_S.gguf) | Q3_K_S | 0.204 GB | very small, high quality loss |
59
- | [SmolLM-360M-Instruct-Q3_K_M.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q3_K_M.gguf) | Q3_K_M | 0.219 GB | very small, high quality loss |
60
- | [SmolLM-360M-Instruct-Q3_K_L.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q3_K_L.gguf) | Q3_K_L | 0.229 GB | small, substantial quality loss |
61
- | [SmolLM-360M-Instruct-Q4_0.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q4_0.gguf) | Q4_0 | 0.213 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
62
- | [SmolLM-360M-Instruct-Q4_K_S.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q4_K_S.gguf) | Q4_K_S | 0.242 GB | small, greater quality loss |
63
- | [SmolLM-360M-Instruct-Q4_K_M.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q4_K_M.gguf) | Q4_K_M | 0.252 GB | medium, balanced quality - recommended |
64
- | [SmolLM-360M-Instruct-Q5_0.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q5_0.gguf) | Q5_0 | 0.250 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
65
- | [SmolLM-360M-Instruct-Q5_K_S.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q5_K_S.gguf) | Q5_K_S | 0.264 GB | large, low quality loss - recommended |
66
- | [SmolLM-360M-Instruct-Q5_K_M.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q5_K_M.gguf) | Q5_K_M | 0.270 GB | large, very low quality loss - recommended |
67
- | [SmolLM-360M-Instruct-Q6_K.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q6_K.gguf) | Q6_K | 0.342 GB | very large, extremely low quality loss |
68
- | [SmolLM-360M-Instruct-Q8_0.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q8_0.gguf) | Q8_0 | 0.360 GB | very large, extremely low quality loss - not recommended |
69
 
70
 
71
  ## Downloading instruction
 
1
  ---
2
+ base_model: mlx-community/SmolLM-360M-Instruct
 
 
 
 
 
 
 
3
  datasets:
4
  - Magpie-Align/Magpie-Pro-300K-Filtered
5
  - bigcode/self-oss-instruct-sc2-exec-filter-50k
6
  - teknium/OpenHermes-2.5
7
  - HuggingFaceTB/everyday-conversations-llama3.1-2k
 
8
  language:
9
  - en
10
+ library_name: transformers
11
+ license: apache-2.0
12
+ tags:
13
+ - alignment-handbook
14
+ - trl
15
+ - sft
16
+ - mlx
17
+ - TensorBlock
18
+ - GGUF
19
  ---
20
 
21
  <div style="width: auto; margin-left: auto; margin-right: auto">
 
29
  </div>
30
  </div>
31
 
32
+ ## mlx-community/SmolLM-360M-Instruct - GGUF
33
 
34
+ This repo contains GGUF format model files for [mlx-community/SmolLM-360M-Instruct](https://huggingface.co/mlx-community/SmolLM-360M-Instruct).
35
 
36
  The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
37
 
 
55
 
56
  | Filename | Quant type | File Size | Description |
57
  | -------- | ---------- | --------- | ----------- |
58
+ | [SmolLM-360M-Instruct-Q2_K.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q2_K.gguf) | Q2_K | 0.219 GB | smallest, significant quality loss - not recommended for most purposes |
59
+ | [SmolLM-360M-Instruct-Q3_K_S.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q3_K_S.gguf) | Q3_K_S | 0.219 GB | very small, high quality loss |
60
+ | [SmolLM-360M-Instruct-Q3_K_M.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q3_K_M.gguf) | Q3_K_M | 0.235 GB | very small, high quality loss |
61
+ | [SmolLM-360M-Instruct-Q3_K_L.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q3_K_L.gguf) | Q3_K_L | 0.246 GB | small, substantial quality loss |
62
+ | [SmolLM-360M-Instruct-Q4_0.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q4_0.gguf) | Q4_0 | 0.229 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
63
+ | [SmolLM-360M-Instruct-Q4_K_S.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q4_K_S.gguf) | Q4_K_S | 0.260 GB | small, greater quality loss |
64
+ | [SmolLM-360M-Instruct-Q4_K_M.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q4_K_M.gguf) | Q4_K_M | 0.271 GB | medium, balanced quality - recommended |
65
+ | [SmolLM-360M-Instruct-Q5_0.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q5_0.gguf) | Q5_0 | 0.268 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
66
+ | [SmolLM-360M-Instruct-Q5_K_S.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q5_K_S.gguf) | Q5_K_S | 0.283 GB | large, low quality loss - recommended |
67
+ | [SmolLM-360M-Instruct-Q5_K_M.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q5_K_M.gguf) | Q5_K_M | 0.290 GB | large, very low quality loss - recommended |
68
+ | [SmolLM-360M-Instruct-Q6_K.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q6_K.gguf) | Q6_K | 0.367 GB | very large, extremely low quality loss |
69
+ | [SmolLM-360M-Instruct-Q8_0.gguf](https://huggingface.co/tensorblock/SmolLM-360M-Instruct-GGUF/blob/main/SmolLM-360M-Instruct-Q8_0.gguf) | Q8_0 | 0.386 GB | very large, extremely low quality loss - not recommended |
70
 
71
 
72
  ## Downloading instruction
SmolLM-360M-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:917e5566f1cc28820fb4fd90b91c13f643b79401b0ddc3056dabde9cd215404c
3
- size 218674176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6cde2093ddd4def72aa0747b8eebea07cd04989960e95d702f8593091bb41ba
3
+ size 218674144
SmolLM-360M-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8e198e8789ebf688e367c654beb391869656dd310d25172b53c779005b857d25
3
- size 246322176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afaea3b2211e35ec8cc29b175ab4e4c79d92066ea9ff57565aab634477b6ae4c
3
+ size 246322144
SmolLM-360M-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e7cf60d38e3b3e01c683bd662467be0552ed6cf4600d0c29bcbe81683d27252b
3
- size 234686976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65e11cfc2a10c6f9388a469850e6d9eded04eca50e252b2daac6b8c8347c6392
3
+ size 234686944
SmolLM-360M-Instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a9c7c55f7904e9b2c2e0bcbafde98799556555fc1553922b30a881383a52b482
3
- size 218674176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8a606368f1c288e32243dbbee55ce216cf55a1d85ef8587d01bdf312a6a7ad29
3
+ size 218674144
SmolLM-360M-Instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cda7a8066cdcbe2a0d4fc8a5a50d39b10226759852d9195495e0ae5e7a2490cd
3
- size 229118976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db183503350382ef5e59803f520848185ca3ef083b16b6ea98f64cf9b464f77f
3
+ size 229118944
SmolLM-360M-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a0c1c171dac8ebf4b570d9ebcc44577d0628726d4909d5eead173160d716605a
3
- size 270590976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80e0cfc73bcf46bb5f96eb4adfe3ea0b58adb57f1b0f14d01635dc4f9fbe8a62
3
+ size 270590944
SmolLM-360M-Instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c6183256ddf7fa720939e33358e24c237c7fe21d08e695b0897f5ac25f2b37e6
3
- size 259915776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff25971ad904cb80e8be0fa4eb53807ca795afc032d24492ecbeee3efffbd2fc
3
+ size 259915744
SmolLM-360M-Instruct-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cc09e1cc0a98e50b913dd78d7ffeb584b7faf82507bf0f56f889c7218ec1c617
3
- size 268440576
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9b79f8408c88cfeaaefe770fc3ecd0062df3b2200770b56f63a7007da7da4b2
3
+ size 268440544
SmolLM-360M-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2c2ec856ac8ef93ad099cc3eca881e34f52f866a522311629e99d7a83cc22784
3
- size 289944576
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5156682dd0ec9926ca991d03a35c293adcff24025664540cf9ab7152ac0e5b56
3
+ size 289944544
SmolLM-360M-Instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1d6bbcfbb62e46e71f523078b5798c3f71e8ca268939248ffd57457b9b295db9
3
- size 283186176
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce2278efa55be36ec5ee875b3798354d2325c38ec20dbeff310506cf132c829c
3
+ size 283186144
SmolLM-360M-Instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:db1f90ea26933461b0186108a6b9135d4a7a651b084b2f769d8a12fdb0fbb17e
3
- size 367358976
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69aad957aa13de32ccb0bc30928b26efca4a8caaf06a2b2af330ef4e636ca875
3
+ size 367358944
SmolLM-360M-Instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ec69de67f67ee6c0bf6730aa804660ff1987ff1542b32d299bf9e3a412025908
3
- size 386405376
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4a57b58bde260a94c1147fd9a67b898f503c9a9951f75744ccd89b95bce0989
3
+ size 386405344