Upload folder using huggingface_hub

README.md

@@ -1,10 +1,10 @@
 ---
 license: apache-2.0
-base_model: HuggingFaceTB/SmolLM-1.7B-Instruct
+base_model: unsloth/SmolLM-1.7B-Instruct
 tags:
 - alignment-handbook
 - trl
-- sft
+- unsloth
 - TensorBlock
 - GGUF
 datasets:
@@ -28,12 +28,11 @@ language:
     </div>
 </div>
 
-## HuggingFaceTB/SmolLM-1.7B-Instruct - GGUF
+## unsloth/SmolLM-1.7B-Instruct - GGUF
 
-This repo contains GGUF format model files for [HuggingFaceTB/SmolLM-1.7B-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM-1.7B-Instruct).
-
-The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+This repo contains GGUF format model files for [unsloth/SmolLM-1.7B-Instruct](https://huggingface.co/unsloth/SmolLM-1.7B-Instruct).
 
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4242](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
 
 <div style="text-align: left; margin: 20px 0;">
     <a href="https://tensorblock.co/waitlist/client" style="display: inline-block; padding: 10px 20px; background-color: #007bff; color: white; text-decoration: none; border-radius: 5px; font-weight: bold;">
@@ -43,7 +42,6 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
 
 ## Prompt template
 
-
 ```
 <|im_start|>system
 {system_prompt}<|im_end|>
@@ -56,18 +54,18 @@ The files were quantized using machines provided by [TensorBlock](https://tensor
 
 | Filename | Quant type | File Size | Description |
 | -------- | ---------- | --------- | ----------- |
-| [SmolLM-1.7B-Instruct-Q2_K.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q2_K.gguf) | Q2_K | 0.628 GB | smallest, significant quality loss - not recommended for most purposes |
-| [SmolLM-1.7B-Instruct-Q3_K_S.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q3_K_S.gguf) | Q3_K_S | 0.723 GB | very small, high quality loss |
-| [SmolLM-1.7B-Instruct-Q3_K_M.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q3_K_M.gguf) | Q3_K_M | 0.801 GB | very small, high quality loss |
-| [SmolLM-1.7B-Instruct-Q3_K_L.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q3_K_L.gguf) | Q3_K_L | 0.868 GB | small, substantial quality loss |
-| [SmolLM-1.7B-Instruct-Q4_0.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q4_0.gguf) | Q4_0 | 0.923 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
-| [SmolLM-1.7B-Instruct-Q4_K_S.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q4_K_S.gguf) | Q4_K_S | 0.931 GB | small, greater quality loss |
-| [SmolLM-1.7B-Instruct-Q4_K_M.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q4_K_M.gguf) | Q4_K_M | 0.983 GB | medium, balanced quality - recommended |
-| [SmolLM-1.7B-Instruct-Q5_0.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q5_0.gguf) | Q5_0 | 1.110 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
-| [SmolLM-1.7B-Instruct-Q5_K_S.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q5_K_S.gguf) | Q5_K_S | 1.110 GB | large, low quality loss - recommended |
-| [SmolLM-1.7B-Instruct-Q5_K_M.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q5_K_M.gguf) | Q5_K_M | 1.141 GB | large, very low quality loss - recommended |
-| [SmolLM-1.7B-Instruct-Q6_K.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q6_K.gguf) | Q6_K | 1.309 GB | very large, extremely low quality loss |
-| [SmolLM-1.7B-Instruct-Q8_0.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q8_0.gguf) | Q8_0 | 1.695 GB | very large, extremely low quality loss - not recommended |
+| [SmolLM-1.7B-Instruct-Q2_K.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q2_K.gguf) | Q2_K | 0.675 GB | smallest, significant quality loss - not recommended for most purposes |
+| [SmolLM-1.7B-Instruct-Q3_K_S.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q3_K_S.gguf) | Q3_K_S | 0.777 GB | very small, high quality loss |
+| [SmolLM-1.7B-Instruct-Q3_K_M.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q3_K_M.gguf) | Q3_K_M | 0.860 GB | very small, high quality loss |
+| [SmolLM-1.7B-Instruct-Q3_K_L.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q3_K_L.gguf) | Q3_K_L | 0.933 GB | small, substantial quality loss |
+| [SmolLM-1.7B-Instruct-Q4_0.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q4_0.gguf) | Q4_0 | 0.991 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [SmolLM-1.7B-Instruct-Q4_K_S.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q4_K_S.gguf) | Q4_K_S | 0.999 GB | small, greater quality loss |
+| [SmolLM-1.7B-Instruct-Q4_K_M.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q4_K_M.gguf) | Q4_K_M | 1.056 GB | medium, balanced quality - recommended |
+| [SmolLM-1.7B-Instruct-Q5_0.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q5_0.gguf) | Q5_0 | 1.192 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [SmolLM-1.7B-Instruct-Q5_K_S.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q5_K_S.gguf) | Q5_K_S | 1.192 GB | large, low quality loss - recommended |
+| [SmolLM-1.7B-Instruct-Q5_K_M.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q5_K_M.gguf) | Q5_K_M | 1.225 GB | large, very low quality loss - recommended |
+| [SmolLM-1.7B-Instruct-Q6_K.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q6_K.gguf) | Q6_K | 1.406 GB | very large, extremely low quality loss |
+| [SmolLM-1.7B-Instruct-Q8_0.gguf](https://huggingface.co/tensorblock/SmolLM-1.7B-Instruct-GGUF/blob/main/SmolLM-1.7B-Instruct-Q8_0.gguf) | Q8_0 | 1.820 GB | very large, extremely low quality loss - not recommended |
 
 
 ## Downloading instruction

SmolLM-1.7B-Instruct-Q2_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6edd9dcff86f47406e8a868ba1f8cbb5536cefb05b47c8361cb361a27c83c924
-size 674583584
+oid sha256:c230beac854a5d5a3a6cfd7807a9d3720677a3cbad6021059f772167cb64172a
+size 674584416

SmolLM-1.7B-Instruct-Q3_K_L.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2bbd1e2aa2fd11e43b129a831ff52a893f7d6bb09e25d324b0289b89d4c44bbb
-size 932533280
+oid sha256:74a796caf3e3068cfb808f33b63b53f7e22dd3018efe485887cf6a26cf9fd5c5
+size 932534112

SmolLM-1.7B-Instruct-Q3_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:77656e2d9f983a12b79be533fa8c58fab84bd5e6be21bf9e04a14ed51d55f11a
-size 860181536
+oid sha256:a0d6866a8e3119305eb1161f43d4aae8f722710b5455a5d341b36ad9ea066244
+size 860182368

SmolLM-1.7B-Instruct-Q3_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:77ccb67160b9d04524ec6601ffd776bd7ec2dad47dba07de290466c505f593ed
-size 776819744
+oid sha256:dc30c5ea8dcb5ce2e5efa37ae7f43e0a55fef948041c7476aa9f1aafcc7f1fa4
+size 776820576

SmolLM-1.7B-Instruct-Q4_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:96c17f2fd5246eff751dfbcd551849fa2ccb66baa8f44e46a0e9ed728b59b21c
-size 990729248
+oid sha256:a9c4ba0d5c521c2aff1bfdd327856adac6206ea6db984d742d9eafadd2068c59
+size 990730080

SmolLM-1.7B-Instruct-Q4_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f4bc81769705d9e41beb09065dc7f5d126adb314b325e87c9ba93ef75cf16e53
-size 1055609888
+oid sha256:767e65147de752e927afa833b4b4468d2b7134c077b07cc504245463ec5591e4
+size 1055610720

SmolLM-1.7B-Instruct-Q4_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d8a697ee0c9005e6e6112cff8625d807b199b90071ef715e67334181949e2365
-size 999117856
+oid sha256:8c6f8afcac3468a191899f53433e39f50f1af7f95f65d7140dcb42766dd218ea
+size 999118688

SmolLM-1.7B-Instruct-Q5_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:99b709c8143e3539f72288779c7c7f09ef970e79a199d427b69868226570e652
-size 1192055840
+oid sha256:50142662af1804e795468054661e45e318cff014fb32a26e2f3a643f2886acdd
+size 1192056672

SmolLM-1.7B-Instruct-Q5_K_M.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ce2c7247e01a1640cb7a6f03f556510f2bfae9ca0a06342b5221b72017c9b3f8
-size 1225479200
+oid sha256:a9159073e4de66a08ee4e31898d8486a61ed3ea61ccbc94ad57c80dad87eb4e6
+size 1225480032

SmolLM-1.7B-Instruct-Q5_K_S.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:101c6aa370634d72419dceb12f8f21b19910932556bc238ac84358e3c4c1cd3b
-size 1192055840
+oid sha256:7bd90577ec7b7c2736862f2dd8a2b2b7c703d7e953cff8e94febb6d16ac7531b
+size 1192056672

SmolLM-1.7B-Instruct-Q6_K.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cc0369b47bdd0f8cbc6f18e76316a21f299c4d2e15d788406b5c65d5e1775ac4
-size 1405965344
+oid sha256:fca360d6c2753d9e5f92bd4b9b22da912f4e537704b6d8af3a129e42e70a64b7
+size 1405966176

SmolLM-1.7B-Instruct-Q8_0.gguf

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d92ec99f014c96fb0413ed730c9154875f15678bb3767ebf6e403e76e6e1be3b
-size 1820415008
+oid sha256:052e26766d7b3d861f3df2a944137ea7b6e4ad0f20bc715f10f915ba37aa8e2d
+size 1820415840