Upload folder using huggingface_hub

.gitattributes

@@ -33,3 +33,15 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+zefiro-7b-sft-qlora-ITA-v0.5-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+zefiro-7b-sft-qlora-ITA-v0.5-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+zefiro-7b-sft-qlora-ITA-v0.5-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+zefiro-7b-sft-qlora-ITA-v0.5-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+zefiro-7b-sft-qlora-ITA-v0.5-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+zefiro-7b-sft-qlora-ITA-v0.5-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+zefiro-7b-sft-qlora-ITA-v0.5-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+zefiro-7b-sft-qlora-ITA-v0.5-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+zefiro-7b-sft-qlora-ITA-v0.5-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+zefiro-7b-sft-qlora-ITA-v0.5-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+zefiro-7b-sft-qlora-ITA-v0.5-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+zefiro-7b-sft-qlora-ITA-v0.5-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,79 @@
+---
+license: apache-2.0
+datasets:
+- giux78/100k-sft-ready-ultrafeedback-ita
+language:
+- it
+pipeline_tag: text-generation
+base_model: giux78/zefiro-7b-sft-qlora-ITA-v0.5
+tags:
+- TensorBlock
+- GGUF
+---
+
+<div style="width: auto; margin-left: auto; margin-right: auto">
+<img src="https://i.imgur.com/jC7kdl8.jpeg" alt="TensorBlock" style="width: 100%; min-width: 400px; display: block; margin: auto;">
+</div>
+<div style="display: flex; justify-content: space-between; width: 100%;">
+    <div style="display: flex; flex-direction: column; align-items: flex-start;">
+        <p style="margin-top: 0.5em; margin-bottom: 0em;">
+            Feedback and support: TensorBlock's  <a href="https://x.com/tensorblock_aoi">Twitter/X</a>, <a href="https://t.me/TensorBlock">Telegram Group</a> and <a href="https://x.com/tensorblock_aoi">Discord server</a>
+        </p>
+    </div>
+</div>
+
+## giux78/zefiro-7b-sft-qlora-ITA-v0.5 - GGUF
+
+This repo contains GGUF format model files for [giux78/zefiro-7b-sft-qlora-ITA-v0.5](https://huggingface.co/giux78/zefiro-7b-sft-qlora-ITA-v0.5).
+
+The files were quantized using machines provided by [TensorBlock](https://tensorblock.co/), and they are compatible with llama.cpp as of [commit b4011](https://github.com/ggerganov/llama.cpp/commit/a6744e43e80f4be6398fc7733a01642c846dce1d).
+
+## Prompt template
+
+```
+<|system|>
+{system_prompt}</s>
+<|user|>
+{prompt}</s>
+<|assistant|>
+```
+
+## Model file specification
+
+| Filename | Quant type | File Size | Description |
+| -------- | ---------- | --------- | ----------- |
+| [zefiro-7b-sft-qlora-ITA-v0.5-Q2_K.gguf](https://huggingface.co/tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF/tree/main/zefiro-7b-sft-qlora-ITA-v0.5-Q2_K.gguf) | Q2_K | 2.532 GB | smallest, significant quality loss - not recommended for most purposes |
+| [zefiro-7b-sft-qlora-ITA-v0.5-Q3_K_S.gguf](https://huggingface.co/tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF/tree/main/zefiro-7b-sft-qlora-ITA-v0.5-Q3_K_S.gguf) | Q3_K_S | 2.947 GB | very small, high quality loss |
+| [zefiro-7b-sft-qlora-ITA-v0.5-Q3_K_M.gguf](https://huggingface.co/tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF/tree/main/zefiro-7b-sft-qlora-ITA-v0.5-Q3_K_M.gguf) | Q3_K_M | 3.277 GB | very small, high quality loss |
+| [zefiro-7b-sft-qlora-ITA-v0.5-Q3_K_L.gguf](https://huggingface.co/tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF/tree/main/zefiro-7b-sft-qlora-ITA-v0.5-Q3_K_L.gguf) | Q3_K_L | 3.560 GB | small, substantial quality loss |
+| [zefiro-7b-sft-qlora-ITA-v0.5-Q4_0.gguf](https://huggingface.co/tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF/tree/main/zefiro-7b-sft-qlora-ITA-v0.5-Q4_0.gguf) | Q4_0 | 3.827 GB | legacy; small, very high quality loss - prefer using Q3_K_M |
+| [zefiro-7b-sft-qlora-ITA-v0.5-Q4_K_S.gguf](https://huggingface.co/tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF/tree/main/zefiro-7b-sft-qlora-ITA-v0.5-Q4_K_S.gguf) | Q4_K_S | 3.856 GB | small, greater quality loss |
+| [zefiro-7b-sft-qlora-ITA-v0.5-Q4_K_M.gguf](https://huggingface.co/tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF/tree/main/zefiro-7b-sft-qlora-ITA-v0.5-Q4_K_M.gguf) | Q4_K_M | 4.068 GB | medium, balanced quality - recommended |
+| [zefiro-7b-sft-qlora-ITA-v0.5-Q5_0.gguf](https://huggingface.co/tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF/tree/main/zefiro-7b-sft-qlora-ITA-v0.5-Q5_0.gguf) | Q5_0 | 4.654 GB | legacy; medium, balanced quality - prefer using Q4_K_M |
+| [zefiro-7b-sft-qlora-ITA-v0.5-Q5_K_S.gguf](https://huggingface.co/tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF/tree/main/zefiro-7b-sft-qlora-ITA-v0.5-Q5_K_S.gguf) | Q5_K_S | 4.654 GB | large, low quality loss - recommended |
+| [zefiro-7b-sft-qlora-ITA-v0.5-Q5_K_M.gguf](https://huggingface.co/tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF/tree/main/zefiro-7b-sft-qlora-ITA-v0.5-Q5_K_M.gguf) | Q5_K_M | 4.779 GB | large, very low quality loss - recommended |
+| [zefiro-7b-sft-qlora-ITA-v0.5-Q6_K.gguf](https://huggingface.co/tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF/tree/main/zefiro-7b-sft-qlora-ITA-v0.5-Q6_K.gguf) | Q6_K | 5.534 GB | very large, extremely low quality loss |
+| [zefiro-7b-sft-qlora-ITA-v0.5-Q8_0.gguf](https://huggingface.co/tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF/tree/main/zefiro-7b-sft-qlora-ITA-v0.5-Q8_0.gguf) | Q8_0 | 7.167 GB | very large, extremely low quality loss - not recommended |
+
+
+## Downloading instruction
+
+### Command line
+
+Firstly, install Huggingface Client
+
+```shell
+pip install -U "huggingface_hub[cli]"
+```
+
+Then, downoad the individual model file the a local directory
+
+```shell
+huggingface-cli download tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF --include "zefiro-7b-sft-qlora-ITA-v0.5-Q2_K.gguf" --local-dir MY_LOCAL_DIR
+```
+
+If you wanna download multiple model files with a pattern (e.g., `*Q4_K*gguf`), you can try:
+
+```shell
+huggingface-cli download tensorblock/zefiro-7b-sft-qlora-ITA-v0.5-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
+```

zefiro-7b-sft-qlora-ITA-v0.5-Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:52cce5e8d899cf0a06dba329070c5b7310248785ecf612843395430102456005
+size 2719243008

zefiro-7b-sft-qlora-ITA-v0.5-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7d30ddea15e9e6b3b21db52c2abf5dbcf0539adf877af4818f779669712ffa2a
+size 3822025472

zefiro-7b-sft-qlora-ITA-v0.5-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:678a24a435f0cf5cd3e9b9c3648064e2f4b174fc97c6b0ee098e3178700ac79a
+size 3518987008

zefiro-7b-sft-qlora-ITA-v0.5-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:baeb223a8ccf700e0bef3f1d3c243bb4d05c47114f9f1bfec1540af80cf89a3c
+size 3164568320

zefiro-7b-sft-qlora-ITA-v0.5-Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f3e8ca643c47a55ed98d70b9dcb760dcce0cca5d9b62e6085e2fc250327ef1f2
+size 4108917504

zefiro-7b-sft-qlora-ITA-v0.5-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad713fca5ce7e538e7bd2f1a77b43ccd6dad5c227f78238f0fc665b7c239cbe2
+size 4368440064

zefiro-7b-sft-qlora-ITA-v0.5-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e0ba6c0ca16848a0b820560dbc943604c620f0f54f01ea65927dc5bfde502d3
+size 4140374784

zefiro-7b-sft-qlora-ITA-v0.5-Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d201672489f95fa31e5d1c1f0018d2f40924d4a53f58cb71837ef86d444fba1e
+size 4997716736

zefiro-7b-sft-qlora-ITA-v0.5-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6838afa2afd699fdf736f37d84e92990e421c1dfe4b3d504a91e6c34dedd2e5a
+size 5131410176

zefiro-7b-sft-qlora-ITA-v0.5-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c842cc676648694d9a511865c05616b82aae01f3dafa1afe23bf0e5c686c09a
+size 4997716736

zefiro-7b-sft-qlora-ITA-v0.5-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc951642073cb49f320930af044ac589cced493d84e4f90497f4151647327cd0
+size 5942065920

zefiro-7b-sft-qlora-ITA-v0.5-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4724064dd432d74d423552299df26120979418c67112434aacb14b347af2081e
+size 7695858432