Upload folder using huggingface_hub

.gitattributes

@@ -34,3 +34,11 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
 tinyllama-1.1b-1t-openorca.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+TinyLlama-1.1B-1T-OpenOrca.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+TinyLlama-1.1B-1T-OpenOrca.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
+TinyLlama-1.1B-1T-OpenOrca.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
+TinyLlama-1.1B-1T-OpenOrca.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
+TinyLlama-1.1B-1T-OpenOrca.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
+TinyLlama-1.1B-1T-OpenOrca.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+TinyLlama-1.1B-1T-OpenOrca.gguf filter=lfs diff=lfs merge=lfs -text
+imatrix.dat filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,42 +1,5 @@
 ---
-language:
-- en
-license: apache-2.0
-tags:
-- llama-cpp
-- gguf-my-repo
-datasets:
-- Open-Orca/OpenOrca
-- bigcode/starcoderdata
-- cerebras/SlimPajama-627B
+base_model: jeff31415/TinyLlama-1.1B-1T-OpenOrca
 ---
 
-# Felladrin/TinyLlama-1.1B-1T-OpenOrca-Q8_0-GGUF
-This model was converted to GGUF format from [`jeff31415/TinyLlama-1.1B-1T-OpenOrca`](https://huggingface.co/jeff31415/TinyLlama-1.1B-1T-OpenOrca) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
-Refer to the [original model card](https://huggingface.co/jeff31415/TinyLlama-1.1B-1T-OpenOrca) for more details on the model.
-## Use with llama.cpp
-
-Install llama.cpp through brew.
-
-```bash
-brew install ggerganov/ggerganov/llama.cpp
-```
-Invoke the llama.cpp server or the CLI.
-
-CLI:
-
-```bash
-llama-cli --hf-repo Felladrin/TinyLlama-1.1B-1T-OpenOrca-Q8_0-GGUF --model tinyllama-1.1b-1t-openorca.Q8_0.gguf -p "The meaning to life and the universe is"
-```
-
-Server:
-
-```bash
-llama-server --hf-repo Felladrin/TinyLlama-1.1B-1T-OpenOrca-Q8_0-GGUF --model tinyllama-1.1b-1t-openorca.Q8_0.gguf -c 2048
-```
-
-Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
-
-```
-git clone https://github.com/ggerganov/llama.cpp &&             cd llama.cpp &&             make &&             ./main -m tinyllama-1.1b-1t-openorca.Q8_0.gguf -n 128
-```
+GGUF version of [jeff31415/TinyLlama-1.1B-1T-OpenOrca](https://huggingface.co/jeff31415/TinyLlama-1.1B-1T-OpenOrca).

TinyLlama-1.1B-1T-OpenOrca.IQ2_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b33bf1492becb8bc1ee04f5836d7d6c31bb3dab6e8c8004e5a24c05d93bbeb26
+size 518175808

TinyLlama-1.1B-1T-OpenOrca.IQ3_XXS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f0beff1b7753e914bb90c50ffccac5f847c5c90910c1c72c937e8e1035c1dcd9
+size 634059840

TinyLlama-1.1B-1T-OpenOrca.IQ4_XS.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:363b751198f3b54e1a35c1e3131aa3eee45b41e979f5a38ede73b62265685a26
+size 779770944

TinyLlama-1.1B-1T-OpenOrca.Q4_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3c16d42538d9f7d596013160a25b7e1f16d831793a07bf2bf19c51edb4b6957f
+size 839334976

TinyLlama-1.1B-1T-OpenOrca.Q5_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8d88d08ce3acc3530ad30ce4ee198a9eed6f568e0020f2269049845d300ef8f1
+size 945372224

TinyLlama-1.1B-1T-OpenOrca.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5ddb4762617fd423122f3c84a99e89bdca576efe9bfe9a788b981d40c687b5d9
+size 1058036800

TinyLlama-1.1B-1T-OpenOrca.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7efc09cecf01caaeb2c216b2e6f41a4738575012b441b8ad6646c9cf675402e7
+size 1292688448

TinyLlama-1.1B-1T-OpenOrca.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6d9846d0d249e9e782800b81959fd67015cc250103d79337d77b53ee04874c2f
+size 2201017216

imatrix.dat

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1634ca217daa3fa9243ce8dad10148e3ac73a0393eaf123be8436e10463ee37b
+size 1582042