Hugging Face's logo

andrijdavid
/
TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation
Transformers
GGUF
English
llama
GGUF
conversational
Inference Endpoints
text-generation-inference
Model card Files Community
andrijdavid commited on
Commit
3d5c3f3
•
1 Parent(s): 4812e21

Upload folder using huggingface_hub

Browse files
Files changed (20) hide show
  1. README.md +16 -2
  2. TinyLlama-1.1B-Chat-v1.0-Q2_K.gguf +2 -2
  3. TinyLlama-1.1B-Chat-v1.0-Q3_K.gguf +2 -2
  4. TinyLlama-1.1B-Chat-v1.0-Q3_K_L.gguf +2 -2
  5. TinyLlama-1.1B-Chat-v1.0-Q3_K_M.gguf +2 -2
  6. TinyLlama-1.1B-Chat-v1.0-Q3_K_S.gguf +2 -2
  7. TinyLlama-1.1B-Chat-v1.0-Q4_0.gguf +2 -2
  8. TinyLlama-1.1B-Chat-v1.0-Q4_1.gguf +2 -2
  9. TinyLlama-1.1B-Chat-v1.0-Q4_K.gguf +2 -2
  10. TinyLlama-1.1B-Chat-v1.0-Q4_K_M.gguf +2 -2
  11. TinyLlama-1.1B-Chat-v1.0-Q4_K_S.gguf +2 -2
  12. TinyLlama-1.1B-Chat-v1.0-Q5_0.gguf +2 -2
  13. TinyLlama-1.1B-Chat-v1.0-Q5_1.gguf +2 -2
  14. TinyLlama-1.1B-Chat-v1.0-Q5_K.gguf +2 -2
  15. TinyLlama-1.1B-Chat-v1.0-Q5_K_M.gguf +2 -2
  16. TinyLlama-1.1B-Chat-v1.0-Q5_K_S.gguf +2 -2
  17. TinyLlama-1.1B-Chat-v1.0-Q6_K.gguf +2 -2
  18. TinyLlama-1.1B-Chat-v1.0-Q8_0.gguf +2 -2
  19. TinyLlama-1.1B-Chat-v1.0-f16.gguf +2 -2
  20. tokenizer.model +3 -0
README.md CHANGED
@@ -7,7 +7,21 @@ tags:
7
  datasets:
8
  - cerebras/SlimPajama-627B
9
  - bigcode/starcoderdata
10
- - OpenAssistant/oasst_top1_2023-08-25
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  quantized_by: andrijdavid
12
  ---
13
  # TinyLlama-1.1B-Chat-v1.0-GGUF
@@ -217,7 +231,7 @@ The TinyLlama project aims to **pretrain** a **1.1B Llama model on 3 trillion to
217
  We adopted exactly the same architecture and tokenizer as Llama 2. This means TinyLlama can be plugged and played in many open-source projects built upon Llama. Besides, TinyLlama is compact with only 1.1B parameters. This compactness allows it to cater to a multitude of applications demanding a restricted computation and memory footprint.
218
 
219
  #### This Model
220
- This is the chat model finetuned on top of [TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T). **We follow [HF's Zephyr](https://huggingface.co/HuggingFaceH4/zephyr-7b-alpha/edit/main/README.md)'s training recipe.** The model was " initially fine-tuned on a variant of the [`UltraChat`](https://huggingface.co/datasets/stingning/ultrachat) dataset, which contains a diverse range of synthetic dialogues generated by ChatGPT.
221
  We then further aligned the model with [🤗 TRL's](https://github.com/huggingface/trl) `DPOTrainer` on the [openbmb/UltraFeedback](https://huggingface.co/datasets/openbmb/UltraFeedback) dataset, which contain 64k prompts and model completions that are ranked by GPT-4."
222
 
223
 
 
7
  datasets:
8
  - cerebras/SlimPajama-627B
9
  - bigcode/starcoderdata
10
+ - HuggingFaceH4/ultrachat_200k
11
+ - HuggingFaceH4/ultrafeedback_binarized
12
+ widget:
13
+ - text: '<|system|>
14
+
15
+ You are a chatbot who can help code!</s>
16
+
17
+ <|user|>
18
+
19
+ Write me a function to calculate the first 10 digits of the fibonacci sequence
20
+ in Python and print it out to the CLI.</s>
21
+
22
+ <|assistant|>
23
+
24
+ '
25
  quantized_by: andrijdavid
26
  ---
27
  # TinyLlama-1.1B-Chat-v1.0-GGUF
 
231
  We adopted exactly the same architecture and tokenizer as Llama 2. This means TinyLlama can be plugged and played in many open-source projects built upon Llama. Besides, TinyLlama is compact with only 1.1B parameters. This compactness allows it to cater to a multitude of applications demanding a restricted computation and memory footprint.
232
 
233
  #### This Model
234
+ This is the chat model finetuned on top of [TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T). **We follow [HF's Zephyr](https://huggingface.co/HuggingFaceH4/zephyr-7b-alpha)'s training recipe.** The model was " initially fine-tuned on a variant of the [`UltraChat`](https://huggingface.co/datasets/stingning/ultrachat) dataset, which contains a diverse range of synthetic dialogues generated by ChatGPT.
235
  We then further aligned the model with [🤗 TRL's](https://github.com/huggingface/trl) `DPOTrainer` on the [openbmb/UltraFeedback](https://huggingface.co/datasets/openbmb/UltraFeedback) dataset, which contain 64k prompts and model completions that are ranked by GPT-4."
236
 
237
 
TinyLlama-1.1B-Chat-v1.0-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:68e38f6fe19ec6c0e538ef8369e7be9094ce8ff7cd39fdd28438e8b603bd0658
3
- size 483116384
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bade0ed1d2c34723de6b0911573d107d20735fcde742ef8f5b7f09fcd75c26ae
3
+ size 482143168
TinyLlama-1.1B-Chat-v1.0-Q3_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:08334409d38852b503236cb3e0d16a878707e3ea52c0e422f9ae5716ae034771
3
- size 550819168
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c714751f42af6978ead2da26ff7adf8468d685e4298bd980358f4e8f67bdc476
3
+ size 549845952
TinyLlama-1.1B-Chat-v1.0-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a8cab8fd79d8dec5002da32df4fd129a98c9add335be141b2780419b08ff8e2
3
- size 592500064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2bc06c9bf91f01f1d36873530cdd160ae4d9de4b46d81bcb3ef2f2d5b97347f6
3
+ size 591526848
TinyLlama-1.1B-Chat-v1.0-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:08334409d38852b503236cb3e0d16a878707e3ea52c0e422f9ae5716ae034771
3
- size 550819168
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c714751f42af6978ead2da26ff7adf8468d685e4298bd980358f4e8f67bdc476
3
+ size 549845952
TinyLlama-1.1B-Chat-v1.0-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3f9f6d7875d4aa022a0d6ae38b61b155a6f48ce1802d28273aa891a4b5591688
3
- size 500315488
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:16b1c437390e4e24d22fa074c9a99cd9efbf9093d8d1d9da31d461fc3e0fa97c
3
+ size 499342272
TinyLlama-1.1B-Chat-v1.0-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d3765967b7eb61446c941afc90a71971b24f2d03b79d3801020ff4d92755fcbf
3
- size 637699424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6669e2c7bed2f71918db6e94edac08fb52fc70b84b242733b003afe781ab013d
3
+ size 636726208
TinyLlama-1.1B-Chat-v1.0-Q4_1.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:eb8eaaf8e9d12f48b97775e633e70b17f41688e62f15e89e49eb9ddcf9c0d60a
3
- size 702350688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57619add18cbe6247869cc63eedaf7a265d2ee0da2146077725b57cbd93f2ae0
3
+ size 701377472
TinyLlama-1.1B-Chat-v1.0-Q4_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4cd4f93fe55d4a0737b0ebb8e31737d2e551fa05db3304285369fe8f159275ee
3
- size 668788064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6c9d2af17e9213825bbf27240e95085ea9eef8990bfee7bc02b75f2b019be55
3
+ size 667814848
TinyLlama-1.1B-Chat-v1.0-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4cd4f93fe55d4a0737b0ebb8e31737d2e551fa05db3304285369fe8f159275ee
3
- size 668788064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6c9d2af17e9213825bbf27240e95085ea9eef8990bfee7bc02b75f2b019be55
3
+ size 667814848
TinyLlama-1.1B-Chat-v1.0-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4aef1a9d70d9ebf7fafb29b8fa7e6c30cfaccd7b005bd1fc38f4ad9293c9a651
3
- size 643728736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0413c15bb0ec5707302812242bd1fb6158c9c9677c43637a042e793096fcf975
3
+ size 642755520
TinyLlama-1.1B-Chat-v1.0-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e1eef25cd78097dc79cc7d1c040af64cdf194872db5c7044bf3c6234f9f8bd67
3
- size 767001952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:125cde070e4aa8151e154fdb4c7f29318361b5e8bd6b81dd89b2e008aca62acc
3
+ size 766028736
TinyLlama-1.1B-Chat-v1.0-Q5_1.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:61bf7f35c270d2c594634809e358eb95db3af379f458e1aa6c06c1d6b664cb7c
3
- size 831653216
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:387cc58d39127b8ff4685d5e6801d401496ea3823d5600da528d2ba1299ad552
3
+ size 830680000
TinyLlama-1.1B-Chat-v1.0-Q5_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bfbd8834c632d69da21caa6f0aaee1963aa5d8fe3d89fd152a984f893b038f2d
3
- size 783017312
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce675a115a1447f9c7018d25259b8c05ed9a7cb6952e41570d6ca9655316cef6
3
+ size 782044096
TinyLlama-1.1B-Chat-v1.0-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:bfbd8834c632d69da21caa6f0aaee1963aa5d8fe3d89fd152a984f893b038f2d
3
- size 783017312
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ce675a115a1447f9c7018d25259b8c05ed9a7cb6952e41570d6ca9655316cef6
3
+ size 782044096
TinyLlama-1.1B-Chat-v1.0-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:30cb62b812edba2e02ff5f889b45153fd37968584e1082b8069b9b3133f4bb13
3
- size 767001952
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:560954dc4b6e5f712bd6a2067714f08b44b5e805b5e2df39e61cc5b21637e5b3
3
+ size 766028736
TinyLlama-1.1B-Chat-v1.0-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2ce70f9dfb078ddb34649be9166a108cb51cdc98f5c350b837f9b57eeed01876
3
- size 904385888
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f149d2203f796758304839f3b5a201dd644081d113abeaa02402966210b70ca
3
+ size 903412672
TinyLlama-1.1B-Chat-v1.0-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a6c7f85b8842d25771c8459224f6906d03e60e8dbc81692f613781c0660622f4
3
- size 1170781536
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7405c70b3459dd52db34926bb2355335ebf0760e08fc07a800212863251cc280
3
+ size 1169808320
TinyLlama-1.1B-Chat-v1.0-f16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7374ed46b39654ac4eee7d0dcc819c5799c61fbf555488d8ec4459e57c32cc3b
3
- size 2201990464
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d96e46fd247508b02348ac1d4cb1a215312df060b49a529db159bb9bb2a67f0b
3
+ size 2201017248
tokenizer.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
3
+ size 499723