Hugging Face's logo

afrideva
/
Tiny-Vicuna-1B-GGUF

Text Generation
GGUF
ggml
quantized
q2_k
q3_k_m
q4_k_m
q5_k_m
q6_k
q8_0
Model card Files Community
afrideva commited on
Commit
ec86600
•
1 Parent(s): edfb8d5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -1
README.md CHANGED
@@ -23,7 +23,6 @@ Quantized GGUF model files for [Tiny-Vicuna-1B](https://huggingface.co/Jiayi-Pan
23
 
24
  | Name | Quant method | Size |
25
  | ---- | ---- | ---- |
26
- | [tiny-vicuna-1b.fp16.gguf](https://huggingface.co/afrideva/Tiny-Vicuna-1B-GGUF/resolve/main/tiny-vicuna-1b.fp16.gguf) | fp16 | 2.20 GB |
27
  | [tiny-vicuna-1b.q2_k.gguf](https://huggingface.co/afrideva/Tiny-Vicuna-1B-GGUF/resolve/main/tiny-vicuna-1b.q2_k.gguf) | q2_k | 482.14 MB |
28
  | [tiny-vicuna-1b.q3_k_m.gguf](https://huggingface.co/afrideva/Tiny-Vicuna-1B-GGUF/resolve/main/tiny-vicuna-1b.q3_k_m.gguf) | q3_k_m | 549.85 MB |
29
  | [tiny-vicuna-1b.q4_k_m.gguf](https://huggingface.co/afrideva/Tiny-Vicuna-1B-GGUF/resolve/main/tiny-vicuna-1b.q4_k_m.gguf) | q4_k_m | 667.81 MB |
 
23
 
24
  | Name | Quant method | Size |
25
  | ---- | ---- | ---- |
 
26
  | [tiny-vicuna-1b.q2_k.gguf](https://huggingface.co/afrideva/Tiny-Vicuna-1B-GGUF/resolve/main/tiny-vicuna-1b.q2_k.gguf) | q2_k | 482.14 MB |
27
  | [tiny-vicuna-1b.q3_k_m.gguf](https://huggingface.co/afrideva/Tiny-Vicuna-1B-GGUF/resolve/main/tiny-vicuna-1b.q3_k_m.gguf) | q3_k_m | 549.85 MB |
28
  | [tiny-vicuna-1b.q4_k_m.gguf](https://huggingface.co/afrideva/Tiny-Vicuna-1B-GGUF/resolve/main/tiny-vicuna-1b.q4_k_m.gguf) | q4_k_m | 667.81 MB |