| base_model: p208p2002/bloomz-Alpaca-560M | |
| datasets: | |
| - tatsu-lab/alpaca | |
| inference: false | |
| language: | |
| - en | |
| model_creator: p208p2002 | |
| model_name: bloomz-Alpaca-560M | |
| pipeline_tag: text-generation | |
| quantized_by: afrideva | |
| tags: | |
| - text-generation-inference | |
| - gguf | |
| - ggml | |
| - quantized | |
| - q2_k | |
| - q3_k_m | |
| - q4_k_m | |
| - q5_k_m | |
| - q6_k | |
| - q8_0 | |
| widget: | |
| - text: '### Instruction: | |
| How can we reduce air pollution? | |
| ### Response:' | |
| # p208p2002/bloomz-Alpaca-560M-GGUF | |
| Quantized GGUF model files for [bloomz-Alpaca-560M](https://huggingface.co/p208p2002/bloomz-Alpaca-560M) from [p208p2002](https://huggingface.co/p208p2002) | |
| | Name | Quant method | Size | | |
| | ---- | ---- | ---- | | |
| | [bloomz-alpaca-560m.q2_k.gguf](https://huggingface.co/afrideva/bloomz-Alpaca-560M-GGUF/resolve/main/bloomz-alpaca-560m.q2_k.gguf) | q2_k | 430.81 MB | | |
| | [bloomz-alpaca-560m.q3_k_m.gguf](https://huggingface.co/afrideva/bloomz-Alpaca-560M-GGUF/resolve/main/bloomz-alpaca-560m.q3_k_m.gguf) | q3_k_m | 492.33 MB | | |
| | [bloomz-alpaca-560m.q4_k_m.gguf](https://huggingface.co/afrideva/bloomz-Alpaca-560M-GGUF/resolve/main/bloomz-alpaca-560m.q4_k_m.gguf) | q4_k_m | 561.16 MB | | |
| | [bloomz-alpaca-560m.q5_k_m.gguf](https://huggingface.co/afrideva/bloomz-Alpaca-560M-GGUF/resolve/main/bloomz-alpaca-560m.q5_k_m.gguf) | q5_k_m | 625.29 MB | | |
| | [bloomz-alpaca-560m.q6_k.gguf](https://huggingface.co/afrideva/bloomz-Alpaca-560M-GGUF/resolve/main/bloomz-alpaca-560m.q6_k.gguf) | q6_k | 682.78 MB | | |
| | [bloomz-alpaca-560m.q8_0.gguf](https://huggingface.co/afrideva/bloomz-Alpaca-560M-GGUF/resolve/main/bloomz-alpaca-560m.q8_0.gguf) | q8_0 | 880.26 MB | | |
| ## Original Model Card: | |
| Fine-Tune BLOOMZ Model on Alpaca 52K. |