README.md

metadata

base_model: p208p2002/bloomz-Alpaca-560M
datasets:
  - tatsu-lab/alpaca
inference: false
language:
  - en
model_creator: p208p2002
model_name: bloomz-Alpaca-560M
pipeline_tag: text-generation
quantized_by: afrideva
tags:
  - text-generation-inference
  - gguf
  - ggml
  - quantized
  - q2_k
  - q3_k_m
  - q4_k_m
  - q5_k_m
  - q6_k
  - q8_0
widget:
  - text: |-
      ### Instruction:
      How can we reduce air pollution?

      ### Response:

p208p2002/bloomz-Alpaca-560M-GGUF

Quantized GGUF model files for bloomz-Alpaca-560M from p208p2002

Name	Quant method	Size
bloomz-alpaca-560m.q2_k.gguf	q2_k	430.81 MB
bloomz-alpaca-560m.q3_k_m.gguf	q3_k_m	492.33 MB
bloomz-alpaca-560m.q4_k_m.gguf	q4_k_m	561.16 MB
bloomz-alpaca-560m.q5_k_m.gguf	q5_k_m	625.29 MB
bloomz-alpaca-560m.q6_k.gguf	q6_k	682.78 MB
bloomz-alpaca-560m.q8_0.gguf	q8_0	880.26 MB

Original Model Card:

Fine-Tune BLOOMZ Model on Alpaca 52K.