Hugging Face's logo

waldie
/
Mistral-Pygmalion-7b-4bpw-h6-exl2

Text Generation
Transformers
Safetensors
English
llama
Mistral
Pygmalion
llama-2
llama-2-7b
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

quant of Delcos' MistralPy-7b

python3 convert.py \
    -i /input/Delcos_Mistral-Pygmalion-7b/ \
    -c /input/wikitext/0000.parquet \
    -o /output/temp/ \
    -cf /output/4bpw/ \
    -b 4.0 \
    -hb 6
Downloads last month
9
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.