Hugging Face's logo

Kooten
/
EstopianMaid-13B-5bpw-exl2

Text Generation
Transformers
Safetensors
English
llama
roleplay
text-generation-inference
Inference Endpoints
Model card Files Community
Edit model card

EstopianMaid-13B 5bpw

Description

Exllama quant of KatyTheCutie/EstopianMaid-13B

Other quants:

EXL2: 8bpw, 6bpw, 5bpw, 4bpw

Prompt format:

Unclear.. none were suggested and the merged models use different formats.

Contact

Kooten on discord

Downloads last month
32
Inference Examples
Text Generation
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.