Edit model card
Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

6.9bpw (nice) h8 exl2 quant of (https://huggingface.co/BeaverAI/mistral-doryV2-12b)

Dory 12b (v2)

(redone) redone instruct finetune of mistral nemo 12b's base. not (E)RP-focused, leave that to drummer.

image/gif

thanks to twisted again for the compute :3

Prompting

alpaca-like:

### System:
[Optional system prompt]

### Instruction:
[Query]

### Response:
[Response]</s>

### Instruction:
[...]

Training details

Rank 64 QDoRA, trained on the following data mix:

Downloads last month
6
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for Natkituwu/mistral-doryV2-12b-6.9bpw-exl2

Quantized
(55)
this model