Kooten
/

MiquMaid-v1-70B-3bpw-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

MiquMaid-v1-70B-3bpw-exl2 / README.md

Kooten's picture

Update README.md

e0775d6 verified 11 months ago

|

665 Bytes

MiquMaid-v1-70B 3bpw

Description

Exllama quant of NeverSleep/MiquMaid-v1-70B

Other quants:

EXL2: 3.5bpw, 3bpw, 2.4bpw

GGUF:

2bit Imatrix GGUF

NeverSleeps Official Quants

Custom format:

### Instruction:
{system prompt}

### Input:
{input}

### Response:
{reply}

Contact

Kooten on discord