Description

Exllama 2 quant of NeverSleep/Noromaid-20b-v0.1.1

Please make sure to read their description

4 BPW, Head bit set to 8

Prompt template: Custom format, or Alpaca

Custom format:

UPDATED!! SillyTavern config files: Context, Instruct. OLD SillyTavern config files: Context, Instruct.

Alpaca:

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:
Downloads last month
11
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Collection including Kooten/Noromaid-20b-v0.1.1-4bpw-h8-exl2