DaringMaid-20B-GGUF / README.md
Kooten's picture
Update README.md
c70e273
|
raw
history blame
2.51 kB
metadata
license: cc-by-nc-4.0
language:
  - en
pipeline_tag: text-generation

This repo contains GGUF quants of DaringMaid-20B

Q3_K_M - Q4_K_M - Q5_K_M

DaringMaid-20B

My goal was to make a Noromaid that's smarter and better at following instructions.

After trying a bunch of different recipes I think this one turned out pretty good

  • I used sequelbox/DynamicFactor as a base to as its supposed "improve overall knowledge, precise communication, conceptual understanding, and technical skill" over the base llama2.
  • NeverSleep/Noromaid of course.
  • Undi95/Utopia has been recommended again recently and its still really good so in the mixer it goes
  • I enjoyed tavtav/Rose so i threw in a bit of CalderaAI/Thorns
  • There was recently a model that tried to pass itself off as Gryphe/MythoMax, i made a merge with that model before it was revealed to be MythoMax and it turned out pretty good so i used it.

The .yml config files for mergekit with the exact merges can be found in the "Recipe" folder in the fp16 repo

Quants

GGUF, EXL2: 6bpw, 3bpw

Prompt template:

I have been using Undi/Ikaris SillyTavern presets for Noromaid: Context, Instruct.

Alpaca:

Below is an instruction that describes a task. Write a response that appropriately completes the request. Do not include descriptions of non-visual qualities such as personality, movements, scents, mental traits, or anything which could not be seen in a still photograph. Do not write in full sentences. Prefix your description with the phrase 'full body portrait,'

### Instruction:
{prompt}

### Response: