README.md

metadata

license: apache-2.0
language:
  - en
tags:
  - not-for-all-audiences

RPMix 4x7B MoE

A mixture of experts model using my best scoring RP models. This model should primarily be used for RP and creative writing.

base_model: ResplendentAI/DaturaCookie_7B
gate_mode: hidden
experts_per_token: 2
experts:
  - source_model: ChaoticNeutrals/RP_Vision_7B
    positive_prompts:
    - "chat"
    - "assistant"
    - "tell me"
    - "explain"
    - "I want"
  - source_model: ChaoticNeutrals/BuRP_7B
    positive_prompts:
    - "show me"
    - "touch"
    - "believe"
    - "see"
    - "love"
  - source_model: ResplendentAI/DaturaCookie_7B
    positive_prompts:
    - "storywriting"
    - "write"
    - "scene"
    - "story"
    - "character"
  - source_model: ChaoticNeutrals/Kool-Aid_7B
    positive_prompts:
    - "sensual"
    - "sexual"
    - "horny"
    - "turned on"
    - "intimate"
dtype: bfloat16