|
--- |
|
license: apache-2.0 |
|
language: |
|
- en |
|
tags: |
|
- not-for-all-audiences |
|
--- |
|
# RPMix 4x7B MoE |
|
|
|
A mixture of experts model using my best scoring RP models. This model should primarily be used for RP and creative writing. |
|
|
|
``` |
|
base_model: ResplendentAI/DaturaCookie_7B |
|
gate_mode: hidden |
|
experts_per_token: 2 |
|
experts: |
|
- source_model: ChaoticNeutrals/RP_Vision_7B |
|
positive_prompts: |
|
- "chat" |
|
- "assistant" |
|
- "tell me" |
|
- "explain" |
|
- "I want" |
|
- source_model: ChaoticNeutrals/BuRP_7B |
|
positive_prompts: |
|
- "show me" |
|
- "touch" |
|
- "believe" |
|
- "see" |
|
- "love" |
|
- source_model: ResplendentAI/DaturaCookie_7B |
|
positive_prompts: |
|
- "storywriting" |
|
- "write" |
|
- "scene" |
|
- "story" |
|
- "character" |
|
- source_model: ChaoticNeutrals/Kool-Aid_7B |
|
positive_prompts: |
|
- "sensual" |
|
- "sexual" |
|
- "horny" |
|
- "turned on" |
|
- "intimate" |
|
dtype: bfloat16 |
|
``` |
