Hugging Face's logo

dreamgen
/
opus-v0-7b

Text Generation
Transformers
PyTorch
English
mistral
text-generation-inference
Inference Endpoints
Model card Files Community
opus-v0-7b
File size: 3,488 Bytes 
b16edb4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
 
---
language:
  - en
pipeline_tag: text-generation
---

# DreamGen Opus V0 7B

**DreamGen Opus** is a family of **uncensored** models fine-tuned for **(steerable) story writing** and the model also works great for **chat / RP**.
The DreamGen Opus V0 7B model is derived from [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1).

**WARNING** Quantized versions manifest significant performance degradation compared to the original:

- AWQ: [dreamgen/opus-v0-7b-awq](https://huggingface.co/dreamgen/opus-v0-7b-awq)
- GGUF: [TheBloke/opus-v0-7b-gguf](https://huggingface.co/TheBloke/opus-v0-7B-GGUF)
- ELX2: [bartowski/opus-v0-7b-exl2](https://huggingface.co/bartowski/opus-v0-7b-exl2)

Other sizes:

- 70B: [dreamgen/opus-v0-70b](https://huggingface.co/dreamgen/opus-v0-70b)

You can **try the Opus V0 70B** (AWQ) model for free on [dreamgen.com](https://dreamgen.com).

## Prompting

Please see the [official documentation](https://dreamgen.com/docs/stories) for more detailed guide, including how to prompt the model for chat / RP.

The (collaborative / steerable) story writing task teaches the model to respect `<setting>` and `<instruction>` inserted into the prompt.

Example prompt:

```
<setting>
(Setting provides general overview of the story and characters)
This story is a twist on the traditional Little Red Riding Hood story.
In this variation, the Little Red Riding Hood and her grandma are secretely werevoles.
</setting>

(Previous part of the story, potentially empty)

<instruction>
(Setting tells the model what should happen in the next few sentences / paragraphs)
The Little Red Riding hood confronts The Big Bad Wolf, transforming into her wolf form.
</instruction>
```

## Dataset

The fine-tuning dataset consisted of >1M tokens of collaborative writing task examples, each example being up to 4096 tokens. On top of that, >20M tokens of more general, but less instructed examples were included to help preserve generalization.

All prose in the dataset is from actual humans, not AI generated.

## Community

Join the DreamGen community on [**Discord**](https://dreamgen.com/discord), or follow our [**X/Twitter account**](https://dreamgen.com/twitter) for new model releases and other news.
We will soon be releasing models with longer context window, as well as models specifically fine-tuned for character chat & roleplay.

Help us shape the future of DreamGen.

## Running the model

The model is should be compatible with any software that supports [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1).

### Running on DreamGen.com (free)

You can try the model for free at [dreamgen.com](https://dreamgen.com) — note that an account is required.

### Running with vLLM

1. Install [vLLM](https://github.com/vllm-project/vllm) (version at least 0.2.1.post1)
2. Run `python -u -m vllm.entrypoints.openai.api_server --host 0.0.0.0 --model dreamgen/opus-v0-7b`
3. Use any library that's compatible with the OpenAI API to talk to the model

### Running with oobabooga/text-generation-webui

1. Install [oobabooga/text-generation-webui](https://github.com/oobabooga/text-generation-webui)
2. Go to the **Model** tab
3. Under **Download custom model or LoRA**, enter `dreamgen/opus-v0-7b`
4. Go to the **Text Generation** tab
5. Enter your prompt

## License

- For personal and academic use: Same license as the base model, in this case Apache 2.0.
- For commercial use: Please reach out to hello@dreamgen.com.