hf-100 commited on
Commit
f97f2eb
1 Parent(s): 11a8aa7

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +48 -0
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-sa-4.0
3
+ ---
4
+
5
+ # Llama-3 Spellbound Instruct Tuning-Free Q8 GGUF
6
+
7
+
8
+
9
+ <img src="https://i.imgur.com/IG4IKfV.png" width=100 height=100>
10
+
11
+ # Updated Aspects
12
+
13
+ - Trained on additional tokens
14
+ - Improved mix of subject matter model was trained on
15
+ - Trained for 1.5M additional tokens
16
+ - Additional training on DPO dataset
17
+
18
+ # Model Rationale
19
+
20
+ Llama 3 is a strong base model with strong world understanding and creativity. Additional instruct finetuning trades that world understanding and creativity for instruction following that Llama doesn't require in order to adhere to most forms of roleplay.
21
+
22
+ This model was trained on unstructured text only, no instruct related fine-tuning was performed.
23
+
24
+ Made by [tryspellbound.com](https://tryspellbound.com).
25
+
26
+ *(tryspellbound.com does not currently use this model, it uses Claude 3 Sonnet.)*
27
+
28
+
29
+ ## Features of this fine-tune for Llama 3:
30
+ - Roleplaying in multi-turn stories where the history is presented in a single message
31
+ - Dynamic switching of writing styles for different scenarios
32
+ - Interpretation of formatting marks 'quote' and 'action'
33
+
34
+
35
+ **Warning:** The underlying model, Llama 3, was trained on data that included adult content. This fine-tune does not add additional guardrails and is not suitable for all environments.
36
+
37
+ ## Purpose of the Model
38
+
39
+ The main goal is to explore how presenting LLMs with history and instructions separately affects their performance, demonstrating:
40
+
41
+ - Improved coherence in long conversations
42
+ - Enhanced quality of character interactions
43
+ - Decreased instruction adherence, which could be improved with additional training
44
+
45
+
46
+
47
+ ## Advanced prompting of the model
48
+ For advanced prompting, see [this document](https://rentry.co/ti936r2i)