922CA commited on
Commit
882d415
·
1 Parent(s): 4715443

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +23 -0
README.md ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: openrail
3
+ ---
4
+ # l27b-monika-v0.3b:
5
+ -Yet another experimental Monika llama
6
+ -Llama 7b chat fine-tuned for Monika character from DDLC
7
+ -Trained on a dataset of ~600 items (dialogue scraped from game, reddit, and Twitter augmented by Nous Hermes 13b to turn each into snippets of multi-turn chat dialogue between Player and Monika + manually crafted test dataset of 12 items)
8
+ -Trained for 2 epochs
9
+ -For best results: replace "Human" and "Assistant" with "Playe"” and "Monika"
10
+
11
+ Note: aside from formatting and other minor edits, dataset used is mostly as is generated by LM. As such, while this version is better at coherency or chatting than previous ones, it may not reflect perfectly the characteristics of Monika (i.e. she will claim to have an office, work as a translator, or play the guitar).
12
+
13
+ Next version will train on a manually curated and edited version of this dataset, where dialogue will be edited to reflect her characteristics more.
14
+
15
+ Also ideally looking for a base model to work off from aside from llama 7b chat (but so far, they all OOM for us).
16
+
17
+ [WARNINGS AND DISCLAIMERS]
18
+
19
+ [USAGE]
20
+
21
+ [META LICENSE]
22
+
23
+ WIP