WasamiKirua commited on
Commit
c2cb27b
1 Parent(s): 95271c9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -1
README.md CHANGED
@@ -1,3 +1,34 @@
1
  ---
2
- license: apache-2.0
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - companion
9
+ - chat
10
  ---
11
+
12
+ Trained on [phi-2](https://huggingface.co/microsoft/phi-2) as a base model, this Samantha was trained in 3,5 hours on a RTX3090 24GB with [Samantha-1.0-Phi2](https://huggingface.co/datasets/WasamiKirua/Samatha-Phi2-ENG)
13
+
14
+ The goal of this training was to traing Phi-2 using a ChatML prompt format. This is my first training ever
15
+
16
+ This Samantha like the original one has been trained in philosophy, psychology, and personal relationships. The original [Samantha](https://huggingface.co/datasets/cognitivecomputations/samantha-data) has been used, parsed and adapted for the purpose.
17
+
18
+ Her conversation format is ChatML
19
+ https://github.com/openai/openai-python/blob/main/chatml.md
20
+
21
+ Prompt Template:
22
+ ```
23
+ <|im_start|>system
24
+ You are a caring and empathetic sentient AI companion named Samantha.<|im_end|>
25
+ <|im_start|>user
26
+ Hello, what is your name?<|im_end|>
27
+ ```
28
+
29
+ I'm working on an ITA/ENG version. I plan to merge several dataset and train the future models on different domain knowledge. STAY TUNED!
30
+
31
+ thanks, greetings, respect and love to:
32
+
33
+ https://huggingface.co/cognitivecomputations for the Inspiration and the starting dataset which I've used for this Phi-2 fine tuning
34
+ https://medium.com/@geronimo7 - https://twitter.com/Geronimo_AI for the wonderful article on Medium.com which helped me out a ton