pszemraj commited on
Commit
f669f75
1 Parent(s): afeccf8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -15,6 +15,21 @@ This is a layer-pruned language model created using [mergekit](https://github.co
15
 
16
  ![image](phi3small.png)
17
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18
  ## Merge Details
19
  ### Merge Method
20
 
 
15
 
16
  ![image](phi3small.png)
17
 
18
+ ## Usage
19
+
20
+ While some further pre-training will be good, it seems capable of generating coherent text as is.
21
+
22
+ ```yml
23
+ from transformers import AutoModelForCausalLM, AutoTokenizer
24
+
25
+ tokenizer = AutoTokenizer.from_pretrained(
26
+ "microsoft/Phi-3-small-8k-instruct", trust_remote_code=True
27
+ )
28
+ model = AutoModelForCausalLM.from_pretrained(
29
+ "pszemraj/Phi-3-small-8k-prune6", trust_remote_code=True
30
+ )
31
+ ```
32
+
33
  ## Merge Details
34
  ### Merge Method
35