Update README.md
Browse files
README.md
CHANGED
@@ -15,6 +15,21 @@ This is a layer-pruned language model created using [mergekit](https://github.co
|
|
15 |
|
16 |
![image](phi3small.png)
|
17 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
## Merge Details
|
19 |
### Merge Method
|
20 |
|
|
|
15 |
|
16 |
![image](phi3small.png)
|
17 |
|
18 |
+
## Usage
|
19 |
+
|
20 |
+
While some further pre-training will be good, it seems capable of generating coherent text as is.
|
21 |
+
|
22 |
+
```yml
|
23 |
+
from transformers import AutoModelForCausalLM, AutoTokenizer
|
24 |
+
|
25 |
+
tokenizer = AutoTokenizer.from_pretrained(
|
26 |
+
"microsoft/Phi-3-small-8k-instruct", trust_remote_code=True
|
27 |
+
)
|
28 |
+
model = AutoModelForCausalLM.from_pretrained(
|
29 |
+
"pszemraj/Phi-3-small-8k-prune6", trust_remote_code=True
|
30 |
+
)
|
31 |
+
```
|
32 |
+
|
33 |
## Merge Details
|
34 |
### Merge Method
|
35 |
|