mssma commited on
Commit
325f2ae
1 Parent(s): ee65a23

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -0
README.md ADDED
@@ -0,0 +1,22 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ language:
5
+ - ko
6
+ ---
7
+
8
+ # usage
9
+ ```
10
+
11
+ from transformers import AutoModelForCausalLM, AutoTokenizer
12
+ import torch
13
+
14
+ path = "mssma/ko-solar-10.7b-v0.6"
15
+ model = AutoModelForCausalLM.from_pretrained(
16
+ path,
17
+ return_dict=True,
18
+ torch_dtype=torch.float16,
19
+ device_map='auto'
20
+ )
21
+ tokenizer = AutoTokenizer.from_pretrained(path)
22
+ ```