elvisAR commited on
Commit
0586dc5
·
1 Parent(s): 84e337c

feat: add llama2_7b

Browse files
Files changed (3) hide show
  1. README.md +30 -1
  2. llama2_7b_q80-tokenizer.bin +3 -0
  3. llama2_7b_q80.bin +3 -0
README.md CHANGED
@@ -3,4 +3,33 @@ base_model:
3
  - karpathy/tinyllamas
4
  ---
5
  This is a Llama 2 architecture model series quantized for use with [llama2.c](https://github.com/karpathy/llama2.c) project.
6
- This repository is not official llama2.c.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  - karpathy/tinyllamas
4
  ---
5
  This is a Llama 2 architecture model series quantized for use with [llama2.c](https://github.com/karpathy/llama2.c) project.
6
+ This repository is not official llama2.c.
7
+
8
+ Usage:
9
+ ```bash
10
+ ./runq ~/Data/GitHub/llama2.c-models/llama2_7b_q80.bin -z ~/Data/GitHub/llama2.c-models/llama2_7b_q80-tokenizer.bin -p 0.8 -n 0 -m chat
11
+ Enter system prompt (optional):
12
+ User: <s>[INST] Traduce a español lo siguiente "number of steps to run for, default 256."[/INST]
13
+ Assistant: El texto en español es:
14
+
15
+ Número de pasos para correr, predeterminado 256.
16
+
17
+ <s>
18
+ User: <s>[INST]Ahora traduce a chino[/INST]
19
+ Assistant: Sure! Here's the translation of "number of steps to run for, default 256" into Chinese:
20
+
21
+ 数 для,默认为256。
22
+
23
+ Here's a breakdown of the translation:
24
+
25
+ * 数 (bùshuate) - number of steps
26
+ * для (dòu) - for
27
+ * (pàojiǔ) - to run
28
+ * 默认 (mòdé) - default
29
+ * 256 (èr bā) - a specific number
30
+
31
+ I hope this helps! Let me know if you have any other questions.
32
+
33
+ <s>
34
+ User:
35
+ ```
llama2_7b_q80-tokenizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50a52ef822ee9e83de5ce9d0be0a025a773d019437f58b5ff9dcafb063ece361
3
+ size 433869
llama2_7b_q80.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bf687ddfdc4eb749e9a1d51b97110bb988fe3b4180901b290b22818bb505b97
3
+ size 7160348928