Upload README.md with huggingface_hub
Browse files
README.md
ADDED
@@ -0,0 +1,25 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
library_name: transformers
|
3 |
+
tags:
|
4 |
+
- llama-cpp
|
5 |
+
---
|
6 |
+
|
7 |
+
# Llama-3-ELYZA-JP-8B-GGUF
|
8 |
+
|
9 |
+
## Use with llama.cpp
|
10 |
+
Install llama.cpp through brew (works on Mac and Linux)
|
11 |
+
|
12 |
+
```bash
|
13 |
+
brew install llama.cpp
|
14 |
+
```
|
15 |
+
Invoke the llama.cpp server or the CLI.
|
16 |
+
|
17 |
+
### CLI:
|
18 |
+
```bash
|
19 |
+
llama --hf-repo elyza/Llama-3-ELYZA-JP-8B-GGUF --hf-file Llama-3-ELYZA-JP-8B-q4_k_m.gguf -p "鍙や唬銈儶銈枫儯銈掑銇朵笂銇х煡銇c仸銇娿亸銇广亶銉濄偆銉炽儓銇紵"
|
20 |
+
```
|
21 |
+
|
22 |
+
### Server:
|
23 |
+
```bash
|
24 |
+
llama-server --hf-repo elyza/Llama-3-ELYZA-JP-8B-GGUF --hf-file Llama-3-ELYZA-JP-8B-q4_k_m.gguf -c 2048
|
25 |
+
```
|