3Simplex commited on
Commit
8524f64
·
verified ·
1 Parent(s): bdf834b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -3
README.md CHANGED
@@ -1,3 +1,34 @@
1
- ---
2
- license: llama3.1
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: llama3.1
3
+ base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
4
+ pipeline_tag: text-generation
5
+ tags:
6
+ - text-generation-inference
7
+ ---
8
+ > [!NOTE]
9
+ > The new release of llama.cpp and transformers have been applied and the gguf was tested.
10
+ > GPT4All v3.1.1 required.
11
+
12
+ Model converted and quantized by: [3Simplex](https://huggingface.co/3Simplex)
13
+
14
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/645e666bb5c9a8666d0d99c5/9T9q6k90ZGa5EJKeSMbru.png)
15
+
16
+
17
+ ## Prompt Template
18
+
19
+ ```
20
+ <|start_header_id|>system<|end_header_id|>
21
+
22
+ {system_prompt}<|eot_id|>
23
+ ```
24
+
25
+ ```
26
+ <|start_header_id|>user<|end_header_id|>
27
+
28
+ {user_input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
29
+
30
+ {assistant_response}
31
+ ```
32
+
33
+ ## 128k Context Length
34
+ "llama.context_length": 131072