PEFT
Safetensors
GGUF
mixtral
Generated from Trainer
rizla commited on
Commit
96b27c4
1 Parent(s): e5c30a9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -13,3 +13,18 @@ datasets:
13
 
14
 
15
  **qlora finetune of frankensteined rizla/rizla-17 model**
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
13
 
14
 
15
  **qlora finetune of frankensteined rizla/rizla-17 model**
16
+
17
+ The original Rizla models, already displaying promising multilingual capabilities, underwent multiple rounds of customization and optimizations to further enhance their versatility across languages. The process involves not only fine-tuned adjustments for better language comprehension but also strategic modifications to the underlying framework itself.
18
+
19
+ This continual refinement in response to specific requirements exemplifies a dynamic approach towards tackling natural language understanding tasks, where adaptability and flexibility are key factors contributing to performance improvements. In essence, these iterative advancements strive to bridge the gap between generalized pre-trained models and highly specialized applications.
20
+
21
+ ***To run a localhost 127.0.0.1:8080 server with llama.cpp do**
22
+
23
+ ```bash
24
+
25
+ wget https://huggingface.co/rizla/trrapi-16b/resolve/main/trrapi-q5km.gguf
26
+
27
+ git clone https://github.com/ggerganov/llama.cpp && cd llama.cpp && make -j
28
+
29
+ ./server -m ../trrapi-q5km.gguf --port 8080 -c 2000 -cb -t 8 -ngl 80
30
+ ```