Hugging Face's logo

brucethemoose
/
Yi-34B-200K-DARE-merge-v5-4bpw-exl2-fiction

Text Generation
Transformers
Safetensors
English
llama
text-generation-inference
Merge
Inference Endpoints
Model card Files Community
1
brucethemoose commited on
Commit
6bde89a
•
1 Parent(s): 8f0641c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -34,11 +34,11 @@ Being a Yi model, try running a lower temperature with 0.05-0.1 MinP, a little r
34
 
35
  ***
36
  ## Commands
37
- First pass:
38
  ```
39
  python convert.py --in_dir /home/alpha/FastModels/Yi-34B-200K-DARE-merge-v5 -o /home/alpha/FastModels/scratch -om /home/alpha/FastModels/v5.json --cal_dataset /home/alpha/Documents/smol.parquet -ml 32768 -mr 9 -ss 4096 -b 4.0 -hb 6 -nr
40
  ```
41
- Second pass:
42
  ```
43
  python convert.py --in_dir /home/alpha/FastModels/Yi-34B-200K-DARE-merge-v5 -o /home/alpha/FastModels/scratch -m /home/alpha/FastModels/v5.json --cal_dataset /home/alpha/Documents/medium.parquet -l 12288 -r 29 -ml 32768 -mr 9 -ss 4096 -b 4.0 -hb 6 -cf /home/alpha/FastModels/Yi-34B-200K-DARE-merge-v5-exl2-4bpw-fiction -nr
44
  ```
 
34
 
35
  ***
36
  ## Commands
37
+ First pass:
38
  ```
39
  python convert.py --in_dir /home/alpha/FastModels/Yi-34B-200K-DARE-merge-v5 -o /home/alpha/FastModels/scratch -om /home/alpha/FastModels/v5.json --cal_dataset /home/alpha/Documents/smol.parquet -ml 32768 -mr 9 -ss 4096 -b 4.0 -hb 6 -nr
40
  ```
41
+ Second pass:
42
  ```
43
  python convert.py --in_dir /home/alpha/FastModels/Yi-34B-200K-DARE-merge-v5 -o /home/alpha/FastModels/scratch -m /home/alpha/FastModels/v5.json --cal_dataset /home/alpha/Documents/medium.parquet -l 12288 -r 29 -ml 32768 -mr 9 -ss 4096 -b 4.0 -hb 6 -cf /home/alpha/FastModels/Yi-34B-200K-DARE-merge-v5-exl2-4bpw-fiction -nr
44
  ```