nisten commited on
Commit
ea0a077
1 Parent(s): e32490b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -2
README.md CHANGED
@@ -2,12 +2,16 @@
2
  base_model: HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1
3
  license: apache-2.0
4
  ---
5
- ## Alex, download the 3bit orpo3ns.gguf.part0 & orpo3ns.gguf.part1 files then:
 
6
  ```
7
  cd ~/Downloads
8
 
9
- cat orpo3ns.gguf.part* > orpo3ns.gguf && rm -rf orpo3ns.gguf.part*
10
 
 
 
 
11
  ```
12
 
13
  For lmStudio you need to copy the full orpo3ns.gguf file to your ~/.cache/lm-studio/models/YourNAME/
 
2
  base_model: HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1
3
  license: apache-2.0
4
  ---
5
+ ## MAKE SURE TO MERGE TOGETHER THE TWO PARTS AFTER DOWNLOADING OR IT WONT WORK
6
+ ## I.e. Download the 3bit orpo3ns.gguf.part0 & orpo3ns.gguf.part1 files then:
7
  ```
8
  cd ~/Downloads
9
 
10
+ cat orpo3ns.gguf.part* > orpo3ns.gguf
11
 
12
+ cd llamacppFolderLocaltion
13
+
14
+ ./server -m ~/Downloads/orpor3ns.gguf -ngl 56
15
  ```
16
 
17
  For lmStudio you need to copy the full orpo3ns.gguf file to your ~/.cache/lm-studio/models/YourNAME/