Commit
•
df37fba
1
Parent(s):
2707b68
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
A simple (ie, I don't really know what I'm doing) 8bit quant of
|
| 2 |
+
|
| 3 |
+
cognitivecomputations/dolphin-2.9.1-yi-1.5-34b
|
| 4 |
+
|
| 5 |
+
python3 convert.py -i ../models/dolphin-2.9.1-yi-1.5-34b -o dolphin-2.9.1-yi-1.5-34b -cf dolphin-2.9.1-yi-1.5-34b -l 2048 -b 8.0 -hb 8 -ss 8192
|