Update README.md
Browse files
README.md
CHANGED
@@ -8,10 +8,10 @@ These conversions are based off of the updated Pythia Deduped checkpoints, not t
|
|
8 |
|
9 |
Should be compatible with KoboldCpp. Perfect if you want to run them on low-end devices like a phone or Raspberry Pi.
|
10 |
|
11 |
-
**NOTE:** pythia-70m-deduped gave garbage output in my testing.
|
12 |
|
13 |
# RAM USAGE (koboldcpp):
|
14 |
-
Model |
|
15 |
:--:|:--:
|
16 |
ggml-pythia-70m-deduped-q4_3.bin | 121.2 MiB
|
17 |
ggml-pythia-160m-deduped-q4_3.bin | 225.2 MiB
|
@@ -19,4 +19,5 @@ ggml-pythia-410m-deduped-q4_3.bin | 498.1 MiB
|
|
19 |
ggml-pythia-1b-deduped-q4_3.bin | 951.5 MiB
|
20 |
ggml-pythia-1.4b-deduped-q4_3.bin | 1.3 GiB
|
21 |
ggml-pythia-2.8b-deduped-q4_3.bin | 2.4 GiB
|
22 |
-
ggml-pythia-6.9b-deduped-q4_3.bin | 5.4 GiB
|
|
|
|
8 |
|
9 |
Should be compatible with KoboldCpp. Perfect if you want to run them on low-end devices like a phone or Raspberry Pi.
|
10 |
|
11 |
+
**NOTE:** pythia-70m-deduped gave garbage output in my testing. 12B is currently being uploaded.
|
12 |
|
13 |
# RAM USAGE (koboldcpp):
|
14 |
+
Model | Initial RAM usage
|
15 |
:--:|:--:
|
16 |
ggml-pythia-70m-deduped-q4_3.bin | 121.2 MiB
|
17 |
ggml-pythia-160m-deduped-q4_3.bin | 225.2 MiB
|
|
|
19 |
ggml-pythia-1b-deduped-q4_3.bin | 951.5 MiB
|
20 |
ggml-pythia-1.4b-deduped-q4_3.bin | 1.3 GiB
|
21 |
ggml-pythia-2.8b-deduped-q4_3.bin | 2.4 GiB
|
22 |
+
ggml-pythia-6.9b-deduped-q4_3.bin | 5.4 GiB
|
23 |
+
ggml-pythia-12b-deduped-q4_3.bin | 9.2 GiB
|