Merry commited on
Commit
860e903
·
1 Parent(s): 9b7ef2f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -8,10 +8,10 @@ These conversions are based off of the updated Pythia Deduped checkpoints, not t
8
 
9
  Should be compatible with KoboldCpp. Perfect if you want to run them on low-end devices like a phone or Raspberry Pi.
10
 
11
- **NOTE:** pythia-70m-deduped gave garbage output in my testing.
12
 
13
  # RAM USAGE (koboldcpp):
14
- Model | Loaded RAM
15
  :--:|:--:
16
  ggml-pythia-70m-deduped-q4_3.bin | 121.2 MiB
17
  ggml-pythia-160m-deduped-q4_3.bin | 225.2 MiB
@@ -19,4 +19,5 @@ ggml-pythia-410m-deduped-q4_3.bin | 498.1 MiB
19
  ggml-pythia-1b-deduped-q4_3.bin | 951.5 MiB
20
  ggml-pythia-1.4b-deduped-q4_3.bin | 1.3 GiB
21
  ggml-pythia-2.8b-deduped-q4_3.bin | 2.4 GiB
22
- ggml-pythia-6.9b-deduped-q4_3.bin | 5.4 GiB
 
 
8
 
9
  Should be compatible with KoboldCpp. Perfect if you want to run them on low-end devices like a phone or Raspberry Pi.
10
 
11
+ **NOTE:** pythia-70m-deduped gave garbage output in my testing. 12B is currently being uploaded.
12
 
13
  # RAM USAGE (koboldcpp):
14
+ Model | Initial RAM usage
15
  :--:|:--:
16
  ggml-pythia-70m-deduped-q4_3.bin | 121.2 MiB
17
  ggml-pythia-160m-deduped-q4_3.bin | 225.2 MiB
 
19
  ggml-pythia-1b-deduped-q4_3.bin | 951.5 MiB
20
  ggml-pythia-1.4b-deduped-q4_3.bin | 1.3 GiB
21
  ggml-pythia-2.8b-deduped-q4_3.bin | 2.4 GiB
22
+ ggml-pythia-6.9b-deduped-q4_3.bin | 5.4 GiB
23
+ ggml-pythia-12b-deduped-q4_3.bin | 9.2 GiB