alvarobartt
/

notus-7b-v1-mlx-4bit

Text Generation

Model card Files Files and versions Community

alvarobartt HF staff commited on Dec 27, 2023

Commit

17c2498

•

1 Parent(s): ff18eec

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -8,7 +8,7 @@
     "norm_eps": 1e-05,
     "vocab_size": 32000,
     "sliding_window": 4096,
-    "quantization_config": {
         "group_size": 64,
         "bits": 4
     },

     "norm_eps": 1e-05,
     "vocab_size": 32000,
     "sliding_window": 4096,
+    "quantization": {
         "group_size": 64,
         "bits": 4
     },