Upload folder using huggingface_hub

#2
README.md CHANGED
@@ -1,13 +1,13 @@
1
- ---
2
- base_model: GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-test
3
- license: apache-2.0
4
- tags:
5
- - mlx
6
- ---
7
 
8
  # GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx
9
 
10
- This quantized low-bit model [GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx) was converted to MLX format from [`GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-test`](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0) using gbx-lm version **0.3.4**.
11
  Refer to the [original model card](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0) for more details on the model.
12
 
13
  ## Use with mlx
 
1
+ ---
2
+ base_model: GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0
3
+ license: apache-2.0
4
+ tags:
5
+ - mlx
6
+ ---
7
 
8
  # GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx
9
 
10
+ This quantized low-bit model [GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0-mlx) was converted to MLX format from [`GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0`](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0) using gbx-lm version **0.3.4**.
11
  Refer to the [original model card](https://huggingface.co/GreenBitAI/Llama-3.1-Nemotron-70B-Instruct-layer-mix-bpw-4.0) for more details on the model.
12
 
13
  ## Use with mlx
model-00001-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:29c33287e19285bab608e076255e3296e0086ff1f18c15482792a748719ccf76
3
  size 5366037748
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fff571e481b7144bf7faa8a3e34d9502857365e1595257cde3f620144d3d600f
3
  size 5366037748
model-00002-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:655ebf2689d01f98e2a6cf57df9008c3cdd1760b1591af04dbcc44a00e348d6a
3
  size 5253675996
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:828b025774c6797ab478fb7cb2154ad2148fff1ba527fc8c9456cb91ccc3ef51
3
  size 5253675996
model-00003-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ec6e39f1633c532a0e9def452c259917cdfbeaadc5742be5164d4d4d6b8725b1
3
  size 5333976637
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3a03bafa972d157b3221aef2993fb50ddd600aca425af977a72c3e71810458b
3
  size 5333976637
model-00004-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9d0185bce06229d4b141d62f08570d2ccf1ff8e4816b9eaee124b1adadb8371a
3
  size 5334058518
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c87cd17127e9fbf3ab66a1ae5f3845e110db0ebea404452e5b362f9edd07abad
3
  size 5334058518
model-00005-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c8872a3f6f272a6cc970273f8ec690a45316d8f22a16cf87c5702c6acb507561
3
  size 5253676013
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd1cd1f3cc01068100a6b1242775bed23171475ea95c2aa60c9cc4aa4d0245b0
3
  size 5253676013
model-00006-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:02258a5e24a97aa4f7a4e134f19627456f6e0cc857ee2241fa38ea54a89caf86
3
  size 5333976679
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a84fd497cce8df36b1212f2a389be57f405f0b40951d9b7b43bba852dc970a5f
3
  size 5333976679
model-00007-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7994b580cfbeab2eb1d4398d275a7e23a0bf90ca1428e9639cd4e3abcba31bd5
3
  size 5334058518
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:671d264c953c967fd6e877e822c3a37c6ac071154eb1f5b14860c1638f478b7d
3
  size 5334058518
model-00008-of-00008.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ada61dd265817735bfb1d3174978d45adbc1368ca9315b1ba20c5517d729797a
3
  size 3385731500
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5e72acc0ec794fdede30b92587457e6ce961f698922eecfe49b4e1b1f96c185b
3
  size 3385731500
quant_strategy.json CHANGED
@@ -7601,4 +7601,4 @@
7601
  }
7602
  }
7603
  }
7604
- }
 
7601
  }
7602
  }
7603
  }
7604
+ }