Hugging Face's logo

abacaj
/
llama-161M-100B

Text Generation
Transformers
ONNX
Safetensors
llama
text-generation-inference
Inference Endpoints
Model card Files Community
2

Upload ONNX weights

#1
by Xenova HF staff - opened
base: refs/heads/main
←
from: refs/pr/1
Discussion Files changed
+21
-0
Files changed (7) hide show
  1. onnx/model.onnx +3 -0
  2. onnx/model_bnb4.onnx +3 -0
  3. onnx/model_fp16.onnx +3 -0
  4. onnx/model_int8.onnx +3 -0
  5. onnx/model_q4.onnx +3 -0
  6. onnx/model_quantized.onnx +3 -0
  7. onnx/model_uint8.onnx +3 -0
onnx/model.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7b6f6e6d65a230a5c244cc2d6c0136bad79b7277cb8d8ed44b9fb3c9141e4e3
3
+ size 649305944
onnx/model_bnb4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19018cab0519a03e6495295d3f9099c7d4059bf42e62ea896f4b1731b12c5a06
3
+ size 191212298
onnx/model_fp16.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbc5f810b16b817c90d4e2212244845ca68c9c34e654a062ee132426594c3b2f
3
+ size 325390344
onnx/model_int8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f572872638e9c04e7f0da3dd45602c00654c45500975cf34d144c1568e2e4e2f
3
+ size 163579850
onnx/model_q4.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9fed3fa3e3a222ef99615044f132f02e4f987220e06d3e279b744563cd75945
3
+ size 199540860
onnx/model_quantized.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f572872638e9c04e7f0da3dd45602c00654c45500975cf34d144c1568e2e4e2f
3
+ size 163579850
onnx/model_uint8.onnx ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d439ba51ad03b67dbfbca70aefd04f4097fa31f1686bd38d3a42e4f282bb1de3
3
+ size 163579899