Hugging Face's logo

HuggingFaceTB
/
SmolLM2-1.7B-Instruct

Text Generation
Transformers
TensorBoard
ONNX
Safetensors
Transformers.js
English
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
20
Xenova HF staff commited on
Commit
4f13109
•
1 Parent(s): 0919b6c

Fix q8 weights (use uint8 for q8; int8 produces poor results)

Browse files
Files changed (3) hide show
  1. onnx/model_int8.onnx +2 -2
  2. onnx/model_quantized.onnx +2 -2
  3. onnx/model_uint8.onnx +2 -2
onnx/model_int8.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b1565a301f0eb435ee8828ecb8144a3c04ffbac2a520a851741bea71e89f9a48
3
- size 1714133009
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8eeead8e191939562a98af969f9d63dd404dc72a9a65b2c19cabb857de7c8d9
3
+ size 1714133062
onnx/model_quantized.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b1565a301f0eb435ee8828ecb8144a3c04ffbac2a520a851741bea71e89f9a48
3
- size 1714133009
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e038fd6fb27b41fbb62e6a7df9b60b57215db3958d14382221beaab78fbc1d4
3
+ size 1714133130
onnx/model_uint8.onnx CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1603fd58bfd5272fd4658d2785720d6210343db2081c79ab73293a1ca1dbc47b
3
- size 1714133077
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e038fd6fb27b41fbb62e6a7df9b60b57215db3958d14382221beaab78fbc1d4
3
+ size 1714133130