Hugging Face's logo

Infermatic
/
Miquliz-120b-v2.0-FP8-dynamic

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
fp8
Model card Files Community
Svak commited on
Commit
aee883e
·
verified ·
1 Parent(s): 89d1e32

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -5,6 +5,8 @@ license: mit
5
  # Miquliz-120b-v2.0-FP8-dynamic
6
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6303ca537373aacccd85d8a7/vmCAhJCpF0dITtCVxlYET.jpeg)
7
 
 
 
8
  Dynamic FP8 quant of [Miquliz 120B v2.0](https://huggingface.co/wolfram/miquliz-120b-v2.0) made with AutoFP8.
9
 
10
  ## Model Details
 
5
  # Miquliz-120b-v2.0-FP8-dynamic
6
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6303ca537373aacccd85d8a7/vmCAhJCpF0dITtCVxlYET.jpeg)
7
 
8
+ This quant was made for [infermatic.ai](https://infermatic.ai/)
9
+
10
  Dynamic FP8 quant of [Miquliz 120B v2.0](https://huggingface.co/wolfram/miquliz-120b-v2.0) made with AutoFP8.
11
 
12
  ## Model Details