lvkaokao commited on
Commit
8858d8a
1 Parent(s): 719ffc1

add model card.

Browse files
Files changed (1) hide show
  1. README.md +36 -0
README.md CHANGED
@@ -1,3 +1,39 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ tags:
4
+ - int8
5
+ - Intel® Neural Compressor
6
+ - PostTrainingStatic
7
+ datasets:
8
+ - mnli
9
+ metrics:
10
+ - accuracy
11
  ---
12
+
13
+ # INT8 T5 small finetuned on XSum
14
+
15
+ ### Post-training dynamic quantization
16
+
17
+ This is an INT8 PyTorch model quantized with [Intel® Neural Compressor](https://github.com/intel/neural-compressor).
18
+
19
+ The original fp32 model comes from the fine-tuned model [adasnew/t5-small-xsum](https://huggingface.co/adasnew/t5-small-xsum).
20
+
21
+ The calibration dataloader is the train dataloader. The default calibration sampling size 100 isn't divisible exactly by batch size 8, so the real sampling size is 104.
22
+
23
+ The linear modules **lm.head**, fall back to fp32 for less than 1% relative accuracy loss.
24
+
25
+ ### Evaluation result
26
+
27
+ | |INT8|FP32|
28
+ |---|:---:|:---:|
29
+ | **Accuracy (eval-rouge1)** | 29.9008 |29.9592|
30
+ | **Model size** |154M|242M|
31
+
32
+ ### Load with Intel® Neural Compressor:
33
+
34
+ ```python
35
+ from neural_compressor.utils.load_huggingface import OptimizedModel
36
+ int8_model = OptimizedModel.from_pretrained(
37
+ 'Intel/roberta-base-squad2-int8-static',
38
+ )
39
+ ```