Hugging Face's logo

ENOT-AutoDL
/
gpt-j-6B-tensorrt-int8

Text Generation
Transformers
ONNX
English
text-generation-inference
causal-lm
int8
tensorrt
ENOT-AutoDL
Inference Endpoints
Model card Files Community
2
ivkalgin commited on
Commit
ca37425
•
1 Parent(s): 8912b4c

added engine for rtx3080ti

Browse files
Files changed (2) hide show
  1. .gitattributes +1 -0
  2. rtx3080ti_trt8-5-3-1_i8f32.engine +3 -0
.gitattributes CHANGED
@@ -3,6 +3,7 @@
3
  *.bin filter=lfs diff=lfs merge=lfs -text
4
  *.bz2 filter=lfs diff=lfs merge=lfs -text
5
  *.ckpt filter=lfs diff=lfs merge=lfs -text
 
6
  *.ftz filter=lfs diff=lfs merge=lfs -text
7
  *.gz filter=lfs diff=lfs merge=lfs -text
8
  *.h5 filter=lfs diff=lfs merge=lfs -text
 
3
  *.bin filter=lfs diff=lfs merge=lfs -text
4
  *.bz2 filter=lfs diff=lfs merge=lfs -text
5
  *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.engine filter=lfs diff=lfs merge=lfs -text
7
  *.ftz filter=lfs diff=lfs merge=lfs -text
8
  *.gz filter=lfs diff=lfs merge=lfs -text
9
  *.h5 filter=lfs diff=lfs merge=lfs -text
rtx3080ti_trt8-5-3-1_i8f32.engine ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1302801d16eab45d9cdfb2b0b974b008c1313e3cfcea6165a466af1110392b3b
3
+ size 8498486583