Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ENOT-AutoDL
/
gpt-j-6B-tensorrt-int8
like
7
Follow
ENOT AutoDL
10
Text Generation
Transformers
ONNX
lambada
English
text-generation-inference
causal-lm
int8
tensorrt
ENOT-AutoDL
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
2
Train
Deploy
Use this model
refs/pr/1
gpt-j-6B-tensorrt-int8
3 contributors
History:
7 commits
ivkalgin
fixed typos, updated model size values
ac04cb3
over 1 year ago
.gitattributes
1.52 kB
added engine for rtx3080ti
over 1 year ago
NVIDIA_GeForce_RTX_2080_Ti-8_5_3_1-i8f32.engine
8.5 GB
LFS
added 2080ti engine
over 1 year ago
NVIDIA_GeForce_RTX_3080_Ti-8_5_3_1-i8f32.engine
8.5 GB
LFS
normalized engine name
over 1 year ago
NVIDIA_GeForce_RTX_4090-8_5_3_1-i8f32.engine
8.5 GB
LFS
added 4090 engine
over 1 year ago
README.md
992 Bytes
fixed typos, updated model size values
over 1 year ago