ENOT-AutoDL
/

gpt-j-6B-tensorrt-int8

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

agoncharenko1992 commited on Mar 30, 2023

Commit

4231dbc

•

1 Parent(s): 23da18b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ tags:
 GPT-J 6B is a transformer model trained using Ben Wang's [Mesh Transformer JAX](https://github.com/kingoflolz/mesh-transformer-jax/). "GPT-J" refers to the class of model, while "6B" represents the number of trainable parameters.
-This repository contains TensorRT engines with mixed precission int8 + fp32. You can find prebuilt engines for next GPUs:
 * RTX 4090
 * RTX 3080 Ti
 * RTX 2080 Ti

 GPT-J 6B is a transformer model trained using Ben Wang's [Mesh Transformer JAX](https://github.com/kingoflolz/mesh-transformer-jax/). "GPT-J" refers to the class of model, while "6B" represents the number of trainable parameters.
+This repository contains TensorRT engines with mixed precission int8 + fp32. You can find prebuilt engines for the following GPUs:
 * RTX 4090
 * RTX 3080 Ti
 * RTX 2080 Ti