README.md

metadata

tags:
  - endpoints-template
library_name: generic
duplicated_from: philschmid/gpt-j-6B-fp16-sharded

Shareded fp16 copy of EleutherAI/gpt-j-6B

This is fork of EleutherAI/gpt-j-6B with shareded fp16 weights implementing a custom handler.py as an example for how to use gpt-j inference-endpoints