File size: 388 Bytes
9327b57
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
---
tags:
- endpoints-template
library_name: generic
---

# Shareded fp16 copy of [EleutherAI/gpt-j-6B](https://huggingface.co/EleutherAI/gpt-j-6B)

> This is fork of [EleutherAI/gpt-j-6B](https://huggingface.co/EleutherAI/gpt-j-6B) with shareded fp16 weights implementing a custom `handler.py` as an example for how to use `gpt-j` [inference-endpoints](https://hf.co/inference-endpoints)