Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mosaicml
/
mpt-30b-instruct
like
100
Text Generation
Transformers
PyTorch
9 datasets
mpt
Composer
MosaicML
llm-foundry
custom_code
text-generation-inference
arxiv:
2205.14135
arxiv:
2108.12409
License:
apache-2.0
Model card
Files
Files and versions
Community
19
Train
Deploy
Use this model
56bcbea
mpt-30b-instruct
/
fc.py
daking
LLM-foundry update October 17, 2023 23:04:30 (
#11
)
7dda9b2
11 months ago
raw
Copy download link
history
blame
No virus
167 Bytes
from
torch
import
nn
FC_CLASS_REGISTRY = {
'torch'
: nn.Linear}
try
:
import
transformer_engine.pytorch
as
te
FC_CLASS_REGISTRY[
'te'
] = te.Linear
except
:
pass