Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mosaicml
/
mpt-7b-8k-instruct
like
25
Text Generation
Transformers
PyTorch
competition_math
knkarthick/dialogsum
mosaicml/dolly_hhrlhf
duorc
emozilla/quality
scrolls/summ_screen_fd
spider
mpt
Composer
MosaicML
llm-foundry
custom_code
text-generation-inference
arxiv:
2205.14135
arxiv:
2108.12409
arxiv:
2010.04245
License:
apache-2.0
Model card
Files
Files and versions
Community
11
Train
Deploy
Use this model
refs/pr/6
mpt-7b-8k-instruct
/
fc.py
daking
LLM-foundry update October 17, 2023 23:04:30 (
#4
)
484f35e
9 months ago
raw
history
blame
No virus
167 Bytes
from
torch
import
nn
FC_CLASS_REGISTRY = {
'torch'
: nn.Linear}
try
:
import
transformer_engine.pytorch
as
te
FC_CLASS_REGISTRY[
'te'
] = te.Linear
except
:
pass