Base Model : mosaicml/mpt-30b

Tool : MosaicML's llm-foundry (https://github.com/mosaicml/llm-foundry)

Dataset : Entire flan3m-GPT3.5 dataset.

Config yaml with Model Params : https://huggingface.co/iamplus/mpt-30b-v2/blob/main/mpt-30b_orca.yaml

Prompt Format :

<system>: [system prompt]

<human>: [question]

<bot>:
Downloads last month
10
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The HF Inference API does not support model that require custom code execution.

Dataset used to train iamplus/mpt-30b-v2