---
license: apache-2.0
datasets:
- togethercomputer/RedPajama-Data-1T
language:
- en
pipeline_tag: text-generation
tags:
- sharded
- bf16
- instruct
---

# RedPajama-INCITE-7B-Base-sharded-bf16


This is the `togethercomputer/RedPajama-INCITE-7B-Base` model, but the model file(s) have been sharded to ~2GB each to ensure it can be loaded on low-RAM runtimes (like Colab).

Please refer to the [original model card](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) for all details/issues w.r.t. to this model. 
- inference examples are also available on the original model card linked above.
- [example colab notebook](https://colab.research.google.com/gist/pszemraj/d2f73ceaf4939bc55bdf5692cd0302d6/scratchpad.ipynb) covering the basics
---