--- license: apache-2.0 datasets: - togethercomputer/RedPajama-Data-1T language: - en pipeline_tag: text-generation tags: - sharded - bf16 - instruct --- # RedPajama-INCITE-7B-Base-sharded-bf16 This is the `togethercomputer/RedPajama-INCITE-7B-Base` model, but the model file(s) have been sharded to ~2GB each to ensure it can be loaded on low-RAM runtimes (like Colab). Please refer to the [original model card](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Base) for all details/issues w.r.t. to this model. - inference examples are also available on the original model card linked above. ---