|
--- |
|
license: apache-2.0 |
|
library_name: transformers |
|
pipeline_tag: text-generation |
|
--- |
|
|
|
# Starling-LM-10.7B-beta |
|
|
|
This is Starling-LM-10.7B-beta, a depth-upscaled version of [Nexusflow/Starling-LM-7B-beta](https://huggingface.co/Nexusflow/Starling-LM-7B-beta). |
|
|
|
This model is intended to be used as a drop-in upgrade from the original 7 billion parameter model. |
|
|
|
# GGUF quantizations (courtesy of bartowski) |
|
See [bartowski/Starling-LM-10.7B-beta-GGUF](https://huggingface.co/bartowski/Starling-LM-10.7B-beta-GGUF) |
|
|
|
# ExLlamaV2 quantizations (courtesy of [blockblockblock](https://huggingface.co/blockblockblock)) |
|
- [2.5 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw2.5) |
|
- [3 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw3) |
|
- [3.5 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw3.5) |
|
- [3.7 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw3.7) |
|
- [4 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw4) |
|
- [4.4 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw4.4) |
|
- [4.6 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw4.6) |
|
- [4.8 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw4.8) |
|
- [5 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw5) |
|
- [5.5 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw5.5) |
|
- [6 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw6) |
