Update README.md
Browse files
README.md
CHANGED
@@ -10,17 +10,15 @@ This is Starling-LM-10.7B-beta, a depth-upscaled version of [Nexusflow/Starling-
|
|
10 |
|
11 |
This model is intended to be used as a drop-in upgrade from the original 7 billion parameter model.
|
12 |
|
13 |
-
#
|
14 |
-
|
15 |
-
https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-
|
16 |
-
https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw3
|
17 |
-
https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw3.
|
18 |
-
https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-
|
19 |
-
https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw4
|
20 |
-
https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw4
|
21 |
-
https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw4.
|
22 |
-
https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-
|
23 |
-
https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-
|
24 |
-
https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-
|
25 |
-
https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw5.5
|
26 |
-
https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw6
|
|
|
10 |
|
11 |
This model is intended to be used as a drop-in upgrade from the original 7 billion parameter model.
|
12 |
|
13 |
+
# ExLlamaV2 quantizations (courtesy of [blockblockblock](https://huggingface.co/blockblockblock))
|
14 |
+
- [2.5 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw2.5)
|
15 |
+
- [3 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw3)
|
16 |
+
- [3.5 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw3.5)
|
17 |
+
- [3.7 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw3.7)
|
18 |
+
- [4 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw4)
|
19 |
+
- [4.4 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw4.4)
|
20 |
+
- [4.6 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw4.6)
|
21 |
+
- [4.8 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw4.8)
|
22 |
+
- [5 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw5)
|
23 |
+
- [5.5 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw5.5)
|
24 |
+
- [6 bpw](https://huggingface.co/blockblockblock/Starling-LM-10.7B-beta-bpw6)
|
|
|
|