Add quant links (#6)
Browse files- Add quant links (dcf94cb5e61027ba88c41489cd852c622738a892)
Co-authored-by: Bartowski <bartowski@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -181,6 +181,12 @@ tokens:
|
|
| 181 |
|
| 182 |
</details><br>
|
| 183 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 184 |
## Training procedure
|
| 185 |
|
| 186 |
### Training hyperparameters
|
|
|
|
| 181 |
|
| 182 |
</details><br>
|
| 183 |
|
| 184 |
+
## Quants
|
| 185 |
+
|
| 186 |
+
GGUF with imatrix: https://huggingface.co/bartowski/dolphin-2.9-llama3-8b-GGUF
|
| 187 |
+
|
| 188 |
+
Exllamav2: https://huggingface.co/bartowski/dolphin-2.9-llama3-8b-exl2
|
| 189 |
+
|
| 190 |
## Training procedure
|
| 191 |
|
| 192 |
### Training hyperparameters
|