Commit
•
70ec206
1
Parent(s):
a062fc5
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
**GGUF quantizations for [Test157t/Prima-LelantaclesV4-7b-16k](https://huggingface.co/Test157t/Prima-LelantaclesV4-7b-16k).**
|
| 2 |
|
| 3 |
*If you want any specific quantization to be added, feel free to ask.*
|
|
@@ -27,4 +35,4 @@ parameters:
|
|
| 27 |
value: [1, 0.5, 0.7, 0.3, 0]
|
| 28 |
- value: 0.5
|
| 29 |
dtype: bfloat16
|
| 30 |
-
```
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: transformers
|
| 3 |
+
pipeline_tag: text-generation
|
| 4 |
+
tags:
|
| 5 |
+
- text-generation-inference
|
| 6 |
+
- mistral
|
| 7 |
+
- quantized
|
| 8 |
+
---
|
| 9 |
**GGUF quantizations for [Test157t/Prima-LelantaclesV4-7b-16k](https://huggingface.co/Test157t/Prima-LelantaclesV4-7b-16k).**
|
| 10 |
|
| 11 |
*If you want any specific quantization to be added, feel free to ask.*
|
|
|
|
| 35 |
value: [1, 0.5, 0.7, 0.3, 0]
|
| 36 |
- value: 0.5
|
| 37 |
dtype: bfloat16
|
| 38 |
+
```
|