AuriAetherwiing
commited on
Commit
•
325e4a5
1
Parent(s):
b786cf0
Update README.md
Browse files
README.md
CHANGED
@@ -28,6 +28,8 @@ model-index:
|
|
28 |
It uses Celeste 70B 0.1 data mixture, greatly expanding it to improve versatility, creativity and "flavor" of the resulting model.<br>
|
29 |
</p>
|
30 |
|
|
|
|
|
31 |
<p>Note: using quantized KV cache with Qwen2.5 <b>is not recommended</b> and can lead to degraded output quality. On the other hand, Qwen's KV cache is already light enough, so using f16 for it shouldn't be problematic.</p>
|
32 |
<p>Note #2: due to some unexepected effects of data normalization, some artifacting in form of randomly appearring sequence of <code>—</code> can appear in outputs sometimes, if penalties are too high. To avoid it, ban token number <code>158</code>. Thanks to Cahvay/ALK for discovering this fix.</p>
|
33 |
<p>
|
@@ -47,6 +49,7 @@ model-index:
|
|
47 |
- [Instruct and System Prompt](https://huggingface.co/EVA-UNIT-01/EVA-Yi-1.5-9B-32K-V1/blob/main/%5BChatML%5D%20Roleplay-v1.9%20Instruct.json)
|
48 |
</p>
|
49 |
|
|
|
50 |
<p>
|
51 |
<br>
|
52 |
<h3>
|
|
|
28 |
It uses Celeste 70B 0.1 data mixture, greatly expanding it to improve versatility, creativity and "flavor" of the resulting model.<br>
|
29 |
</p>
|
30 |
|
31 |
+
<p>Model is available for inference on <a href=https://featherless.ai/models/EVA-UNIT-01/EVA-Qwen2.5-72B-v0.0>Featherless.AI</a></p
|
32 |
+
|
33 |
<p>Note: using quantized KV cache with Qwen2.5 <b>is not recommended</b> and can lead to degraded output quality. On the other hand, Qwen's KV cache is already light enough, so using f16 for it shouldn't be problematic.</p>
|
34 |
<p>Note #2: due to some unexepected effects of data normalization, some artifacting in form of randomly appearring sequence of <code>—</code> can appear in outputs sometimes, if penalties are too high. To avoid it, ban token number <code>158</code>. Thanks to Cahvay/ALK for discovering this fix.</p>
|
35 |
<p>
|
|
|
49 |
- [Instruct and System Prompt](https://huggingface.co/EVA-UNIT-01/EVA-Yi-1.5-9B-32K-V1/blob/main/%5BChatML%5D%20Roleplay-v1.9%20Instruct.json)
|
50 |
</p>
|
51 |
|
52 |
+
|
53 |
<p>
|
54 |
<br>
|
55 |
<h3>
|