Commit
•
a27f0c3
1
Parent(s):
4e8f877
"Update README.md"
Browse files
README.md
CHANGED
@@ -50,7 +50,7 @@ The core project making use of the ggml library is the [llama.cpp](https://githu
|
|
50 |
|
51 |
There is a bunch of quantized files available. How to choose the best for you:
|
52 |
|
53 |
-
#
|
54 |
|
55 |
Q4_0, Q4_1, Q5_0, Q5_1 and Q8 are `legacy` quantization types.
|
56 |
Nevertheless, they are fully supported, as there are several circumstances that cause certain model not to be compatible with the modern K-quants.
|
@@ -64,6 +64,7 @@ With a Q6_K you should find it really hard to find a quality difference to the o
|
|
64 |
|
65 |
|
66 |
|
|
|
67 |
# Original Model Card:
|
68 |
# ✨ Falcon-40B-Instruct
|
69 |
|
@@ -280,6 +281,7 @@ Falcon-40B-Instruct is made available under the Apache 2.0 license.
|
|
280 |
falconllm@tii.ae
|
281 |
|
282 |
***End of original Model File***
|
|
|
283 |
|
284 |
|
285 |
## Please consider to support my work
|
|
|
50 |
|
51 |
There is a bunch of quantized files available. How to choose the best for you:
|
52 |
|
53 |
+
# Legacy quants
|
54 |
|
55 |
Q4_0, Q4_1, Q5_0, Q5_1 and Q8 are `legacy` quantization types.
|
56 |
Nevertheless, they are fully supported, as there are several circumstances that cause certain model not to be compatible with the modern K-quants.
|
|
|
64 |
|
65 |
|
66 |
|
67 |
+
---
|
68 |
# Original Model Card:
|
69 |
# ✨ Falcon-40B-Instruct
|
70 |
|
|
|
281 |
falconllm@tii.ae
|
282 |
|
283 |
***End of original Model File***
|
284 |
+
---
|
285 |
|
286 |
|
287 |
## Please consider to support my work
|