Update README.md
Browse files
README.md
CHANGED
|
@@ -22,7 +22,7 @@ tags:
|
|
| 22 |
## EXL2 Quantization
|
| 23 |
|
| 24 |
This is a 4.0bpw, h6 exl2 quant of the Llama 3.1 model. Big thanks to turboderp and grimulkan for their assistance.
|
| 25 |
-
measurements.json is also included for those that want to make their own quants.
|
| 26 |
|
| 27 |
Compute for this quantization provided under the NSF NAIRR Pilot program under resource allocation, NAIRR240051 - Neuro-inspired Oversight for Safe and Trustworthy Large Language Models
|
| 28 |
|
|
|
|
| 22 |
## EXL2 Quantization
|
| 23 |
|
| 24 |
This is a 4.0bpw, h6 exl2 quant of the Llama 3.1 model. Big thanks to turboderp and grimulkan for their assistance.
|
| 25 |
+
measurements.json is also included for those that want to make their own quants. By utilizing these quants, you agree to abide by the terms and conditions of the original model.
|
| 26 |
|
| 27 |
Compute for this quantization provided under the NSF NAIRR Pilot program under resource allocation, NAIRR240051 - Neuro-inspired Oversight for Safe and Trustworthy Large Language Models
|
| 28 |
|