Update README.md
Browse files
README.md
CHANGED
@@ -46,9 +46,10 @@ For detailed benchmark results, including sub-categories and various metrics, pl
|
|
46 |
|
47 |
## GGUF and Quantizations
|
48 |
|
49 |
-
[Hermes-2-Pro-Mistral-7B-infinity-GGUF](https://huggingface.co/juvi21/Hermes-2-Pro-Mistral-7B-infinity-GGUF) is
|
50 |
- **F16** **Q8_0** **Q6_KQ5_K_M** **Q4_K_M** **Q3_K_M** **Q2_K**
|
51 |
-
|
|
|
52 |
## Usage
|
53 |
|
54 |
To use this model, you can load it using the Hugging Face Transformers library:
|
|
|
46 |
|
47 |
## GGUF and Quantizations
|
48 |
|
49 |
+
[Hermes-2-Pro-Mistral-7B-infinity-GGUF](https://huggingface.co/juvi21/Hermes-2-Pro-Mistral-7B-infinity-GGUF) is availabe in:
|
50 |
- **F16** **Q8_0** **Q6_KQ5_K_M** **Q4_K_M** **Q3_K_M** **Q2_K**
|
51 |
+
|
52 |
+
|
53 |
## Usage
|
54 |
|
55 |
To use this model, you can load it using the Hugging Face Transformers library:
|