Update README.md
Browse files
README.md
CHANGED
|
@@ -47,10 +47,12 @@ For detailed benchmark results, including sub-categories and various metrics, pl
|
|
| 47 |
|
| 48 |
## GGUF and Quantizations
|
| 49 |
|
|
|
|
| 50 |
[Hermes-2-Pro-Mistral-7B-infinity-GGUF](https://huggingface.co/juvi21/Hermes-2-Pro-Mistral-7B-infinity-GGUF) is availabe in:
|
| 51 |
- **F16** **Q8_0** **Q6_KQ5_K_M** **Q4_K_M** **Q3_K_M** **Q2_K**
|
| 52 |
|
| 53 |
|
|
|
|
| 54 |
## Usage
|
| 55 |
|
| 56 |
To use this model, you can load it using the Hugging Face Transformers library:
|
|
|
|
| 47 |
|
| 48 |
## GGUF and Quantizations
|
| 49 |
|
| 50 |
+
- llama.cpp [b3166](https://github.com/ggerganov/llama.cpp/releases/tag/b3166)
|
| 51 |
[Hermes-2-Pro-Mistral-7B-infinity-GGUF](https://huggingface.co/juvi21/Hermes-2-Pro-Mistral-7B-infinity-GGUF) is availabe in:
|
| 52 |
- **F16** **Q8_0** **Q6_KQ5_K_M** **Q4_K_M** **Q3_K_M** **Q2_K**
|
| 53 |
|
| 54 |
|
| 55 |
+
|
| 56 |
## Usage
|
| 57 |
|
| 58 |
To use this model, you can load it using the Hugging Face Transformers library:
|