apepkuss79
commited on
Commit
•
cdb23b8
1
Parent(s):
35eb726
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -71,7 +71,7 @@ language:
|
|
71 |
|
72 |
| Name | Quant method | Bits | Size | Use case |
|
73 |
| ---- | ---- | ---- | ---- | ----- |
|
74 |
-
| [Mistral-Large-Instruct-2407-Q2_K.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q2_K.gguf) | Q2_K | 2 | 2
|
75 |
| [Mistral-Large-Instruct-2407-Q3_K_L.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q3_K_L.gguf) | Q3_K_L | 3 | 3.83 GB| small, substantial quality loss |
|
76 |
| [Mistral-Large-Instruct-2407-Q3_K_M.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q3_K_M.gguf) | Q3_K_M | 3 | 3.52 GB| very small, high quality loss |
|
77 |
| [Mistral-Large-Instruct-2407-Q3_K_S.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q3_K_S.gguf) | Q3_K_S | 3 | 3.17 GB| very small, high quality loss |
|
|
|
71 |
|
72 |
| Name | Quant method | Bits | Size | Use case |
|
73 |
| ---- | ---- | ---- | ---- | ----- |
|
74 |
+
| [Mistral-Large-Instruct-2407-Q2_K.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q2_K.gguf) | Q2_K | 2 | 45.2 GB| smallest, significant quality loss - not recommended for most purposes |
|
75 |
| [Mistral-Large-Instruct-2407-Q3_K_L.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q3_K_L.gguf) | Q3_K_L | 3 | 3.83 GB| small, substantial quality loss |
|
76 |
| [Mistral-Large-Instruct-2407-Q3_K_M.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q3_K_M.gguf) | Q3_K_M | 3 | 3.52 GB| very small, high quality loss |
|
77 |
| [Mistral-Large-Instruct-2407-Q3_K_S.gguf](https://huggingface.co/second-state/Mistral-Large-Instruct-2407-GGUF/blob/main/Mistral-Large-Instruct-2407-Q3_K_S.gguf) | Q3_K_S | 3 | 3.17 GB| very small, high quality loss |
|