legraphista
commited on
Commit
β’
5c0303b
1
Parent(s):
d73184b
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -52,7 +52,7 @@ IMatrix dataset: [here](https://gist.githubusercontent.com/bartowski1182/eb213dc
|
|
52 |
| [Llama-3.1-Minitron-4B-Width-Base.Q6_K.gguf](https://huggingface.co/legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF/blob/main/Llama-3.1-Minitron-4B-Width-Base.Q6_K.gguf) | Q6_K | 3.71GB | β
Available | βͺ Static | π¦ No
|
53 |
| [Llama-3.1-Minitron-4B-Width-Base.Q4_K.gguf](https://huggingface.co/legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF/blob/main/Llama-3.1-Minitron-4B-Width-Base.Q4_K.gguf) | Q4_K | 2.78GB | β
Available | βͺ Static | π¦ No
|
54 |
| [Llama-3.1-Minitron-4B-Width-Base.Q3_K.gguf](https://huggingface.co/legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF/blob/main/Llama-3.1-Minitron-4B-Width-Base.Q3_K.gguf) | Q3_K | 2.30GB | β
Available | βͺ Static | π¦ No
|
55 |
-
| Llama-3.1-Minitron-4B-Width-Base.Q2_K | Q2_K |
|
56 |
|
57 |
|
58 |
### All Quants
|
@@ -74,7 +74,7 @@ IMatrix dataset: [here](https://gist.githubusercontent.com/bartowski1182/eb213dc
|
|
74 |
| Llama-3.1-Minitron-4B-Width-Base.IQ3_M | IQ3_M | - | β³ Processing | βͺ Static | -
|
75 |
| Llama-3.1-Minitron-4B-Width-Base.IQ3_S | IQ3_S | - | β³ Processing | βͺ Static | -
|
76 |
| Llama-3.1-Minitron-4B-Width-Base.IQ3_XS | IQ3_XS | - | β³ Processing | βͺ Static | -
|
77 |
-
| Llama-3.1-Minitron-4B-Width-Base.Q2_K | Q2_K |
|
78 |
|
79 |
|
80 |
## Downloading using huggingface-cli
|
|
|
52 |
| [Llama-3.1-Minitron-4B-Width-Base.Q6_K.gguf](https://huggingface.co/legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF/blob/main/Llama-3.1-Minitron-4B-Width-Base.Q6_K.gguf) | Q6_K | 3.71GB | β
Available | βͺ Static | π¦ No
|
53 |
| [Llama-3.1-Minitron-4B-Width-Base.Q4_K.gguf](https://huggingface.co/legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF/blob/main/Llama-3.1-Minitron-4B-Width-Base.Q4_K.gguf) | Q4_K | 2.78GB | β
Available | βͺ Static | π¦ No
|
54 |
| [Llama-3.1-Minitron-4B-Width-Base.Q3_K.gguf](https://huggingface.co/legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF/blob/main/Llama-3.1-Minitron-4B-Width-Base.Q3_K.gguf) | Q3_K | 2.30GB | β
Available | βͺ Static | π¦ No
|
55 |
+
| [Llama-3.1-Minitron-4B-Width-Base.Q2_K.gguf](https://huggingface.co/legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF/blob/main/Llama-3.1-Minitron-4B-Width-Base.Q2_K.gguf) | Q2_K | 1.84GB | β
Available | βͺ Static | π¦ No
|
56 |
|
57 |
|
58 |
### All Quants
|
|
|
74 |
| Llama-3.1-Minitron-4B-Width-Base.IQ3_M | IQ3_M | - | β³ Processing | βͺ Static | -
|
75 |
| Llama-3.1-Minitron-4B-Width-Base.IQ3_S | IQ3_S | - | β³ Processing | βͺ Static | -
|
76 |
| Llama-3.1-Minitron-4B-Width-Base.IQ3_XS | IQ3_XS | - | β³ Processing | βͺ Static | -
|
77 |
+
| [Llama-3.1-Minitron-4B-Width-Base.Q2_K.gguf](https://huggingface.co/legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF/blob/main/Llama-3.1-Minitron-4B-Width-Base.Q2_K.gguf) | Q2_K | 1.84GB | β
Available | βͺ Static | π¦ No
|
78 |
|
79 |
|
80 |
## Downloading using huggingface-cli
|