MaziyarPanahi
commited on
Commit
•
190468a
1
Parent(s):
e2c741e
Add GGUF link (#5)
Browse files- Add GGUF link (d4a0ca6271983fa119b450cd8ddbf3d25797f2fb)
README.md
CHANGED
@@ -42,7 +42,10 @@ model = AutoModelForCausalLM.from_pretrained("MaziyarPanahi/Calme-7B-Instruct-v0
|
|
42 |
|
43 |
### Quantized Models
|
44 |
|
45 |
-
|
|
|
|
|
|
|
46 |
|
47 |
## Examples
|
48 |
|
|
|
42 |
|
43 |
### Quantized Models
|
44 |
|
45 |
+
> I love how GGUF democratizes the use of Large Language Models (LLMs) on commodity hardware, more specifically, personal computers without any accelerated hardware. Because of this, I am committed to converting and quantizing any models I fine-tune to make them accessible to everyone!
|
46 |
+
|
47 |
+
GGUF (2/3/4/5/6/8 bits): [MaziyarPanahi/Calme-7B-Instruct-v0.1.1-GGUF](https://huggingface.co/MaziyarPanahi/Calme-7B-Instruct-v0.1.1-GGUF)
|
48 |
+
|
49 |
|
50 |
## Examples
|
51 |
|