Commit
•
5c6d3c6
1
Parent(s):
64af3b2
Update README.md
Browse files
README.md
CHANGED
|
@@ -1 +1,3 @@
|
|
| 1 |
-
Custom GGUF quants of Meta’s [Llama-3.2-3B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct), where the Output Tensors are quantized to Q8_0 or kept at F32, and the Embeddings are kept at F32. Enjoy! 🧠🔥🚀
|
|
|
|
|
|
|
|
|
| 1 |
+
Custom GGUF quants of Meta’s [Llama-3.2-3B-Instruct](https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct), where the Output Tensors are quantized to Q8_0 or kept at F32, and the Embeddings are kept at F32. Enjoy! 🧠🔥🚀
|
| 2 |
+
|
| 3 |
+
Notes: Great SMOL LLM for on-device inference for mobile devices. 😋
|