Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
ikawrakow
/
various-2bit-sota-gguf
like
80
GGUF
Inference Endpoints
License:
apache-2.0
Model card
Files
Files and versions
Community
13
Deploy
Use this model
ikawrakow
commited on
Jan 5
Commit
5c2dcb5
•
1 Parent(s):
7790dee
Update README.md
Browse files
Files changed (1)
hide
show
README.md
+1
-0
README.md
CHANGED
Viewed
@@ -1,3 +1,4 @@
1
---
2
license: apache-2.0
3
---
1
---
2
license: apache-2.0
3
---
4
+
Various models in GGUF format quantized with a new 2-bit approach. Intended for use with llama.cpp. Requires llama.cpp PR 4773.