Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

AetherArchitectural
/

GGUF-Quantization-Script

Text Generation

text-generation-inference

Model card Files Files and versions Community

GGUF-Quantization-Script

5 contributors

History: 30 commits

FantasiaFoundry's picture

FantasiaFoundry

Fix lines.

b6bbbe0 verified 7 months ago

imatrix
Upload 2 files 9 months ago
.gitattributes

1.52 kB

initial commit 9 months ago
README.md

2.56 kB

Fix lines. 7 months ago
gguf-imat.py

8.33 kB

Add checks for F16.gguf and imatrix.dat, as well make HF model removal optional by default. (#11) 7 months ago