Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
tensorblock
/
Sheared-LLaMA-2.7B-Pruned-GGUF
like
0
Follow
TensorBlock
39
GGUF
TensorBlock
GGUF
Inference Endpoints
License:
llama2
Model card
Files
Files and versions
Community
Deploy
Use this model
main
Sheared-LLaMA-2.7B-Pruned-GGUF
1 contributor
History:
2 commits
morriszms
Upload folder using huggingface_hub
4dacd46
verified
23 days ago
.gitattributes
Safe
2.4 kB
Upload folder using huggingface_hub
23 days ago
README.md
Safe
5.01 kB
Upload folder using huggingface_hub
23 days ago
Sheared-LLaMA-2.7B-Pruned-Q2_K.gguf
Safe
1.03 GB
LFS
Upload folder using huggingface_hub
23 days ago
Sheared-LLaMA-2.7B-Pruned-Q3_K_L.gguf
Safe
1.45 GB
LFS
Upload folder using huggingface_hub
23 days ago
Sheared-LLaMA-2.7B-Pruned-Q3_K_M.gguf
Safe
1.33 GB
LFS
Upload folder using huggingface_hub
23 days ago
Sheared-LLaMA-2.7B-Pruned-Q3_K_S.gguf
Safe
1.19 GB
LFS
Upload folder using huggingface_hub
23 days ago
Sheared-LLaMA-2.7B-Pruned-Q4_0.gguf
Safe
1.54 GB
LFS
Upload folder using huggingface_hub
23 days ago
Sheared-LLaMA-2.7B-Pruned-Q4_K_M.gguf
Safe
1.64 GB
LFS
Upload folder using huggingface_hub
23 days ago
Sheared-LLaMA-2.7B-Pruned-Q4_K_S.gguf
Safe
1.55 GB
LFS
Upload folder using huggingface_hub
23 days ago
Sheared-LLaMA-2.7B-Pruned-Q5_0.gguf
Safe
1.87 GB
LFS
Upload folder using huggingface_hub
23 days ago
Sheared-LLaMA-2.7B-Pruned-Q5_K_M.gguf
Safe
1.92 GB
LFS
Upload folder using huggingface_hub
23 days ago
Sheared-LLaMA-2.7B-Pruned-Q5_K_S.gguf
Safe
1.87 GB
LFS
Upload folder using huggingface_hub
23 days ago
Sheared-LLaMA-2.7B-Pruned-Q6_K.gguf
2.22 GB
LFS
Upload folder using huggingface_hub
23 days ago
Sheared-LLaMA-2.7B-Pruned-Q8_0.gguf
2.87 GB
LFS
Upload folder using huggingface_hub
23 days ago