Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
PrunaAI
/
WizardLM-2-7B-GGUF-smashed
like
3
GGUF
pruna-ai
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
2
Deploy
Use this model
7fe8097
WizardLM-2-7B-GGUF-smashed
2 contributors
History:
11 commits
johnrachwanpruna
ba14a0ce99906cbd2fd9400537e401edc30a62440f46d302325ef21ddbff9494
7fe8097
verified
6 months ago
.gitattributes
2.23 kB
ba14a0ce99906cbd2fd9400537e401edc30a62440f46d302325ef21ddbff9494
6 months ago
microsoft_WizardLM-2-7B.IQ3_M.gguf
3.28 GB
LFS
2befca1a07a468f9063e9e08006cc0bc30e50a68b2d4df1f8e230fbd513f2d5a
6 months ago
microsoft_WizardLM-2-7B.IQ3_S.gguf
3.18 GB
LFS
8cfb4d9750250c32899be0f313134ec784a40f04f1553258b43f4be878389f75
6 months ago
microsoft_WizardLM-2-7B.IQ3_XS.gguf
3.02 GB
LFS
1d5414afc699c11b8f02a4c98b1517ef6172d556a2be7faa9d2882771e42c4e1
6 months ago
microsoft_WizardLM-2-7B.IQ4_NL.gguf
4.16 GB
LFS
9b5fbb4db7cfd24c38977ff618123ebb9b3e33a7936dd61a287d8e823c28c503
6 months ago
microsoft_WizardLM-2-7B.IQ4_XS.gguf
3.94 GB
LFS
98d6c0af735e9ac9f89bebd7f4aea3bc65f26a010ccd6c67114a72c00eba9521
6 months ago
microsoft_WizardLM-2-7B.Q2_K.gguf
2.72 GB
LFS
63a863c48dda84756120d7a432686bdf58ab787851d415e2ec9263d3afc141a7
6 months ago
microsoft_WizardLM-2-7B.Q3_K_L.gguf
3.82 GB
LFS
2da95da32d278f7c1627d8c690050c16443091993e44c2c0b9c7ae7a821ee5aa
6 months ago
microsoft_WizardLM-2-7B.Q3_K_M.gguf
3.52 GB
LFS
ff8430e6875a9fd1fcc06124aa8e85ecff5c4ffacc355ce9de52ba08d6a4433c
6 months ago
microsoft_WizardLM-2-7B.Q3_K_S.gguf
3.16 GB
LFS
2ee10ca3c80c22ae0d67dadcff23f93d5e9a80c755784a11b3f30f6864b68557
6 months ago
microsoft_WizardLM-2-7B.Q4_0.gguf
4.11 GB
LFS
ba14a0ce99906cbd2fd9400537e401edc30a62440f46d302325ef21ddbff9494
6 months ago
