Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
PrunaAI
/
WizardLM-2-7B-GGUF-smashed
like
3
Follow
Pruna AI
137
GGUF
pruna-ai
Inference Endpoints
conversational
Model card
Files
Files and versions
Community
2
Deploy
Use this model
refs/pr/1
WizardLM-2-7B-GGUF-smashed
2 contributors
History:
22 commits
johnrachwanpruna
e2831ce9d8d8b3d1461100b88a073d0c5344135f04db9fd61584b29ae53f00bb
3ab54ff
verified
8 months ago
.gitattributes
Safe
2.87 kB
6ade10ac637fd19c05d4b046eafc3f28c38c877e29da133ba6dc32a9113840dc
8 months ago
README.md
Safe
12.1 kB
e2831ce9d8d8b3d1461100b88a073d0c5344135f04db9fd61584b29ae53f00bb
8 months ago
microsoft_WizardLM-2-7B.IQ3_M.gguf
Safe
3.28 GB
LFS
2befca1a07a468f9063e9e08006cc0bc30e50a68b2d4df1f8e230fbd513f2d5a
8 months ago
microsoft_WizardLM-2-7B.IQ3_S.gguf
Safe
3.18 GB
LFS
8cfb4d9750250c32899be0f313134ec784a40f04f1553258b43f4be878389f75
8 months ago
microsoft_WizardLM-2-7B.IQ3_XS.gguf
Safe
3.02 GB
LFS
1d5414afc699c11b8f02a4c98b1517ef6172d556a2be7faa9d2882771e42c4e1
8 months ago
microsoft_WizardLM-2-7B.IQ4_NL.gguf
Safe
4.16 GB
LFS
9b5fbb4db7cfd24c38977ff618123ebb9b3e33a7936dd61a287d8e823c28c503
8 months ago
microsoft_WizardLM-2-7B.IQ4_XS.gguf
Safe
3.94 GB
LFS
98d6c0af735e9ac9f89bebd7f4aea3bc65f26a010ccd6c67114a72c00eba9521
8 months ago
microsoft_WizardLM-2-7B.Q2_K.gguf
Safe
2.72 GB
LFS
63a863c48dda84756120d7a432686bdf58ab787851d415e2ec9263d3afc141a7
8 months ago
microsoft_WizardLM-2-7B.Q3_K_L.gguf
Safe
3.82 GB
LFS
2da95da32d278f7c1627d8c690050c16443091993e44c2c0b9c7ae7a821ee5aa
8 months ago
microsoft_WizardLM-2-7B.Q3_K_M.gguf
Safe
3.52 GB
LFS
ff8430e6875a9fd1fcc06124aa8e85ecff5c4ffacc355ce9de52ba08d6a4433c
8 months ago
microsoft_WizardLM-2-7B.Q3_K_S.gguf
Safe
3.16 GB
LFS
2ee10ca3c80c22ae0d67dadcff23f93d5e9a80c755784a11b3f30f6864b68557
8 months ago
microsoft_WizardLM-2-7B.Q4_0.gguf
Safe
4.11 GB
LFS
ba14a0ce99906cbd2fd9400537e401edc30a62440f46d302325ef21ddbff9494
8 months ago
microsoft_WizardLM-2-7B.Q4_1.gguf
Safe
4.55 GB
LFS
2dc167d2ca11632cb3672c4cc5ed8ba2dd9cc27feb93d02c751d4eb7f3b0501c
8 months ago
microsoft_WizardLM-2-7B.Q4_K_M.gguf
Safe
4.37 GB
LFS
447d974b332b9d43b8c9d7e0a954741aed42dc0ffb16da2a77afa4274b6b3384
8 months ago
microsoft_WizardLM-2-7B.Q4_K_S.gguf
Safe
4.14 GB
LFS
fd92ba04089d33b10c35605a2bcd358f589ef2989b00d388da0331702e0b4347
8 months ago
microsoft_WizardLM-2-7B.Q5_0.gguf
Safe
5 GB
LFS
8837fe5e157027c56258d65dfd42529f2516b53e2a080112ac0c3709bdf96bb7
8 months ago
microsoft_WizardLM-2-7B.Q5_1.gguf
Safe
5.44 GB
LFS
030d19120f313b86974b7b31f5fcdaa07d0d7f0faaa8267ed724d1c5ce423e7c
8 months ago
microsoft_WizardLM-2-7B.Q5_K_M.gguf
Safe
5.13 GB
LFS
c1a9d7591f0d976dca9e06f516fd7714ce899923267ec7c2553028cc9c0307aa
8 months ago
microsoft_WizardLM-2-7B.Q5_K_S.gguf
Safe
5 GB
LFS
fd1e8e31bef983b51162cd8f242bfdaa8d19e93554c652f722016a2780e84ad0
8 months ago
microsoft_WizardLM-2-7B.Q6_K.gguf
Safe
5.94 GB
LFS
b077fb17fdf6b6fd38cb8ff99de4b10fdea7cd09e6bab556d3d75c36136078ea
8 months ago
microsoft_WizardLM-2-7B.Q8_0.gguf
Safe
7.7 GB
LFS
6ade10ac637fd19c05d4b046eafc3f28c38c877e29da133ba6dc32a9113840dc
8 months ago
microsoft_WizardLM-2-7B.fp16.bin
Safe
14.5 GB
LFS
6db2ff41958013d5e9f5dcd020bd16e4adb40887aba4a7cecfee5e8014b82f8f
8 months ago