PrunaAI
/

phi-2-GGUF-smashed

Inference Endpoints

Model card Files Files and versions Community

phi-2-GGUF-smashed

2 contributors

History: 13 commits

johnrachwanpruna's picture

johnrachwanpruna

7eeeda83547c0cd613429cd1fb317639ecaa9188e031e4989213d04b8c955ef6

2fbfbea verified 7 months ago

.gitattributes

2.16 kB

7eeeda83547c0cd613429cd1fb317639ecaa9188e031e4989213d04b8c955ef6 7 months ago
phi-2.Q2_K.gguf

1.11 GB
LFS

02e328382a1ecc8bc729207e9170213656255864a2e7857f6a7b29987df6ee9e 7 months ago
phi-2.Q3_K_L.gguf

1.58 GB
LFS

59c7fd06bc49d2924c650672cad7f8b775f817e7b41fd73887209ace09adc749 7 months ago
phi-2.Q3_K_M.gguf

1.43 GB
LFS

3fb336fb15aa3f774b3ce91bfd633d6b347cb8c25cdd20d71cb890f604a2462d 7 months ago
phi-2.Q3_K_S.gguf

1.25 GB
LFS

6750b882e8865222d55a89645a93c5a4d2133c020337a05354219d58b8a060d4 7 months ago
phi-2.Q4_0.gguf

1.6 GB
LFS

deb9980e6f2b6032aa0b35d578acd2011ff69ad32393aa72036f3ee0b1d893c7 7 months ago
phi-2.Q4_1.gguf

1.77 GB
LFS

1d5486e8767ed88798a962684e233965587aa798b24b88c83e88b287dddf09fb 7 months ago
phi-2.Q4_K_M.gguf

1.74 GB
LFS

214ded5aad34698b51129e92aa16a86fc54a70ec64a5f8710ea4ab6730e65cd7 7 months ago
phi-2.Q4_K_S.gguf

1.62 GB
LFS

95882c33a01d650bf7b92f976ae738b259db6fd77a49ca1bc245c045b83f0cb8 7 months ago
phi-2.Q5_0.gguf

1.93 GB
LFS

7f326441df8364363eb10e8b53eb961c1a958998fff86e41bd97550925d0f6d7 7 months ago
phi-2.Q5_1.gguf

2.1 GB
LFS

e6e59c350402bf5edb612db9801c7149ab2c1f867870538cb7f17681c94c8da1 7 months ago
phi-2.Q5_K_M.gguf

2 GB
LFS

06ef4bdea480639a5dba5b6d54a29dc0f617ec206ddf17e3bfbe413364cda8b6 7 months ago
phi-2.Q6_K.gguf

2.29 GB
LFS

7eeeda83547c0cd613429cd1fb317639ecaa9188e031e4989213d04b8c955ef6 7 months ago