Hugging Face's logo

l3utterfly
/
phi-2-layla-v1-chatml-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
l3utterfly commited on
Commit
1adedec
·
1 Parent(s): fe1c07f

Add quantised GGUF files

Browse files
Files changed (4) hide show
  1. phi-2-layla-v1-chatml-Q4_0_4_4.gguf +3 -0
  2. phi-2-layla-v1-chatml-Q4_0_4_8.gguf +3 -0
  3. phi-2-layla-v1-chatml-Q4_0_8_8.gguf +3 -0
  4. phi-2-layla-v1-chatml-Q4_K_M.gguf +3 -0
phi-2-layla-v1-chatml-Q4_0_4_4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ff8523404b11858961c7f895518d4f21ecb1bdf7d3e533d2c68ac71dc832a04
3
+ size 1602468672
phi-2-layla-v1-chatml-Q4_0_4_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66373f880777e534084df25dafc83e34587c2fa210e79240f550e3694769d9ad
3
+ size 1602468672
phi-2-layla-v1-chatml-Q4_0_8_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41f87551e2c01282d3cbd131e461318395281b111095fdcc18ffe9460d55df63
3
+ size 1602468672
phi-2-layla-v1-chatml-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a22468c54c14cc1d30f4fa28c71b90edde135bbd30d27ef3b230b465cdddad0
3
+ size 1737636672