Add new GGMLv3 k-quant Falcon40B GGMLs

Files changed (10) hide show

wizard-falcon40b.ggmlv3.q2_K.bin ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:4dd279951cb4519e4e3af73b9dea03d9cb5efc1bd69561333b80b39c737c9d0c
+size 13735672992

wizard-falcon40b.ggmlv3.q3_K_L.bin ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:aca68f2e3bd483c0edf87e939fb209d9b43a67ef7af5784fefe0e655058b07bf
+size 17984439072

wizard-falcon40b.ggmlv3.q3_K_M.bin ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:2e2f883984b09e73046c0bf54e10b21b94c46afaadab267593e57f1c839e2dde
+size 17984439072

wizard-falcon40b.ggmlv3.q3_K_S.bin ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:208da603d43cf477acb54f0484efb8a2b471d88a3f64620f6eb86e565fb7df6d
+size 17984439072

wizard-falcon40b.ggmlv3.q4_K_M.bin ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:6ad1138ec1bd27d2e1fdcb64f34e6fc59f267bdd15727fbf65729f7d390ed912
+size 23540517792

wizard-falcon40b.ggmlv3.q4_K_S.bin ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:0b606070d5c66d73b5e925459ecfeee58c255170ed10e046407e1afcd07d52ed
+size 23540517792

wizard-falcon40b.ggmlv3.q5_K_M.bin ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:bd59a3df5bbb8bd86ea412b957eeffd237f38154234389dd19ded3f6e1050b55
+size 28769768352

wizard-falcon40b.ggmlv3.q5_K_S.bin ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:243875860c102ecbd0ffdbf55d1be7012a27d5bbda2d3b1393f338df1634bd98
+size 28769768352

wizard-falcon40b.ggmlv3.q6_K.bin ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:9513a03f3b906950402a9a135a4ce4e37a99f2f2acfa3e4fc8f884943bf3ab7a
+size 34325847072

wizard-falcon40b.ggmlv3.q8_0.bin ADDED Viewed

+version https://git-lfs.github.com/spec/v1
+oid sha256:98082dedfe0a7a881299a676e632d0b3fe5c26b3f97eb252279b88139e25b32e
+size 44457520032