shaowenchen
/

longchat-13b-16k-gguf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

longchat-13b-16k-gguf

2 contributors

History: 16 commits

shaowenchen's picture

add ./longchat-13b-16k.Q6_K.gguf

251f0fb about 1 year ago

.gitattributes

1.56 kB

add meta files about 1 year ago
README.md

2.09 kB

add meta files about 1 year ago
configuration.json

191 Bytes

add meta files about 1 year ago
longchat-13b-16k.Q2_K.gguf

5.43 GB
LFS

add ./longchat-13b-16k.Q2_K.gguf about 1 year ago
longchat-13b-16k.Q3_K.gguf

6.34 GB
LFS

add ./longchat-13b-16k.Q3_K.gguf about 1 year ago
longchat-13b-16k.Q3_K_L.gguf

6.93 GB
LFS

add ./longchat-13b-16k.Q3_K_L.gguf about 1 year ago
longchat-13b-16k.Q3_K_S.gguf

5.66 GB
LFS

add ./longchat-13b-16k.Q3_K_S.gguf about 1 year ago
longchat-13b-16k.Q4_0.gguf

7.37 GB
LFS

add ./longchat-13b-16k.Q4_0.gguf about 1 year ago
longchat-13b-16k.Q4_1.gguf

8.17 GB
LFS

add ./longchat-13b-16k.Q4_1.gguf about 1 year ago
longchat-13b-16k.Q4_K.gguf

7.87 GB
LFS

add ./longchat-13b-16k.Q4_K.gguf about 1 year ago
longchat-13b-16k.Q4_K_S.gguf

7.41 GB
LFS

add ./longchat-13b-16k.Q4_K_S.gguf about 1 year ago
longchat-13b-16k.Q5_0.gguf

8.97 GB
LFS

add ./longchat-13b-16k.Q5_0.gguf about 1 year ago
longchat-13b-16k.Q5_1.gguf

9.78 GB
LFS

add ./longchat-13b-16k.Q5_1.gguf about 1 year ago
longchat-13b-16k.Q5_K.gguf

9.23 GB
LFS

add ./longchat-13b-16k.Q5_K.gguf about 1 year ago
longchat-13b-16k.Q5_K_S.gguf

8.97 GB
LFS

add ./longchat-13b-16k.Q5_K_S.gguf about 1 year ago
longchat-13b-16k.Q6_K.gguf

10.7 GB
LFS

add ./longchat-13b-16k.Q6_K.gguf about 1 year ago