shaowenchen
/

longchat-13b-16k-gguf

Text Generation

Inference Endpoints

Model card Files Files and versions Community

longchat-13b-16k-gguf

2 contributors

History: 17 commits

shaowenchen's picture

add ./longchat-13b-16k.Q8_0.gguf

0ca1887 over 1 year ago

.gitattributes

1.56 kB

add meta files over 1 year ago
README.md
2.09 kB

add meta files over 1 year ago
configuration.json

191 Bytes

add meta files over 1 year ago
longchat-13b-16k.Q2_K.gguf

5.43 GB
LFS

add ./longchat-13b-16k.Q2_K.gguf over 1 year ago
longchat-13b-16k.Q3_K.gguf

6.34 GB
LFS

add ./longchat-13b-16k.Q3_K.gguf over 1 year ago
longchat-13b-16k.Q3_K_L.gguf

6.93 GB
LFS

add ./longchat-13b-16k.Q3_K_L.gguf over 1 year ago
longchat-13b-16k.Q3_K_S.gguf

5.66 GB
LFS

add ./longchat-13b-16k.Q3_K_S.gguf over 1 year ago
longchat-13b-16k.Q4_0.gguf

7.37 GB
LFS

add ./longchat-13b-16k.Q4_0.gguf over 1 year ago
longchat-13b-16k.Q4_1.gguf

8.17 GB
LFS

add ./longchat-13b-16k.Q4_1.gguf over 1 year ago
longchat-13b-16k.Q4_K.gguf

7.87 GB
LFS

add ./longchat-13b-16k.Q4_K.gguf over 1 year ago
longchat-13b-16k.Q4_K_S.gguf

7.41 GB
LFS

add ./longchat-13b-16k.Q4_K_S.gguf over 1 year ago
longchat-13b-16k.Q5_0.gguf

8.97 GB
LFS

add ./longchat-13b-16k.Q5_0.gguf over 1 year ago
longchat-13b-16k.Q5_1.gguf

9.78 GB
LFS

add ./longchat-13b-16k.Q5_1.gguf over 1 year ago
longchat-13b-16k.Q5_K.gguf

9.23 GB
LFS

add ./longchat-13b-16k.Q5_K.gguf over 1 year ago
longchat-13b-16k.Q5_K_S.gguf

8.97 GB
LFS

add ./longchat-13b-16k.Q5_K_S.gguf over 1 year ago
longchat-13b-16k.Q6_K.gguf

10.7 GB
LFS

add ./longchat-13b-16k.Q6_K.gguf over 1 year ago
longchat-13b-16k.Q8_0.gguf

13.8 GB
LFS

add ./longchat-13b-16k.Q8_0.gguf over 1 year ago