mav23
/

LLaMA-2-7B-32K-GGUF

Inference Endpoints

Model card Files Files and versions Community

LLaMA-2-7B-32K-GGUF

1 contributor

History: 13 commits

mav23's picture

Upload folder using huggingface_hub

9ff66dd verified about 2 months ago

.gitattributes

2.26 kB

Upload folder using huggingface_hub about 2 months ago
README.md

6.15 kB

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q2_K.gguf

2.53 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q3_K.gguf

3.3 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q3_K_L.gguf

3.6 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q3_K_M.gguf

3.3 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q3_K_S.gguf

2.95 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q4_0.gguf

3.83 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q4_1.gguf

4.24 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q4_K.gguf

4.08 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q4_K_M.gguf

4.08 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q4_K_S.gguf

3.86 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q5_0.gguf

4.65 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q5_1.gguf

5.06 GB
LFS

Upload folder using huggingface_hub about 2 months ago