mav23
/

LLaMA-2-7B-32K-GGUF

Inference Endpoints

Model card Files Files and versions Community

LLaMA-2-7B-32K-GGUF

1 contributor

History: 9 commits

mav23's picture

Upload folder using huggingface_hub

048261a verified about 2 months ago

.gitattributes

2.01 kB

Upload folder using huggingface_hub about 2 months ago
README.md

6.15 kB

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q2_K.gguf

2.53 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q3_K.gguf

3.3 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q3_K_M.gguf

3.3 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q3_K_S.gguf

2.95 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q4_0.gguf

3.83 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q4_1.gguf

4.24 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q5_0.gguf

4.65 GB
LFS

Upload folder using huggingface_hub about 2 months ago
llama-2-7b-32k.Q5_1.gguf

5.06 GB
LFS

Upload folder using huggingface_hub about 2 months ago